Nov 13 09:49:31 user nova-compute[74611]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74611) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 13 09:49:31 user nova-compute[74611]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74611) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 13 09:49:31 user nova-compute[74611]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74611) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 13 09:49:31 user nova-compute[74611]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:49:32 user nova-compute[74611]: INFO nova.virt.driver [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 13 09:49:32 user nova-compute[74611]: INFO nova.compute.provider_config [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] Acquiring lock "singleton_lock" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] Acquired lock "singleton_lock" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] Releasing lock "singleton_lock" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] Full set of CONF: {{(pid=74611) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ******************************************************************************** {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] Configuration options gathered from: {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ================================================================================ {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] allow_resize_to_same_host      = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] arq_binding_timeout            = 300 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] backdoor_port                  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] backdoor_socket                = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] block_device_allocate_retries  = 300 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] block_device_allocate_retries_interval = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cert                           = self.pem {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] compute_monitors               = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] config_dir                     = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] config_drive_format            = iso9660 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] config_source                  = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] console_host                   = user {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] control_exchange               = nova {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cpu_allocation_ratio           = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] daemon                         = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] debug                          = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] default_access_ip_network_name = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] default_availability_zone      = nova {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] default_ephemeral_format       = ext4 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] default_green_pool_size        = 1000 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] default_schedule_zone          = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] disk_allocation_ratio          = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] enable_new_services            = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] enabled_ssl_apis               = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] flat_injected                  = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] force_config_drive             = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] force_raw_images               = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] graceful_shutdown_timeout      = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] heal_instance_info_cache_interval = 60 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] host                           = user {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] instance_build_timeout         = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] instance_delete_interval       = 300 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] instance_name_template         = instance-%08x {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] instance_usage_audit           = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] instance_usage_audit_period    = month {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] internal_service_availability_zone = internal {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] key                            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] live_migration_retry_count     = 30 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] log_config_append              = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] log_dir                        = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] log_file                       = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] log_options                    = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] log_rotate_interval            = 1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] log_rotate_interval_type       = days {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] log_rotation_type              = none {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] long_rpc_timeout               = 1800 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] max_concurrent_builds          = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] max_concurrent_live_migrations = 1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] max_concurrent_snapshots       = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] max_local_block_devices        = 3 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] max_logfile_count              = 30 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] max_logfile_size_mb            = 200 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] maximum_instance_delete_attempts = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] metadata_listen                = 0.0.0.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] metadata_listen_port           = 8775 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] metadata_workers               = 3 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] migrate_max_retries            = -1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] mkisofs_cmd                    = genisoimage {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] my_ip                          = 10.0.0.210 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] network_allocate_retries       = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] osapi_compute_listen_port      = 8774 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] osapi_compute_unique_server_name_scope =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] osapi_compute_workers          = 3 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] password_length                = 12 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] periodic_enable                = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] periodic_fuzzy_delay           = 60 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] pointer_model                  = ps2mouse {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] preallocate_images             = none {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] publish_errors                 = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] pybasedir                      = /opt/stack/nova {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ram_allocation_ratio           = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] rate_limit_burst               = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] rate_limit_except_level        = CRITICAL {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] rate_limit_interval            = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] reboot_timeout                 = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] reclaim_instance_interval      = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] record                         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] reimage_timeout_per_gb         = 60 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] report_interval                = 120 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] rescue_timeout                 = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] reserved_host_cpus             = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] reserved_host_disk_mb          = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] reserved_host_memory_mb        = 512 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] reserved_huge_pages            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] resize_confirm_window          = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] resize_fs_using_block_device   = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] resume_guests_state_on_host_boot = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] rpc_response_timeout           = 60 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] run_external_periodic_tasks    = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] running_deleted_instance_action = reap {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] running_deleted_instance_timeout = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] scheduler_instance_sync_interval = 120 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] service_down_time              = 720 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] servicegroup_driver            = db {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] shelved_offload_time           = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] shelved_poll_interval          = 3600 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] shutdown_timeout               = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] source_is_ipv6                 = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ssl_only                       = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] state_path                     = /opt/stack/data/nova {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] sync_power_state_interval      = 600 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] sync_power_state_pool_size     = 1000 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] syslog_log_facility            = LOG_USER {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] tempdir                        = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] timeout_nbd                    = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] transport_url                  = **** {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] update_resources_interval      = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] use_cow_images                 = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] use_eventlog                   = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] use_journal                    = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] use_json                       = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] use_rootwrap_daemon            = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] use_stderr                     = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] use_syslog                     = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vcpu_pin_set                   = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vif_plugging_is_fatal          = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vif_plugging_timeout           = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] virt_mkfs                      = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] volume_usage_poll_interval     = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] watch_log_file                 = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] web                            = /usr/share/spice-html5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_concurrency.disable_process_locking = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.auth_strategy              = keystone {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.compute_link_prefix        = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.dhcp_domain                = novalocal {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.enable_instance_password   = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.glance_link_prefix         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.instance_list_per_project_cells = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.list_records_by_skipping_down_cells = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.local_metadata_per_cell    = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.max_limit                  = 1000 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.metadata_cache_expiration  = 15 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.neutron_default_tenant_id  = default {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.use_forwarded_for          = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.use_neutron_default_nets   = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.vendordata_dynamic_targets = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.vendordata_jsonfile_path   = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.backend_argument         = **** {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.config_prefix            = cache.oslo {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.dead_timeout             = 60.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.debug_cache_backend      = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.enable_retry_client      = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.enable_socket_keepalive  = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.enabled                  = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.expiration_time          = 600 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.hashclient_retry_attempts = 2 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.memcache_dead_retry      = 300 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.memcache_password        =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.memcache_sasl_enabled    = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.memcache_username        =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.proxies                  = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.retry_attempts           = 2 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.retry_delay              = 0.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.socket_keepalive_count   = 1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.socket_keepalive_idle    = 1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.socket_keepalive_interval = 1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.tls_allowed_ciphers      = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.tls_cafile               = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.tls_certfile             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.tls_enabled              = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cache.tls_keyfile              = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cinder.auth_section            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cinder.auth_type               = password {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cinder.cafile                  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cinder.certfile                = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cinder.collect_timing          = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cinder.cross_az_attach         = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cinder.debug                   = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cinder.endpoint_template       = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cinder.http_retries            = 3 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cinder.insecure                = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cinder.keyfile                 = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cinder.os_region_name          = RegionOne {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cinder.split_loggers           = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cinder.timeout                 = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] compute.cpu_dedicated_set      = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] compute.cpu_shared_set         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] compute.image_type_exclude_list = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] compute.resource_provider_association_refresh = 300 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] compute.shutdown_retry_interval = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] conductor.workers              = 3 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] console.allowed_origins        = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] console.ssl_ciphers            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] console.ssl_minimum_version    = default {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] consoleauth.token_ttl          = 600 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.cafile                  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.certfile                = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.collect_timing          = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.connect_retries         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.connect_retry_delay     = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.endpoint_override       = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.insecure                = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.keyfile                 = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.max_version             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.min_version             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.region_name             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.service_name            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.service_type            = accelerator {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.split_loggers           = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.status_code_retries     = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.status_code_retry_delay = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.timeout                 = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] cyborg.version                 = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.backend               = sqlalchemy {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.connection            = **** {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.connection_debug      = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.connection_parameters =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.connection_recycle_time = 3600 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.connection_trace      = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.db_inc_retry_interval = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.db_max_retries        = 20 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.db_max_retry_interval = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.db_retry_interval     = 1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.max_overflow          = 50 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.max_pool_size         = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.max_retries           = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.mysql_wsrep_sync_wait = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.pool_timeout          = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.retry_interval        = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.slave_connection      = **** {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] database.sqlite_synchronous    = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.backend           = sqlalchemy {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.connection        = **** {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.connection_debug  = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.connection_parameters =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.connection_recycle_time = 3600 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.connection_trace  = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.db_inc_retry_interval = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.db_max_retries    = 20 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.db_max_retry_interval = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.db_retry_interval = 1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.max_overflow      = 50 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.max_pool_size     = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.max_retries       = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.pool_timeout      = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.retry_interval    = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.slave_connection  = **** {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] api_database.sqlite_synchronous = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] devices.enabled_mdev_types     = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ephemeral_storage_encryption.enabled = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.api_servers             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.cafile                  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.certfile                = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.collect_timing          = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.connect_retries         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.connect_retry_delay     = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.debug                   = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.default_trusted_certificate_ids = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.enable_certificate_validation = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.enable_rbd_download     = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.endpoint_override       = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.insecure                = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.keyfile                 = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.max_version             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.min_version             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.num_retries             = 3 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.rbd_ceph_conf           =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.rbd_connect_timeout     = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.rbd_pool                =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.rbd_user                =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.region_name             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.service_name            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.service_type            = image {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.split_loggers           = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.status_code_retries     = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.status_code_retry_delay = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.timeout                 = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.verify_glance_signatures = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] glance.version                 = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] guestfs.debug                  = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.config_drive_cdrom      = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.config_drive_inject_password = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.enable_remotefx         = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.instances_path_share    =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.limit_cpu_features      = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.use_multipath_io        = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.vswitch_name            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] mks.enabled                    = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] image_cache.manager_interval   = 2400 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] image_cache.precache_concurrency = 1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] image_cache.remove_unused_base_images = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] image_cache.subdirectory_name  = _base {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.api_max_retries         = 60 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.api_retry_interval      = 2 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.auth_section            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.auth_type               = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.cafile                  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.certfile                = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.collect_timing          = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.conductor_group         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.connect_retries         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.connect_retry_delay     = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.endpoint_override       = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.insecure                = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.keyfile                 = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.max_version             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.min_version             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.peer_list               = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.region_name             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.serial_console_state_timeout = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.service_name            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.service_type            = baremetal {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.split_loggers           = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.status_code_retries     = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.status_code_retry_delay = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.timeout                 = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ironic.version                 = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] key_manager.fixed_key          = **** {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.barbican_api_version  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.barbican_endpoint     = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.barbican_endpoint_type = public {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.barbican_region_name  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.cafile                = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.certfile              = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.collect_timing        = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.insecure              = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.keyfile               = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.number_of_retries     = 60 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.retry_delay           = 1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.send_service_user_token = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.split_loggers         = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.timeout               = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.verify_ssl            = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican.verify_ssl_path       = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican_service_user.auth_section = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican_service_user.auth_type = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican_service_user.cafile   = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican_service_user.certfile = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican_service_user.collect_timing = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican_service_user.insecure = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican_service_user.keyfile  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican_service_user.split_loggers = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] barbican_service_user.timeout  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.approle_role_id          = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.approle_secret_id        = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.cafile                   = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.certfile                 = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.collect_timing           = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.insecure                 = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.keyfile                  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.kv_mountpoint            = secret {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.kv_path                  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.kv_version               = 2 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.namespace                = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.root_token_id            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.split_loggers            = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.ssl_ca_crt_file          = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.timeout                  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.use_ssl                  = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.auth_section          = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.auth_type             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.cafile                = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.certfile              = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.collect_timing        = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.connect_retries       = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.connect_retry_delay   = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.endpoint_override     = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.insecure              = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.keyfile               = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.max_version           = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.min_version           = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.region_name           = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.service_name          = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.service_type          = identity {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.split_loggers         = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.status_code_retries   = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.status_code_retry_delay = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.timeout               = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] keystone.version               = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.connection_uri         =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.cpu_mode               = custom {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: WARNING oslo_config.cfg [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.cpu_power_governor_high = performance {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.cpu_power_management   = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.device_detach_attempts = 8 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.device_detach_timeout  = 20 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.disk_cachemodes        = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.disk_prefix            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.enabled_perf_events    = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.file_backed_memory     = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.gid_maps               = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.hw_disk_discard        = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.hw_machine_type        = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.images_rbd_pool        = rbd {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.images_type            = default {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.images_volume_group    = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.inject_key             = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.inject_partition       = -2 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.inject_password        = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.iscsi_iface            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.iser_use_multipath     = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.live_migration_downtime = 500 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.live_migration_inbound_addr = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.live_migration_scheme  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.live_migration_timeout_action = abort {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.live_migration_tunnelled = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: WARNING oslo_config.cfg [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 13 09:49:32 user nova-compute[74611]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 13 09:49:32 user nova-compute[74611]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 13 09:49:32 user nova-compute[74611]: and ``live_migration_inbound_addr`` respectively.
Nov 13 09:49:32 user nova-compute[74611]: ).  Its value may be silently ignored in the future.
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.live_migration_with_native_tls = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.max_queues             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.nfs_mount_options      = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.num_pcie_ports         = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.pmem_namespaces        = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.quobyte_client_cfg     = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.rbd_secret_uuid        = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.rbd_user               = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.rescue_image_id        = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.rescue_kernel_id       = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.rx_queue_size          = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.smbfs_mount_options    =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.snapshot_compression   = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.snapshot_image_format  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.sparse_logical_volumes = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.swtpm_enabled          = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.swtpm_group            = tss {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.swtpm_user             = tss {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.sysinfo_serial         = unique {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.tb_cache_size          = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.tx_queue_size          = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.uid_maps               = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.use_virtio_for_bridges = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.virt_type              = kvm {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.volume_clear           = zero {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.volume_clear_size      = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.volume_use_multipath   = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.vzstorage_cache_path   = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.auth_section           = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.auth_type              = password {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.cafile                 = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.certfile               = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.collect_timing         = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.connect_retries        = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.connect_retry_delay    = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.default_floating_pool  = public {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.endpoint_override      = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.extension_sync_interval = 600 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.http_retries           = 3 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.insecure               = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.keyfile                = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.max_version            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.min_version            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.ovs_bridge             = br-int {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.physnets               = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.region_name            = RegionOne {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.service_metadata_proxy = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.service_name           = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.service_type           = network {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.split_loggers          = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.status_code_retries    = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.status_code_retry_delay = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.timeout                = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] neutron.version                = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] notifications.bdms_in_notifications = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] notifications.default_level    = INFO {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] notifications.notification_format = unversioned {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] notifications.notify_on_state_change = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] pci.alias                      = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] pci.device_spec                = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] pci.report_in_placement        = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.auth_section         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.auth_type            = password {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.cafile               = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.certfile             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.collect_timing       = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.connect_retries      = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.connect_retry_delay  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.default_domain_id    = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.default_domain_name  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.domain_id            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.domain_name          = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.endpoint_override    = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.insecure             = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.keyfile              = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.max_version          = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.min_version          = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.password             = **** {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.project_domain_id    = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.project_domain_name  = Default {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.project_id           = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.project_name         = service {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.region_name          = RegionOne {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.service_name         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.service_type         = placement {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.split_loggers        = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.status_code_retries  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.status_code_retry_delay = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.system_scope         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.timeout              = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.trust_id             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.user_domain_id       = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.user_domain_name     = Default {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.user_id              = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.username             = placement {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] placement.version              = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] quota.cores                    = 20 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] quota.count_usage_from_placement = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] quota.injected_file_content_bytes = 10240 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] quota.injected_file_path_length = 255 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] quota.injected_files           = 5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] quota.instances                = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] quota.key_pairs                = 100 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] quota.metadata_items           = 128 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] quota.ram                      = 51200 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] quota.recheck_quota            = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] quota.server_group_members     = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] quota.server_groups            = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] rdp.enabled                    = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] scheduler.image_metadata_prefilter = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] scheduler.max_attempts         = 3 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] scheduler.max_placement_results = 1000 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] scheduler.workers              = 3 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.host_subset_size = 1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.isolated_hosts = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.isolated_images = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.pci_in_placement = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.track_instance_changes = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] metrics.required               = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] metrics.weight_multiplier      = 1.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] metrics.weight_setting         = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] serial_console.enabled         = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] serial_console.port_range      = 10000:20000 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] serial_console.serialproxy_port = 6083 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] service_user.auth_section      = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] service_user.auth_type         = password {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] service_user.cafile            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] service_user.certfile          = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] service_user.collect_timing    = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] service_user.insecure          = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] service_user.keyfile           = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] service_user.send_service_user_token = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] service_user.split_loggers     = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] service_user.timeout           = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] spice.agent_enabled            = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] spice.enabled                  = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] spice.html5proxy_port          = 6082 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] spice.image_compression        = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] spice.jpeg_compression         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] spice.playback_compression     = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] spice.server_listen            = 127.0.0.1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] spice.streaming_mode           = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] spice.zlib_compression         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] upgrade_levels.baseapi         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] upgrade_levels.cert            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] upgrade_levels.compute         = auto {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] upgrade_levels.conductor       = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] upgrade_levels.scheduler       = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vendordata_dynamic_auth.cafile = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vendordata_dynamic_auth.certfile = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vendordata_dynamic_auth.insecure = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vendordata_dynamic_auth.timeout = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.api_retry_count         = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.ca_file                 = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.cache_prefix            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.cluster_name            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.connection_pool_size    = 10 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.console_delay_seconds   = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.datastore_regex         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.host_ip                 = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.host_password           = **** {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.host_port               = 443 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.host_username           = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.insecure                = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.integration_bridge      = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.maximum_objects         = 100 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.pbm_default_policy      = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.pbm_enabled             = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.pbm_wsdl_location       = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.serial_port_proxy_uri   = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.serial_port_service_uri = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.task_poll_interval      = 0.5 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.use_linked_clone        = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.vnc_keymap              = en-us {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.vnc_port                = 5900 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vmware.vnc_port_total          = 10000 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vnc.auth_schemes               = ['none'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vnc.enabled                    = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vnc.novncproxy_port            = 6080 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vnc.vencrypt_ca_certs          = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vnc.vencrypt_client_cert       = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vnc.vencrypt_client_key        = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.disable_rootwrap   = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.enable_numa_live_migration = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.libvirt_disable_apic = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] wsgi.client_socket_timeout     = 900 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] wsgi.default_pool_size         = 1000 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] wsgi.keep_alive                = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] wsgi.max_header_line           = 16384 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] wsgi.ssl_ca_file               = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] wsgi.ssl_cert_file             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] wsgi.ssl_key_file              = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] wsgi.tcp_keepidle              = 600 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] zvm.ca_file                    = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] zvm.cloud_connector_url        = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] zvm.reachable_timeout          = 300 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_policy.enforce_new_defaults = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_policy.enforce_scope      = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_policy.policy_default_rule = default {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] profiler.connection_string     = messaging:// {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] profiler.enabled               = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] profiler.es_doc_type           = notification {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] profiler.es_scroll_size        = 10000 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] profiler.es_scroll_time        = 2m {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] profiler.filter_error_trace    = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] profiler.hmac_keys             = **** {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] profiler.sentinel_service_name = mymaster {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] profiler.socket_timeout        = 0.1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] profiler.trace_requests        = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] profiler.trace_sqlalchemy      = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] profiler_jaeger.process_tags   = {} {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] profiler_jaeger.service_name_prefix = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] profiler_otlp.service_name_prefix = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] remote_debug.host              = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] remote_debug.port              = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_notifications.retry = -1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.auth_section        = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.auth_type           = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.cafile              = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.certfile            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.collect_timing      = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.connect_retries     = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.connect_retry_delay = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.endpoint_id         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.endpoint_override   = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.insecure            = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.keyfile             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.max_version         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.min_version         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.region_name         = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.service_name        = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.service_type        = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.split_loggers       = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.status_code_retries = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.status_code_retry_delay = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.timeout             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.valid_interfaces    = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_limit.version             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_reports.file_event_handler = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] oslo_reports.log_dir           = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vif_plug_ovs_privileged.group  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] vif_plug_ovs_privileged.user   = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] os_vif_ovs.isolate_vif         = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] os_brick.lock_path             = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] privsep_osbrick.capabilities   = [21] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] privsep_osbrick.group          = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] privsep_osbrick.helper_command = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] privsep_osbrick.user           = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] nova_sys_admin.group           = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] nova_sys_admin.helper_command  = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] nova_sys_admin.user            = None {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG oslo_service.service [None req-86f8e2f6-16d2-4bae-aba7-670a118b1977 None None] ******************************************************************************** {{(pid=74611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 13 09:49:32 user nova-compute[74611]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 13 09:49:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Connecting to libvirt: qemu:///system {{(pid=74611) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fbb856f3550> {{(pid=74611) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 13 09:49:32 user nova-compute[74611]: libvirt:  error : internal error: could not initialize domain event timer
Nov 13 09:49:32 user nova-compute[74611]: WARNING nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 13 09:49:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fbb856f3550> {{(pid=74611) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Starting native event thread {{(pid=74611) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Starting green dispatch thread {{(pid=74611) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 13 09:49:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Starting connection event dispatch thread {{(pid=74611) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 13 09:49:32 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Connection event '1' reason 'None'
Nov 13 09:49:32 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 13 09:49:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.mount [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Initialising _HostMountState generation 0 {{(pid=74611) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 13 09:49:40 user nova-compute[74611]: INFO nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Libvirt host capabilities <capabilities>
Nov 13 09:49:40 user nova-compute[74611]:   <host>
Nov 13 09:49:40 user nova-compute[74611]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 13 09:49:40 user nova-compute[74611]:     <cpu>
Nov 13 09:49:40 user nova-compute[74611]:       <arch>x86_64</arch>
Nov 13 09:49:40 user nova-compute[74611]:       <model>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <vendor>Intel</vendor>
Nov 13 09:49:40 user nova-compute[74611]:       <microcode version='1070'/>
Nov 13 09:49:40 user nova-compute[74611]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 13 09:49:40 user nova-compute[74611]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature name='ss'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature name='vmx'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature name='pcid'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature name='osxsave'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature name='hypervisor'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature name='arat'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature name='tsc_adjust'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature name='md-clear'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature name='stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature name='arch-capabilities'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature name='ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature name='invtsc'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature name='rsba'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature name='skip-l1dfl-vmentry'/>
Nov 13 09:49:40 user nova-compute[74611]:       <pages unit='KiB' size='4'/>
Nov 13 09:49:40 user nova-compute[74611]:       <pages unit='KiB' size='2048'/>
Nov 13 09:49:40 user nova-compute[74611]:     </cpu>
Nov 13 09:49:40 user nova-compute[74611]:     <power_management>
Nov 13 09:49:40 user nova-compute[74611]:       <suspend_mem/>
Nov 13 09:49:40 user nova-compute[74611]:       <suspend_disk/>
Nov 13 09:49:40 user nova-compute[74611]:       <suspend_hybrid/>
Nov 13 09:49:40 user nova-compute[74611]:     </power_management>
Nov 13 09:49:40 user nova-compute[74611]:     <iommu support='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     <migration_features>
Nov 13 09:49:40 user nova-compute[74611]:       <live/>
Nov 13 09:49:40 user nova-compute[74611]:       <uri_transports>
Nov 13 09:49:40 user nova-compute[74611]:         <uri_transport>tcp</uri_transport>
Nov 13 09:49:40 user nova-compute[74611]:         <uri_transport>rdma</uri_transport>
Nov 13 09:49:40 user nova-compute[74611]:       </uri_transports>
Nov 13 09:49:40 user nova-compute[74611]:     </migration_features>
Nov 13 09:49:40 user nova-compute[74611]:     <topology>
Nov 13 09:49:40 user nova-compute[74611]:       <cells num='2'>
Nov 13 09:49:40 user nova-compute[74611]:         <cell id='0'>
Nov 13 09:49:40 user nova-compute[74611]:           <memory unit='KiB'>8189224</memory>
Nov 13 09:49:40 user nova-compute[74611]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 13 09:49:40 user nova-compute[74611]:           <pages unit='KiB' size='2048'>0</pages>
Nov 13 09:49:40 user nova-compute[74611]:           <distances>
Nov 13 09:49:40 user nova-compute[74611]:             <sibling id='0' value='10'/>
Nov 13 09:49:40 user nova-compute[74611]:             <sibling id='1' value='20'/>
Nov 13 09:49:40 user nova-compute[74611]:           </distances>
Nov 13 09:49:40 user nova-compute[74611]:           <cpus num='6'>
Nov 13 09:49:40 user nova-compute[74611]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 13 09:49:40 user nova-compute[74611]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 13 09:49:40 user nova-compute[74611]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 13 09:49:40 user nova-compute[74611]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 13 09:49:40 user nova-compute[74611]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 13 09:49:40 user nova-compute[74611]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 13 09:49:40 user nova-compute[74611]:           </cpus>
Nov 13 09:49:40 user nova-compute[74611]:         </cell>
Nov 13 09:49:40 user nova-compute[74611]:         <cell id='1'>
Nov 13 09:49:40 user nova-compute[74611]:           <memory unit='KiB'>8206460</memory>
Nov 13 09:49:40 user nova-compute[74611]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 13 09:49:40 user nova-compute[74611]:           <pages unit='KiB' size='2048'>0</pages>
Nov 13 09:49:40 user nova-compute[74611]:           <distances>
Nov 13 09:49:40 user nova-compute[74611]:             <sibling id='0' value='20'/>
Nov 13 09:49:40 user nova-compute[74611]:             <sibling id='1' value='10'/>
Nov 13 09:49:40 user nova-compute[74611]:           </distances>
Nov 13 09:49:40 user nova-compute[74611]:           <cpus num='6'>
Nov 13 09:49:40 user nova-compute[74611]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 13 09:49:40 user nova-compute[74611]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 13 09:49:40 user nova-compute[74611]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 13 09:49:40 user nova-compute[74611]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 13 09:49:40 user nova-compute[74611]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 13 09:49:40 user nova-compute[74611]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 13 09:49:40 user nova-compute[74611]:           </cpus>
Nov 13 09:49:40 user nova-compute[74611]:         </cell>
Nov 13 09:49:40 user nova-compute[74611]:       </cells>
Nov 13 09:49:40 user nova-compute[74611]:     </topology>
Nov 13 09:49:40 user nova-compute[74611]:     <cache>
Nov 13 09:49:40 user nova-compute[74611]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 13 09:49:40 user nova-compute[74611]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 13 09:49:40 user nova-compute[74611]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 13 09:49:40 user nova-compute[74611]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 13 09:49:40 user nova-compute[74611]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 13 09:49:40 user nova-compute[74611]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 13 09:49:40 user nova-compute[74611]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 13 09:49:40 user nova-compute[74611]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 13 09:49:40 user nova-compute[74611]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 13 09:49:40 user nova-compute[74611]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 13 09:49:40 user nova-compute[74611]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 13 09:49:40 user nova-compute[74611]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 13 09:49:40 user nova-compute[74611]:     </cache>
Nov 13 09:49:40 user nova-compute[74611]:     <secmodel>
Nov 13 09:49:40 user nova-compute[74611]:       <model>apparmor</model>
Nov 13 09:49:40 user nova-compute[74611]:       <doi>0</doi>
Nov 13 09:49:40 user nova-compute[74611]:     </secmodel>
Nov 13 09:49:40 user nova-compute[74611]:     <secmodel>
Nov 13 09:49:40 user nova-compute[74611]:       <model>dac</model>
Nov 13 09:49:40 user nova-compute[74611]:       <doi>0</doi>
Nov 13 09:49:40 user nova-compute[74611]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 13 09:49:40 user nova-compute[74611]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 13 09:49:40 user nova-compute[74611]:     </secmodel>
Nov 13 09:49:40 user nova-compute[74611]:   </host>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='alpha'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>64</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>clipper</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='armv6l'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>32</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>integratorcp</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>borzoi</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>spitz</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>nuri</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>musca-b1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>versatileab</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>kzm</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>musca-a</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>smdkc210</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>sx1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>z2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>tosa</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>sabrelite</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>realview-eb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>n810</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>n800</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>versatilepb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>terrier</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mainstone</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>midway</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>musicpal</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>microbit</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>cubieboard</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>verdex</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>netduino2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>raspi2b</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>cheetah</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>highbank</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>akita</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>connex</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>collie</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>raspi0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='armv7l'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>32</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>integratorcp</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>borzoi</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>spitz</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>nuri</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>musca-b1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>versatileab</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>kzm</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>musca-a</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>smdkc210</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>sx1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>z2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>tosa</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>sabrelite</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>realview-eb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>n810</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>n800</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>versatilepb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>terrier</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mainstone</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>midway</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>musicpal</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>microbit</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>cubieboard</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>verdex</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>netduino2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>raspi2b</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>cheetah</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>highbank</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>akita</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>connex</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>collie</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>raspi0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='aarch64'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>64</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>integratorcp</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>borzoi</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>spitz</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>nuri</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>musca-b1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>versatileab</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>kzm</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>musca-a</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>smdkc210</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>sx1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>z2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>tosa</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>sabrelite</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>realview-eb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>n810</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>n800</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>versatilepb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>terrier</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mainstone</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>midway</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>musicpal</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>microbit</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>cubieboard</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>verdex</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>netduino2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>raspi3b</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>raspi2b</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>cheetah</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>highbank</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>akita</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>connex</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>collie</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>raspi0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <acpi default='on' toggle='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='cris'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>32</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='i686'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>32</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>x-remote</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>isapc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>microvm</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='kvm'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <pae/>
Nov 13 09:49:40 user nova-compute[74611]:       <nonpae/>
Nov 13 09:49:40 user nova-compute[74611]:       <acpi default='on' toggle='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:       <apic default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='m68k'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>32</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>an5206</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>q800</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>next-cube</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='microblaze'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>32</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='microblazeel'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>32</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='mips'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>32</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='16'>malta</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='mipsel'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>32</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='16'>malta</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='mips64'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>64</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='16'>malta</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>pica61</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>magnum</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='mips64el'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>64</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='16'>malta</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>pica61</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>magnum</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='16'>boston</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='ppc'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>32</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>g3beige</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mac99</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>ppce500</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>pegasos2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>sam460ex</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>bamboo</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>40p</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>ref405ep</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>taihu</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='ppc64'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>64</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2048'>powernv9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>taihu</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2048'>powernv10</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>ppce500</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>40p</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>pegasos2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>bamboo</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>g3beige</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mac99</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>sam460ex</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>ref405ep</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2048'>powernv8</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='ppc64le'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>64</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2048'>powernv9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>taihu</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2048'>powernv10</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>ppce500</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>40p</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>pegasos2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>bamboo</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>g3beige</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>mac99</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>sam460ex</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>ref405ep</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2048'>powernv8</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='riscv32'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>32</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='8'>spike</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>opentitan</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='5'>sifive_u</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>sifive_e</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='8'>virt</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='riscv64'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>64</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='8'>spike</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='5'>sifive_u</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>shakti_c</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>sifive_e</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='8'>virt</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='s390x'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>64</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='sh4'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>32</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>shix</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>r2d</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='sh4eb'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>64</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>shix</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>r2d</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='sparc'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>32</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>SS-5</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>SS-20</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>LX</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>SS-4</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>SS-10</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>Voyager</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='sparc64'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>64</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>sun4u</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>niagara</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>sun4v</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='x86_64'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>64</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>x-remote</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='1'>isapc</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>microvm</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='kvm'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <acpi default='on' toggle='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:       <apic default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='xtensa'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>32</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>sim</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>kc705</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>ml605</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>virt</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>lx200</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>lx60</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]:   <guest>
Nov 13 09:49:40 user nova-compute[74611]:     <os_type>hvm</os_type>
Nov 13 09:49:40 user nova-compute[74611]:     <arch name='xtensaeb'>
Nov 13 09:49:40 user nova-compute[74611]:       <wordsize>32</wordsize>
Nov 13 09:49:40 user nova-compute[74611]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='4'>sim</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>kc705</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>ml605</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>virt</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>lx200</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>lx60</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 13 09:49:40 user nova-compute[74611]:       <domain type='qemu'/>
Nov 13 09:49:40 user nova-compute[74611]:     </arch>
Nov 13 09:49:40 user nova-compute[74611]:     <features>
Nov 13 09:49:40 user nova-compute[74611]:       <cpuselection/>
Nov 13 09:49:40 user nova-compute[74611]:       <deviceboot/>
Nov 13 09:49:40 user nova-compute[74611]:       <disksnapshot default='on' toggle='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     </features>
Nov 13 09:49:40 user nova-compute[74611]:   </guest>
Nov 13 09:49:40 user nova-compute[74611]: </capabilities>
Nov 13 09:49:40 user nova-compute[74611]: 
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 13 09:49:40 user nova-compute[74611]: <domainCapabilities>
Nov 13 09:49:40 user nova-compute[74611]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 09:49:40 user nova-compute[74611]:   <domain>kvm</domain>
Nov 13 09:49:40 user nova-compute[74611]:   <machine>pc-q35-6.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:   <arch>i686</arch>
Nov 13 09:49:40 user nova-compute[74611]:   <vcpu max='288'/>
Nov 13 09:49:40 user nova-compute[74611]:   <iothreads supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:   <os supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:     <enum name='firmware'/>
Nov 13 09:49:40 user nova-compute[74611]:     <loader supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='type'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>rom</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>pflash</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='readonly'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>yes</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>no</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='secure'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>no</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </loader>
Nov 13 09:49:40 user nova-compute[74611]:   </os>
Nov 13 09:49:40 user nova-compute[74611]:   <cpu>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='host-passthrough' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='hostPassthroughMigratable'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>off</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='maximum' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='maximumMigratable'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>on</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>off</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='host-model' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <vendor>Intel</vendor>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ss'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='vmx'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='pcid'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='hypervisor'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='arat'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='umip'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='md-clear'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ibpb'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ibrs'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='amd-stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='erms'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='lm'/>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='custom' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>qemu64</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>qemu32</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>phenom</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium3</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium2</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>n270</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>kvm64</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>kvm32</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>coreduo</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>core2duo</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>athlon</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Westmere</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Snowridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>SandyBridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Penryn</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G5</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G4</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G3</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G2</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G1</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Nehalem</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>IvyBridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Icelake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-Rome</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-Milan</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Dhyana</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cooperlake</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Conroe</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>486</model>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:   </cpu>
Nov 13 09:49:40 user nova-compute[74611]:   <memoryBacking supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:     <enum name='sourceType'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>file</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>anonymous</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>memfd</value>
Nov 13 09:49:40 user nova-compute[74611]:     </enum>
Nov 13 09:49:40 user nova-compute[74611]:   </memoryBacking>
Nov 13 09:49:40 user nova-compute[74611]:   <devices>
Nov 13 09:49:40 user nova-compute[74611]:     <disk supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='diskDevice'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>disk</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>cdrom</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>floppy</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>lun</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='bus'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>fdc</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>scsi</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>usb</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>sata</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-non-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </disk>
Nov 13 09:49:40 user nova-compute[74611]:     <graphics supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='type'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>sdl</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vnc</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>spice</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>egl-headless</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </graphics>
Nov 13 09:49:40 user nova-compute[74611]:     <video supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='modelType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vga</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>cirrus</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vmvga</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>qxl</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>none</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>bochs</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>ramfb</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </video>
Nov 13 09:49:40 user nova-compute[74611]:     <hostdev supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='mode'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>subsystem</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='startupPolicy'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>default</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>mandatory</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>requisite</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>optional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='subsysType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>usb</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>pci</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>scsi</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='capsType'/>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='pciBackend'/>
Nov 13 09:49:40 user nova-compute[74611]:     </hostdev>
Nov 13 09:49:40 user nova-compute[74611]:     <rng supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-non-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='backendModel'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>random</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>egd</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>builtin</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </rng>
Nov 13 09:49:40 user nova-compute[74611]:     <filesystem supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='driverType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>path</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>handle</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtiofs</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </filesystem>
Nov 13 09:49:40 user nova-compute[74611]:     <tpm supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>tpm-tis</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>tpm-crb</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='backendModel'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>passthrough</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>emulator</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </tpm>
Nov 13 09:49:40 user nova-compute[74611]:   </devices>
Nov 13 09:49:40 user nova-compute[74611]:   <features>
Nov 13 09:49:40 user nova-compute[74611]:     <gic supported='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     <vmcoreinfo supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <genid supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <backingStoreInput supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <backup supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <sev supported='no'/>
Nov 13 09:49:40 user nova-compute[74611]:   </features>
Nov 13 09:49:40 user nova-compute[74611]: </domainCapabilities>
Nov 13 09:49:40 user nova-compute[74611]:  {{(pid=74611) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 13 09:49:40 user nova-compute[74611]: <domainCapabilities>
Nov 13 09:49:40 user nova-compute[74611]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 09:49:40 user nova-compute[74611]:   <domain>kvm</domain>
Nov 13 09:49:40 user nova-compute[74611]:   <machine>pc-i440fx-6.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:   <arch>i686</arch>
Nov 13 09:49:40 user nova-compute[74611]:   <vcpu max='255'/>
Nov 13 09:49:40 user nova-compute[74611]:   <iothreads supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:   <os supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:     <enum name='firmware'/>
Nov 13 09:49:40 user nova-compute[74611]:     <loader supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='type'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>rom</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>pflash</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='readonly'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>yes</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>no</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='secure'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>no</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </loader>
Nov 13 09:49:40 user nova-compute[74611]:   </os>
Nov 13 09:49:40 user nova-compute[74611]:   <cpu>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='host-passthrough' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='hostPassthroughMigratable'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>off</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='maximum' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='maximumMigratable'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>on</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>off</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='host-model' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <vendor>Intel</vendor>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ss'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='vmx'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='pcid'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='hypervisor'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='arat'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='umip'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='md-clear'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ibpb'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ibrs'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='amd-stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='erms'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='lm'/>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='custom' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>qemu64</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>qemu32</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>phenom</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium3</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium2</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>n270</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>kvm64</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>kvm32</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>coreduo</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>core2duo</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>athlon</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Westmere</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Snowridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>SandyBridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Penryn</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G5</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G4</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G3</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G2</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G1</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Nehalem</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>IvyBridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Icelake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-Rome</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-Milan</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Dhyana</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cooperlake</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Conroe</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>486</model>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:   </cpu>
Nov 13 09:49:40 user nova-compute[74611]:   <memoryBacking supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:     <enum name='sourceType'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>file</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>anonymous</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>memfd</value>
Nov 13 09:49:40 user nova-compute[74611]:     </enum>
Nov 13 09:49:40 user nova-compute[74611]:   </memoryBacking>
Nov 13 09:49:40 user nova-compute[74611]:   <devices>
Nov 13 09:49:40 user nova-compute[74611]:     <disk supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='diskDevice'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>disk</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>cdrom</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>floppy</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>lun</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='bus'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>ide</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>fdc</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>scsi</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>usb</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>sata</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-non-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </disk>
Nov 13 09:49:40 user nova-compute[74611]:     <graphics supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='type'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>sdl</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vnc</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>spice</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>egl-headless</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </graphics>
Nov 13 09:49:40 user nova-compute[74611]:     <video supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='modelType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vga</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>cirrus</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vmvga</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>qxl</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>none</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>bochs</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>ramfb</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </video>
Nov 13 09:49:40 user nova-compute[74611]:     <hostdev supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='mode'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>subsystem</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='startupPolicy'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>default</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>mandatory</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>requisite</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>optional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='subsysType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>usb</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>pci</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>scsi</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='capsType'/>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='pciBackend'/>
Nov 13 09:49:40 user nova-compute[74611]:     </hostdev>
Nov 13 09:49:40 user nova-compute[74611]:     <rng supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-non-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='backendModel'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>random</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>egd</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>builtin</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </rng>
Nov 13 09:49:40 user nova-compute[74611]:     <filesystem supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='driverType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>path</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>handle</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtiofs</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </filesystem>
Nov 13 09:49:40 user nova-compute[74611]:     <tpm supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>tpm-tis</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>tpm-crb</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='backendModel'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>passthrough</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>emulator</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </tpm>
Nov 13 09:49:40 user nova-compute[74611]:   </devices>
Nov 13 09:49:40 user nova-compute[74611]:   <features>
Nov 13 09:49:40 user nova-compute[74611]:     <gic supported='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     <vmcoreinfo supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <genid supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <backingStoreInput supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <backup supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <sev supported='no'/>
Nov 13 09:49:40 user nova-compute[74611]:   </features>
Nov 13 09:49:40 user nova-compute[74611]: </domainCapabilities>
Nov 13 09:49:40 user nova-compute[74611]:  {{(pid=74611) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 13 09:49:40 user nova-compute[74611]: <domainCapabilities>
Nov 13 09:49:40 user nova-compute[74611]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 09:49:40 user nova-compute[74611]:   <domain>kvm</domain>
Nov 13 09:49:40 user nova-compute[74611]:   <machine>pc-q35-jammy</machine>
Nov 13 09:49:40 user nova-compute[74611]:   <arch>i686</arch>
Nov 13 09:49:40 user nova-compute[74611]:   <vcpu max='288'/>
Nov 13 09:49:40 user nova-compute[74611]:   <iothreads supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:   <os supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:     <enum name='firmware'/>
Nov 13 09:49:40 user nova-compute[74611]:     <loader supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='type'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>rom</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>pflash</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='readonly'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>yes</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>no</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='secure'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>no</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </loader>
Nov 13 09:49:40 user nova-compute[74611]:   </os>
Nov 13 09:49:40 user nova-compute[74611]:   <cpu>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='host-passthrough' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='hostPassthroughMigratable'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>off</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='maximum' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='maximumMigratable'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>on</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>off</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='host-model' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <vendor>Intel</vendor>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ss'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='vmx'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='pcid'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='hypervisor'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='arat'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='umip'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='md-clear'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ibpb'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ibrs'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='amd-stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='erms'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='lm'/>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='custom' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>qemu64</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>qemu32</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>phenom</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium3</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium2</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>n270</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>kvm64</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>kvm32</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>coreduo</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>core2duo</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>athlon</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Westmere</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Snowridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>SandyBridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Penryn</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G5</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G4</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G3</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G2</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G1</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Nehalem</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>IvyBridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Icelake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-Rome</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-Milan</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Dhyana</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cooperlake</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Conroe</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>486</model>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:   </cpu>
Nov 13 09:49:40 user nova-compute[74611]:   <memoryBacking supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:     <enum name='sourceType'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>file</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>anonymous</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>memfd</value>
Nov 13 09:49:40 user nova-compute[74611]:     </enum>
Nov 13 09:49:40 user nova-compute[74611]:   </memoryBacking>
Nov 13 09:49:40 user nova-compute[74611]:   <devices>
Nov 13 09:49:40 user nova-compute[74611]:     <disk supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='diskDevice'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>disk</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>cdrom</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>floppy</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>lun</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='bus'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>fdc</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>scsi</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>usb</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>sata</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-non-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </disk>
Nov 13 09:49:40 user nova-compute[74611]:     <graphics supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='type'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>sdl</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vnc</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>spice</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>egl-headless</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </graphics>
Nov 13 09:49:40 user nova-compute[74611]:     <video supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='modelType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vga</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>cirrus</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vmvga</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>qxl</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>none</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>bochs</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>ramfb</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </video>
Nov 13 09:49:40 user nova-compute[74611]:     <hostdev supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='mode'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>subsystem</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='startupPolicy'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>default</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>mandatory</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>requisite</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>optional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='subsysType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>usb</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>pci</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>scsi</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='capsType'/>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='pciBackend'/>
Nov 13 09:49:40 user nova-compute[74611]:     </hostdev>
Nov 13 09:49:40 user nova-compute[74611]:     <rng supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-non-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='backendModel'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>random</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>egd</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>builtin</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </rng>
Nov 13 09:49:40 user nova-compute[74611]:     <filesystem supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='driverType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>path</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>handle</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtiofs</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </filesystem>
Nov 13 09:49:40 user nova-compute[74611]:     <tpm supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>tpm-tis</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>tpm-crb</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='backendModel'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>passthrough</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>emulator</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </tpm>
Nov 13 09:49:40 user nova-compute[74611]:   </devices>
Nov 13 09:49:40 user nova-compute[74611]:   <features>
Nov 13 09:49:40 user nova-compute[74611]:     <gic supported='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     <vmcoreinfo supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <genid supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <backingStoreInput supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <backup supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <sev supported='no'/>
Nov 13 09:49:40 user nova-compute[74611]:   </features>
Nov 13 09:49:40 user nova-compute[74611]: </domainCapabilities>
Nov 13 09:49:40 user nova-compute[74611]:  {{(pid=74611) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 13 09:49:40 user nova-compute[74611]: <domainCapabilities>
Nov 13 09:49:40 user nova-compute[74611]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 09:49:40 user nova-compute[74611]:   <domain>kvm</domain>
Nov 13 09:49:40 user nova-compute[74611]:   <machine>pc-i440fx-jammy</machine>
Nov 13 09:49:40 user nova-compute[74611]:   <arch>i686</arch>
Nov 13 09:49:40 user nova-compute[74611]:   <vcpu max='255'/>
Nov 13 09:49:40 user nova-compute[74611]:   <iothreads supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:   <os supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:     <enum name='firmware'/>
Nov 13 09:49:40 user nova-compute[74611]:     <loader supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='type'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>rom</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>pflash</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='readonly'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>yes</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>no</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='secure'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>no</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </loader>
Nov 13 09:49:40 user nova-compute[74611]:   </os>
Nov 13 09:49:40 user nova-compute[74611]:   <cpu>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='host-passthrough' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='hostPassthroughMigratable'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>off</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='maximum' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='maximumMigratable'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>on</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>off</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='host-model' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <vendor>Intel</vendor>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ss'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='vmx'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='pcid'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='hypervisor'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='arat'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='umip'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='md-clear'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ibpb'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ibrs'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='amd-stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='erms'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='lm'/>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='custom' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>qemu64</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>qemu32</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>phenom</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium3</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium2</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>n270</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>kvm64</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>kvm32</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>coreduo</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>core2duo</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>athlon</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Westmere</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Snowridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>SandyBridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Penryn</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G5</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G4</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G3</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G2</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G1</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Nehalem</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>IvyBridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Icelake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-Rome</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-Milan</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Dhyana</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cooperlake</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Conroe</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>486</model>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:   </cpu>
Nov 13 09:49:40 user nova-compute[74611]:   <memoryBacking supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:     <enum name='sourceType'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>file</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>anonymous</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>memfd</value>
Nov 13 09:49:40 user nova-compute[74611]:     </enum>
Nov 13 09:49:40 user nova-compute[74611]:   </memoryBacking>
Nov 13 09:49:40 user nova-compute[74611]:   <devices>
Nov 13 09:49:40 user nova-compute[74611]:     <disk supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='diskDevice'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>disk</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>cdrom</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>floppy</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>lun</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='bus'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>ide</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>fdc</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>scsi</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>usb</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>sata</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-non-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </disk>
Nov 13 09:49:40 user nova-compute[74611]:     <graphics supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='type'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>sdl</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vnc</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>spice</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>egl-headless</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </graphics>
Nov 13 09:49:40 user nova-compute[74611]:     <video supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='modelType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vga</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>cirrus</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vmvga</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>qxl</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>none</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>bochs</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>ramfb</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </video>
Nov 13 09:49:40 user nova-compute[74611]:     <hostdev supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='mode'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>subsystem</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='startupPolicy'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>default</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>mandatory</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>requisite</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>optional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='subsysType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>usb</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>pci</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>scsi</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='capsType'/>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='pciBackend'/>
Nov 13 09:49:40 user nova-compute[74611]:     </hostdev>
Nov 13 09:49:40 user nova-compute[74611]:     <rng supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-non-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='backendModel'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>random</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>egd</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>builtin</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </rng>
Nov 13 09:49:40 user nova-compute[74611]:     <filesystem supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='driverType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>path</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>handle</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtiofs</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </filesystem>
Nov 13 09:49:40 user nova-compute[74611]:     <tpm supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>tpm-tis</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>tpm-crb</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='backendModel'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>passthrough</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>emulator</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </tpm>
Nov 13 09:49:40 user nova-compute[74611]:   </devices>
Nov 13 09:49:40 user nova-compute[74611]:   <features>
Nov 13 09:49:40 user nova-compute[74611]:     <gic supported='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     <vmcoreinfo supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <genid supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <backingStoreInput supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <backup supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <sev supported='no'/>
Nov 13 09:49:40 user nova-compute[74611]:   </features>
Nov 13 09:49:40 user nova-compute[74611]: </domainCapabilities>
Nov 13 09:49:40 user nova-compute[74611]:  {{(pid=74611) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 13 09:49:40 user nova-compute[74611]: <domainCapabilities>
Nov 13 09:49:40 user nova-compute[74611]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 09:49:40 user nova-compute[74611]:   <domain>kvm</domain>
Nov 13 09:49:40 user nova-compute[74611]:   <machine>pc-q35-6.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:   <arch>x86_64</arch>
Nov 13 09:49:40 user nova-compute[74611]:   <vcpu max='288'/>
Nov 13 09:49:40 user nova-compute[74611]:   <iothreads supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:   <os supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:     <enum name='firmware'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>efi</value>
Nov 13 09:49:40 user nova-compute[74611]:     </enum>
Nov 13 09:49:40 user nova-compute[74611]:     <loader supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='type'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>rom</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>pflash</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='readonly'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>yes</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>no</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='secure'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>yes</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>no</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </loader>
Nov 13 09:49:40 user nova-compute[74611]:   </os>
Nov 13 09:49:40 user nova-compute[74611]:   <cpu>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='host-passthrough' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='hostPassthroughMigratable'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>on</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>off</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='maximum' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='maximumMigratable'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>on</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>off</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='host-model' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <vendor>Intel</vendor>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ss'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='vmx'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='pcid'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='hypervisor'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='arat'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='umip'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='md-clear'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='invtsc'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ibpb'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ibrs'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='amd-stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='rsba'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='erms'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='custom' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>qemu64</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>qemu32</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>phenom</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium3</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium2</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>n270</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>kvm64</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>kvm32</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>coreduo</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>core2duo</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>athlon</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Westmere</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Snowridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>SandyBridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Penryn</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G5</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G4</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G3</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G2</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Opteron_G1</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Nehalem</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>IvyBridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Icelake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-Rome</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-Milan</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Dhyana</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cooperlake</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Conroe</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>486</model>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:   </cpu>
Nov 13 09:49:40 user nova-compute[74611]:   <memoryBacking supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:     <enum name='sourceType'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>file</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>anonymous</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>memfd</value>
Nov 13 09:49:40 user nova-compute[74611]:     </enum>
Nov 13 09:49:40 user nova-compute[74611]:   </memoryBacking>
Nov 13 09:49:40 user nova-compute[74611]:   <devices>
Nov 13 09:49:40 user nova-compute[74611]:     <disk supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='diskDevice'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>disk</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>cdrom</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>floppy</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>lun</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='bus'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>fdc</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>scsi</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>usb</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>sata</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-non-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </disk>
Nov 13 09:49:40 user nova-compute[74611]:     <graphics supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='type'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>sdl</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vnc</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>spice</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>egl-headless</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </graphics>
Nov 13 09:49:40 user nova-compute[74611]:     <video supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='modelType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vga</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>cirrus</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vmvga</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>qxl</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>none</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>bochs</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>ramfb</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </video>
Nov 13 09:49:40 user nova-compute[74611]:     <hostdev supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='mode'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>subsystem</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='startupPolicy'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>default</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>mandatory</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>requisite</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>optional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='subsysType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>usb</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>pci</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>scsi</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='capsType'/>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='pciBackend'/>
Nov 13 09:49:40 user nova-compute[74611]:     </hostdev>
Nov 13 09:49:40 user nova-compute[74611]:     <rng supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-non-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='backendModel'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>random</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>egd</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>builtin</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </rng>
Nov 13 09:49:40 user nova-compute[74611]:     <filesystem supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='driverType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>path</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>handle</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtiofs</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </filesystem>
Nov 13 09:49:40 user nova-compute[74611]:     <tpm supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>tpm-tis</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>tpm-crb</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='backendModel'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>passthrough</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>emulator</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </tpm>
Nov 13 09:49:40 user nova-compute[74611]:   </devices>
Nov 13 09:49:40 user nova-compute[74611]:   <features>
Nov 13 09:49:40 user nova-compute[74611]:     <gic supported='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     <vmcoreinfo supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <genid supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <backingStoreInput supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <backup supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <sev supported='no'/>
Nov 13 09:49:40 user nova-compute[74611]:   </features>
Nov 13 09:49:40 user nova-compute[74611]: </domainCapabilities>
Nov 13 09:49:40 user nova-compute[74611]:  {{(pid=74611) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 13 09:49:40 user nova-compute[74611]: <domainCapabilities>
Nov 13 09:49:40 user nova-compute[74611]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 09:49:40 user nova-compute[74611]:   <domain>kvm</domain>
Nov 13 09:49:40 user nova-compute[74611]:   <machine>pc-i440fx-6.2</machine>
Nov 13 09:49:40 user nova-compute[74611]:   <arch>x86_64</arch>
Nov 13 09:49:40 user nova-compute[74611]:   <vcpu max='255'/>
Nov 13 09:49:40 user nova-compute[74611]:   <iothreads supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:   <os supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:     <enum name='firmware'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>efi</value>
Nov 13 09:49:40 user nova-compute[74611]:     </enum>
Nov 13 09:49:40 user nova-compute[74611]:     <loader supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='type'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>rom</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>pflash</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='readonly'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>yes</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>no</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='secure'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>no</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </loader>
Nov 13 09:49:40 user nova-compute[74611]:   </os>
Nov 13 09:49:40 user nova-compute[74611]:   <cpu>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='host-passthrough' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='hostPassthroughMigratable'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>on</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>off</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='maximum' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='maximumMigratable'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>on</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>off</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='host-model' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <vendor>Intel</vendor>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ss'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='vmx'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='pcid'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='hypervisor'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='arat'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='umip'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='md-clear'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='invtsc'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ibpb'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ibrs'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='amd-stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='rsba'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='erms'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='custom' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>qemu64</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>qemu32</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>phenom</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium3</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium2</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>n270</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>kvm64</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>kvm32</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>coreduo</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>core2duo</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>athlon</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Westmere</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Snowridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>SandyBridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Penryn</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G5</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G4</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G3</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G2</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Opteron_G1</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Nehalem</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>IvyBridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Icelake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-Rome</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-Milan</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Dhyana</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cooperlake</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Conroe</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>486</model>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:   </cpu>
Nov 13 09:49:40 user nova-compute[74611]:   <memoryBacking supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:     <enum name='sourceType'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>file</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>anonymous</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>memfd</value>
Nov 13 09:49:40 user nova-compute[74611]:     </enum>
Nov 13 09:49:40 user nova-compute[74611]:   </memoryBacking>
Nov 13 09:49:40 user nova-compute[74611]:   <devices>
Nov 13 09:49:40 user nova-compute[74611]:     <disk supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='diskDevice'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>disk</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>cdrom</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>floppy</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>lun</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='bus'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>ide</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>fdc</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>scsi</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>usb</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>sata</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-non-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </disk>
Nov 13 09:49:40 user nova-compute[74611]:     <graphics supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='type'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>sdl</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vnc</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>spice</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>egl-headless</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </graphics>
Nov 13 09:49:40 user nova-compute[74611]:     <video supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='modelType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vga</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>cirrus</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vmvga</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>qxl</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>none</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>bochs</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>ramfb</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </video>
Nov 13 09:49:40 user nova-compute[74611]:     <hostdev supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='mode'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>subsystem</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='startupPolicy'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>default</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>mandatory</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>requisite</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>optional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='subsysType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>usb</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>pci</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>scsi</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='capsType'/>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='pciBackend'/>
Nov 13 09:49:40 user nova-compute[74611]:     </hostdev>
Nov 13 09:49:40 user nova-compute[74611]:     <rng supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-non-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='backendModel'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>random</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>egd</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>builtin</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </rng>
Nov 13 09:49:40 user nova-compute[74611]:     <filesystem supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='driverType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>path</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>handle</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtiofs</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </filesystem>
Nov 13 09:49:40 user nova-compute[74611]:     <tpm supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>tpm-tis</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>tpm-crb</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='backendModel'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>passthrough</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>emulator</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </tpm>
Nov 13 09:49:40 user nova-compute[74611]:   </devices>
Nov 13 09:49:40 user nova-compute[74611]:   <features>
Nov 13 09:49:40 user nova-compute[74611]:     <gic supported='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     <vmcoreinfo supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <genid supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <backingStoreInput supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <backup supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <sev supported='no'/>
Nov 13 09:49:40 user nova-compute[74611]:   </features>
Nov 13 09:49:40 user nova-compute[74611]: </domainCapabilities>
Nov 13 09:49:40 user nova-compute[74611]:  {{(pid=74611) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 13 09:49:40 user nova-compute[74611]: <domainCapabilities>
Nov 13 09:49:40 user nova-compute[74611]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 09:49:40 user nova-compute[74611]:   <domain>kvm</domain>
Nov 13 09:49:40 user nova-compute[74611]:   <machine>pc-q35-jammy</machine>
Nov 13 09:49:40 user nova-compute[74611]:   <arch>x86_64</arch>
Nov 13 09:49:40 user nova-compute[74611]:   <vcpu max='288'/>
Nov 13 09:49:40 user nova-compute[74611]:   <iothreads supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:   <os supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:     <enum name='firmware'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>efi</value>
Nov 13 09:49:40 user nova-compute[74611]:     </enum>
Nov 13 09:49:40 user nova-compute[74611]:     <loader supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='type'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>rom</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>pflash</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='readonly'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>yes</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>no</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='secure'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>yes</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>no</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </loader>
Nov 13 09:49:40 user nova-compute[74611]:   </os>
Nov 13 09:49:40 user nova-compute[74611]:   <cpu>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='host-passthrough' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='hostPassthroughMigratable'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>on</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>off</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='maximum' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='maximumMigratable'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>on</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>off</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='host-model' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <vendor>Intel</vendor>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ss'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='vmx'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='pcid'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='hypervisor'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='arat'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='umip'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='md-clear'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='invtsc'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ibpb'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ibrs'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='amd-stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='rsba'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='erms'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='custom' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>qemu64</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>qemu32</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>phenom</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium3</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium2</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>n270</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>kvm64</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>kvm32</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>coreduo</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>core2duo</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>athlon</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Westmere</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Snowridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>SandyBridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Penryn</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G5</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G4</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G3</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G2</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Opteron_G1</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Nehalem</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>IvyBridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Icelake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-Rome</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-Milan</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Dhyana</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cooperlake</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Conroe</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>486</model>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:   </cpu>
Nov 13 09:49:40 user nova-compute[74611]:   <memoryBacking supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:     <enum name='sourceType'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>file</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>anonymous</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>memfd</value>
Nov 13 09:49:40 user nova-compute[74611]:     </enum>
Nov 13 09:49:40 user nova-compute[74611]:   </memoryBacking>
Nov 13 09:49:40 user nova-compute[74611]:   <devices>
Nov 13 09:49:40 user nova-compute[74611]:     <disk supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='diskDevice'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>disk</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>cdrom</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>floppy</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>lun</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='bus'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>fdc</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>scsi</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>usb</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>sata</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-non-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </disk>
Nov 13 09:49:40 user nova-compute[74611]:     <graphics supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='type'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>sdl</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vnc</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>spice</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>egl-headless</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </graphics>
Nov 13 09:49:40 user nova-compute[74611]:     <video supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='modelType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vga</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>cirrus</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vmvga</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>qxl</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>none</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>bochs</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>ramfb</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </video>
Nov 13 09:49:40 user nova-compute[74611]:     <hostdev supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='mode'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>subsystem</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='startupPolicy'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>default</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>mandatory</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>requisite</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>optional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='subsysType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>usb</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>pci</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>scsi</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='capsType'/>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='pciBackend'/>
Nov 13 09:49:40 user nova-compute[74611]:     </hostdev>
Nov 13 09:49:40 user nova-compute[74611]:     <rng supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-non-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='backendModel'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>random</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>egd</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>builtin</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </rng>
Nov 13 09:49:40 user nova-compute[74611]:     <filesystem supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='driverType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>path</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>handle</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtiofs</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </filesystem>
Nov 13 09:49:40 user nova-compute[74611]:     <tpm supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>tpm-tis</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>tpm-crb</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='backendModel'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>passthrough</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>emulator</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </tpm>
Nov 13 09:49:40 user nova-compute[74611]:   </devices>
Nov 13 09:49:40 user nova-compute[74611]:   <features>
Nov 13 09:49:40 user nova-compute[74611]:     <gic supported='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     <vmcoreinfo supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <genid supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <backingStoreInput supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <backup supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <sev supported='no'/>
Nov 13 09:49:40 user nova-compute[74611]:   </features>
Nov 13 09:49:40 user nova-compute[74611]: </domainCapabilities>
Nov 13 09:49:40 user nova-compute[74611]:  {{(pid=74611) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 13 09:49:40 user nova-compute[74611]: <domainCapabilities>
Nov 13 09:49:40 user nova-compute[74611]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 09:49:40 user nova-compute[74611]:   <domain>kvm</domain>
Nov 13 09:49:40 user nova-compute[74611]:   <machine>pc-i440fx-jammy</machine>
Nov 13 09:49:40 user nova-compute[74611]:   <arch>x86_64</arch>
Nov 13 09:49:40 user nova-compute[74611]:   <vcpu max='255'/>
Nov 13 09:49:40 user nova-compute[74611]:   <iothreads supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:   <os supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:     <enum name='firmware'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>efi</value>
Nov 13 09:49:40 user nova-compute[74611]:     </enum>
Nov 13 09:49:40 user nova-compute[74611]:     <loader supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='type'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>rom</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>pflash</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='readonly'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>yes</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>no</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='secure'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>no</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </loader>
Nov 13 09:49:40 user nova-compute[74611]:   </os>
Nov 13 09:49:40 user nova-compute[74611]:   <cpu>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='host-passthrough' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='hostPassthroughMigratable'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>on</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>off</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='maximum' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='maximumMigratable'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>on</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>off</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='host-model' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <vendor>Intel</vendor>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ss'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='vmx'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='pcid'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='hypervisor'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='arat'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='umip'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='md-clear'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='invtsc'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ibpb'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='ibrs'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='amd-stibp'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='rsba'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='erms'/>
Nov 13 09:49:40 user nova-compute[74611]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:     <mode name='custom' supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>qemu64</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>qemu32</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>phenom</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium3</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium2</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>pentium</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>n270</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>kvm64</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>kvm32</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>coreduo</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>core2duo</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>athlon</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Westmere</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Snowridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Skylake-Client</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>SandyBridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Penryn</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G5</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G4</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G3</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Opteron_G2</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Opteron_G1</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Nehalem</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>IvyBridge</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Icelake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Haswell</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-Rome</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-Milan</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>EPYC</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Dhyana</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cooperlake</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>Conroe</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='no'>Broadwell</model>
Nov 13 09:49:40 user nova-compute[74611]:       <model usable='yes'>486</model>
Nov 13 09:49:40 user nova-compute[74611]:     </mode>
Nov 13 09:49:40 user nova-compute[74611]:   </cpu>
Nov 13 09:49:40 user nova-compute[74611]:   <memoryBacking supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:     <enum name='sourceType'>
Nov 13 09:49:40 user nova-compute[74611]:       <value>file</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>anonymous</value>
Nov 13 09:49:40 user nova-compute[74611]:       <value>memfd</value>
Nov 13 09:49:40 user nova-compute[74611]:     </enum>
Nov 13 09:49:40 user nova-compute[74611]:   </memoryBacking>
Nov 13 09:49:40 user nova-compute[74611]:   <devices>
Nov 13 09:49:40 user nova-compute[74611]:     <disk supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='diskDevice'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>disk</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>cdrom</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>floppy</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>lun</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='bus'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>ide</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>fdc</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>scsi</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>usb</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>sata</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-non-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </disk>
Nov 13 09:49:40 user nova-compute[74611]:     <graphics supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='type'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>sdl</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vnc</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>spice</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>egl-headless</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </graphics>
Nov 13 09:49:40 user nova-compute[74611]:     <video supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='modelType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vga</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>cirrus</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>vmvga</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>qxl</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>none</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>bochs</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>ramfb</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </video>
Nov 13 09:49:40 user nova-compute[74611]:     <hostdev supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='mode'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>subsystem</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='startupPolicy'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>default</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>mandatory</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>requisite</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>optional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='subsysType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>usb</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>pci</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>scsi</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='capsType'/>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='pciBackend'/>
Nov 13 09:49:40 user nova-compute[74611]:     </hostdev>
Nov 13 09:49:40 user nova-compute[74611]:     <rng supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtio-non-transitional</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='backendModel'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>random</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>egd</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>builtin</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </rng>
Nov 13 09:49:40 user nova-compute[74611]:     <filesystem supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='driverType'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>path</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>handle</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>virtiofs</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </filesystem>
Nov 13 09:49:40 user nova-compute[74611]:     <tpm supported='yes'>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='model'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>tpm-tis</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>tpm-crb</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:       <enum name='backendModel'>
Nov 13 09:49:40 user nova-compute[74611]:         <value>passthrough</value>
Nov 13 09:49:40 user nova-compute[74611]:         <value>emulator</value>
Nov 13 09:49:40 user nova-compute[74611]:       </enum>
Nov 13 09:49:40 user nova-compute[74611]:     </tpm>
Nov 13 09:49:40 user nova-compute[74611]:   </devices>
Nov 13 09:49:40 user nova-compute[74611]:   <features>
Nov 13 09:49:40 user nova-compute[74611]:     <gic supported='no'/>
Nov 13 09:49:40 user nova-compute[74611]:     <vmcoreinfo supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <genid supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <backingStoreInput supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <backup supported='yes'/>
Nov 13 09:49:40 user nova-compute[74611]:     <sev supported='no'/>
Nov 13 09:49:40 user nova-compute[74611]:   </features>
Nov 13 09:49:40 user nova-compute[74611]: </domainCapabilities>
Nov 13 09:49:40 user nova-compute[74611]:  {{(pid=74611) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74611) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74611) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Checking secure boot support for host arch (x86_64) {{(pid=74611) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 13 09:49:40 user nova-compute[74611]: INFO nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Secure Boot support detected
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] cpu compare xml: <cpu match="exact">
Nov 13 09:49:40 user nova-compute[74611]:   <model>Nehalem</model>
Nov 13 09:49:40 user nova-compute[74611]: </cpu>
Nov 13 09:49:40 user nova-compute[74611]:  {{(pid=74611) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 13 09:49:40 user nova-compute[74611]: INFO nova.virt.node [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Generated node identity f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a
Nov 13 09:49:40 user nova-compute[74611]: INFO nova.virt.node [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Wrote node identity f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a to /opt/stack/data/nova/compute_id
Nov 13 09:49:40 user nova-compute[74611]: WARNING nova.compute.manager [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Compute nodes ['f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 13 09:49:40 user nova-compute[74611]: INFO nova.compute.manager [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 13 09:49:40 user nova-compute[74611]: WARNING nova.compute.manager [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 13 09:49:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 09:49:40 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:49:40 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Hypervisor/Node resource view: name=user free_ram=10946MB free_disk=26.306644439697266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:49:40 user nova-compute[74611]: WARNING nova.compute.resource_tracker [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] No compute node record for user:f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a could not be found.
Nov 13 09:49:40 user nova-compute[74611]: INFO nova.compute.resource_tracker [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Compute node record created for user:user with uuid: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 09:49:40 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 09:49:41 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] [req-e17a0935-3b91-4189-98fa-e9f0c0d59c6b] Created resource provider record via placement API for resource provider with UUID f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a and name user.
Nov 13 09:49:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74611) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 13 09:49:41 user nova-compute[74611]: INFO nova.virt.libvirt.host [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] kernel doesn't support AMD SEV
Nov 13 09:49:41 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Updating inventory in ProviderTree for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 09:49:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:49:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Libvirt baseline CPU <cpu>
Nov 13 09:49:41 user nova-compute[74611]:   <arch>x86_64</arch>
Nov 13 09:49:41 user nova-compute[74611]:   <model>Nehalem</model>
Nov 13 09:49:41 user nova-compute[74611]:   <vendor>Intel</vendor>
Nov 13 09:49:41 user nova-compute[74611]:   <topology sockets="6" cores="1" threads="1"/>
Nov 13 09:49:41 user nova-compute[74611]: </cpu>
Nov 13 09:49:41 user nova-compute[74611]:  {{(pid=74611) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 13 09:49:41 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Updated inventory for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 13 09:49:41 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Updating resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a generation from 0 to 1 during operation: update_inventory {{(pid=74611) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 13 09:49:41 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Updating inventory in ProviderTree for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 09:49:41 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Updating resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a generation from 1 to 2 during operation: update_traits {{(pid=74611) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 13 09:49:41 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 09:49:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:49:41 user nova-compute[74611]: DEBUG nova.service [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Creating RPC server for service compute {{(pid=74611) start /opt/stack/nova/nova/service.py:182}}
Nov 13 09:49:41 user nova-compute[74611]: DEBUG nova.service [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] Join ServiceGroup membership for this service compute {{(pid=74611) start /opt/stack/nova/nova/service.py:199}}
Nov 13 09:49:41 user nova-compute[74611]: DEBUG nova.servicegroup.drivers.db [None req-4476c632-365c-4a3e-a105-b0593f079e46 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74611) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 13 09:50:26 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:50:26 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Didn't find any instances for network info cache update. {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 09:50:32 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:50:32 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:50:32 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=10350MB free_disk=26.210472106933594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 09:50:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:51:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:51:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:51:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:51:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 09:51:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 09:51:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Didn't find any instances for network info cache update. {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 09:51:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:51:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 09:51:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:51:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:51:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:51:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:51:32 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 09:51:33 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:51:33 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:51:33 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=10311MB free_disk=26.274795532226562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 09:51:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:51:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:51:33 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 09:51:33 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 09:51:33 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:51:33 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:51:33 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 09:51:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:51:33 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:51:33 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:51:33 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:51:34 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:51:34 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:52:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:52:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:52:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 09:52:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 09:52:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Didn't find any instances for network info cache update. {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 09:52:33 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:52:33 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:52:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:52:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:52:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:52:33 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 09:52:33 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:52:33 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:52:33 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=10344MB free_disk=26.027271270751953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 09:52:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:52:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:52:33 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 09:52:33 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 09:52:33 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:52:33 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:52:33 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 09:52:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:52:34 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:52:34 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:52:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 09:52:35 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:52:35 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:52:36 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:53:33 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:53:33 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:53:34 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:53:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 09:53:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 09:53:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Didn't find any instances for network info cache update. {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 09:53:34 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:53:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 09:53:35 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:53:35 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:53:35 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:53:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:35 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 09:53:35 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:53:35 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:53:35 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=9605MB free_disk=26.047138214111328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 09:53:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:35 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 09:53:35 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 09:53:35 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:53:35 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:53:35 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 09:53:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:36 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:53:36 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:53:37 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:53:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:38 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:53:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:53:39 user nova-compute[74611]: INFO nova.compute.claims [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Claim successful on node user
Nov 13 09:53:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG nova.network.neutron [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:53:39 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:53:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:53:39 user nova-compute[74611]: INFO nova.compute.claims [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Claim successful on node user
Nov 13 09:53:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:53:39 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Creating image(s)
Nov 13 09:53:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "/opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "/opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "/opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:53:39 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:53:39 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:53:40 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:53:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915.part --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:40 user nova-compute[74611]: DEBUG nova.policy [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '863471360be04ab5acb07ef3e99007c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9ab18bb67e4db19e6c3366771ad218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:53:40 user nova-compute[74611]: DEBUG nova.policy [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6bc911a5649643a6a3606d8b80e20eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e3b3233a5b43d682200d91f29a80b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:53:40 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:53:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:53:40 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Creating image(s)
Nov 13 09:53:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "/opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "/opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915.part --force-share --output=json" returned: 0 in 0.186s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:40 user nova-compute[74611]: DEBUG nova.virt.images [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] b51f50a6-3c60-4450-bd2c-4073087acec9 was qcow2, converting to raw {{(pid=74611) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 09:53:40 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 09:53:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915.part /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915.converted {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915.part /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915.converted" returned: 0 in 0.288s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915.converted --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915.converted --force-share --output=json" returned: 0 in 0.167s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.475s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:41 user nova-compute[74611]: INFO oslo.privsep.daemon [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpnx9202tk/privsep.sock']
Nov 13 09:53:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.477s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:41 user sudo[83861]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpnx9202tk/privsep.sock
Nov 13 09:53:41 user sudo[83861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 13 09:53:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:41 user nova-compute[74611]: DEBUG nova.compute.manager [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:53:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:53:41 user nova-compute[74611]: INFO nova.compute.claims [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Claim successful on node user
Nov 13 09:53:41 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:53:41 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:53:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:41 user nova-compute[74611]: DEBUG nova.compute.manager [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG nova.network.neutron [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:53:42 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:53:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Successfully created port: e5967c05-de89-4853-b421-516eb483271e {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:53:42 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Creating image(s)
Nov 13 09:53:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "/opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "/opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "/opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG nova.policy [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '863471360be04ab5acb07ef3e99007c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9ab18bb67e4db19e6c3366771ad218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:53:42 user sudo[83861]: pam_unix(sudo:session): session closed for user root
Nov 13 09:53:42 user nova-compute[74611]: INFO oslo.privsep.daemon [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Spawned new privsep daemon via rootwrap
Nov 13 09:53:42 user nova-compute[74611]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 13 09:53:42 user nova-compute[74611]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 13 09:53:42 user nova-compute[74611]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 13 09:53:42 user nova-compute[74611]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83867
Nov 13 09:53:42 user nova-compute[74611]: WARNING oslo_privsep.priv_context [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] privsep daemon already running
Nov 13 09:53:42 user nova-compute[74611]: WARNING oslo_privsep.priv_context [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] privsep daemon already running
Nov 13 09:53:42 user nova-compute[74611]: DEBUG nova.network.neutron [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Successfully created port: 18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "1c66c8a8-abb5-4f60-8464-074627c213d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "1c66c8a8-abb5-4f60-8464-074627c213d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:42 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:53:42 user nova-compute[74611]: INFO nova.compute.claims [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Claim successful on node user
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.194s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.204s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.165s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk 1073741824" returned: 0 in 0.052s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.200s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.201s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG nova.compute.manager [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk 1073741824" returned: 0 in 0.067s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.474s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Cannot resize image /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Ensure instance console log exists: /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG nova.compute.manager [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG nova.network.neutron [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.162s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.164s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:43 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk 1073741824" returned: 0 in 0.045s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG nova.compute.manager [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Cannot resize image /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Ensure instance console log exists: /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG nova.policy [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21adb30d68754dba856e5d0a3ae6727e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd392465e2d4ff0b511c9e543972244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.160s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:53:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG nova.compute.manager [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:53:44 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Creating image(s)
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "/opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "/opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Cannot resize image /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Ensure instance console log exists: /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.189s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Successfully created port: 7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.160s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk 1073741824" returned: 0 in 0.045s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.156s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Successfully updated port: 18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Successfully updated port: e5967c05-de89-4853-b421-516eb483271e {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Cannot resize image /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Ensure instance console log exists: /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquired lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "refresh_cache-f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquired lock "refresh_cache-f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:53:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:53:45 user nova-compute[74611]: DEBUG nova.network.neutron [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:53:45 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:53:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-2725149f-9f58-49ff-a7e5-355994de57cd req-afa6908c-7237-4bae-9a14-43ef22ccd028 service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Received event network-changed-e5967c05-de89-4853-b421-516eb483271e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:53:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-2725149f-9f58-49ff-a7e5-355994de57cd req-afa6908c-7237-4bae-9a14-43ef22ccd028 service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Refreshing instance network info cache due to event network-changed-e5967c05-de89-4853-b421-516eb483271e. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:53:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2725149f-9f58-49ff-a7e5-355994de57cd req-afa6908c-7237-4bae-9a14-43ef22ccd028 service nova] Acquiring lock "refresh_cache-f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:53:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-f9da8e3c-fc5e-46db-921a-eb911c805c0b req-8c88c62c-0266-4743-b49f-8c462e679f4f service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received event network-changed-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:53:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-f9da8e3c-fc5e-46db-921a-eb911c805c0b req-8c88c62c-0266-4743-b49f-8c462e679f4f service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Refreshing instance network info cache due to event network-changed-18262a82-8847-4594-98ce-2ad50387fbf2. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:53:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f9da8e3c-fc5e-46db-921a-eb911c805c0b req-8c88c62c-0266-4743-b49f-8c462e679f4f service nova] Acquiring lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:53:45 user nova-compute[74611]: DEBUG nova.network.neutron [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Successfully created port: af98cec6-7e77-428e-b0df-8901c45fafe5 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:53:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:45 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:53:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:45 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:53:45 user nova-compute[74611]: INFO nova.compute.claims [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Claim successful on node user
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.network.neutron [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Updating instance_info_cache with network_info: [{"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Releasing lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Instance network_info: |[{"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f9da8e3c-fc5e-46db-921a-eb911c805c0b req-8c88c62c-0266-4743-b49f-8c462e679f4f service nova] Acquired lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.network.neutron [req-f9da8e3c-fc5e-46db-921a-eb911c805c0b req-8c88c62c-0266-4743-b49f-8c462e679f4f service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Refreshing network info cache for port 18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Start _get_guest_xml network_info=[{"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:53:46 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:53:46 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-263488679',display_name='tempest-ServerRescueNegativeTestJSON-server-263488679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-263488679',id=1,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae9ab18bb67e4db19e6c3366771ad218',ramdisk_id='',reservation_id='r-ldcvdrmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-961432289',owner_user_name='tempest-ServerRescueNegativeTestJSON-961432289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:53:40Z,user_data=None,user_id='863471360be04ab5acb07ef3e99007c4',uuid=ccd219ab-ccdc-4eee-a7d4-484e3cc597c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converting VIF {"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:7e:57,bridge_name='br-int',has_traffic_filtering=True,id=18262a82-8847-4594-98ce-2ad50387fbf2,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18262a82-88') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.objects.instance [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'pci_devices' on Instance uuid ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Updating instance_info_cache with network_info: [{"id": "e5967c05-de89-4853-b421-516eb483271e", "address": "fa:16:3e:c6:32:07", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5967c05-de", "ovs_interfaceid": "e5967c05-de89-4853-b421-516eb483271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:53:46 user nova-compute[74611]:   <uuid>ccd219ab-ccdc-4eee-a7d4-484e3cc597c6</uuid>
Nov 13 09:53:46 user nova-compute[74611]:   <name>instance-00000001</name>
Nov 13 09:53:46 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:53:46 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:53:46 user nova-compute[74611]:   <metadata>
Nov 13 09:53:46 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:53:46 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:53:46 user nova-compute[74611]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-263488679</nova:name>
Nov 13 09:53:46 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:53:46</nova:creationTime>
Nov 13 09:53:46 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:53:46 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:53:46 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:53:46 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:53:46 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:53:46 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:53:46 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:53:46 user nova-compute[74611]:       <nova:owner>
Nov 13 09:53:46 user nova-compute[74611]:         <nova:user uuid="863471360be04ab5acb07ef3e99007c4">tempest-ServerRescueNegativeTestJSON-961432289-project-member</nova:user>
Nov 13 09:53:46 user nova-compute[74611]:         <nova:project uuid="ae9ab18bb67e4db19e6c3366771ad218">tempest-ServerRescueNegativeTestJSON-961432289</nova:project>
Nov 13 09:53:46 user nova-compute[74611]:       </nova:owner>
Nov 13 09:53:46 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:53:46 user nova-compute[74611]:       <nova:ports>
Nov 13 09:53:46 user nova-compute[74611]:         <nova:port uuid="18262a82-8847-4594-98ce-2ad50387fbf2">
Nov 13 09:53:46 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 09:53:46 user nova-compute[74611]:         </nova:port>
Nov 13 09:53:46 user nova-compute[74611]:       </nova:ports>
Nov 13 09:53:46 user nova-compute[74611]:     </nova:instance>
Nov 13 09:53:46 user nova-compute[74611]:   </metadata>
Nov 13 09:53:46 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:53:46 user nova-compute[74611]:     <system>
Nov 13 09:53:46 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:53:46 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:53:46 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:53:46 user nova-compute[74611]:       <entry name="serial">ccd219ab-ccdc-4eee-a7d4-484e3cc597c6</entry>
Nov 13 09:53:46 user nova-compute[74611]:       <entry name="uuid">ccd219ab-ccdc-4eee-a7d4-484e3cc597c6</entry>
Nov 13 09:53:46 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:53:46 user nova-compute[74611]:     </system>
Nov 13 09:53:46 user nova-compute[74611]:   </sysinfo>
Nov 13 09:53:46 user nova-compute[74611]:   <os>
Nov 13 09:53:46 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:53:46 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:53:46 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:53:46 user nova-compute[74611]:   </os>
Nov 13 09:53:46 user nova-compute[74611]:   <features>
Nov 13 09:53:46 user nova-compute[74611]:     <acpi/>
Nov 13 09:53:46 user nova-compute[74611]:     <apic/>
Nov 13 09:53:46 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:53:46 user nova-compute[74611]:   </features>
Nov 13 09:53:46 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:53:46 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:53:46 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:53:46 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:53:46 user nova-compute[74611]:   </clock>
Nov 13 09:53:46 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:53:46 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:53:46 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:53:46 user nova-compute[74611]:   </cpu>
Nov 13 09:53:46 user nova-compute[74611]:   <devices>
Nov 13 09:53:46 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:53:46 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:53:46 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk"/>
Nov 13 09:53:46 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:53:46 user nova-compute[74611]:     </disk>
Nov 13 09:53:46 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:53:46 user nova-compute[74611]:       <mac address="fa:16:3e:47:7e:57"/>
Nov 13 09:53:46 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:53:46 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:53:46 user nova-compute[74611]:       <target dev="tap18262a82-88"/>
Nov 13 09:53:46 user nova-compute[74611]:     </interface>
Nov 13 09:53:46 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:53:46 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/console.log" append="off"/>
Nov 13 09:53:46 user nova-compute[74611]:     </serial>
Nov 13 09:53:46 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:53:46 user nova-compute[74611]:     <video>
Nov 13 09:53:46 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:53:46 user nova-compute[74611]:     </video>
Nov 13 09:53:46 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:53:46 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:53:46 user nova-compute[74611]:     </rng>
Nov 13 09:53:46 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:53:46 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:53:46 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:53:46 user nova-compute[74611]:     </memballoon>
Nov 13 09:53:46 user nova-compute[74611]:   </devices>
Nov 13 09:53:46 user nova-compute[74611]: </domain>
Nov 13 09:53:46 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-263488679',display_name='tempest-ServerRescueNegativeTestJSON-server-263488679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-263488679',id=1,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae9ab18bb67e4db19e6c3366771ad218',ramdisk_id='',reservation_id='r-ldcvdrmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-961432289',owner_user_name='tempest-ServerRescueNegativeTestJSON-961432289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:53:40Z,user_data=None,user_id='863471360be04ab5acb07ef3e99007c4',uuid=ccd219ab-ccdc-4eee-a7d4-484e3cc597c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converting VIF {"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:7e:57,bridge_name='br-int',has_traffic_filtering=True,id=18262a82-8847-4594-98ce-2ad50387fbf2,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18262a82-88') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG os_vif [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:7e:57,bridge_name='br-int',has_traffic_filtering=True,id=18262a82-8847-4594-98ce-2ad50387fbf2,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18262a82-88') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Releasing lock "refresh_cache-f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Instance network_info: |[{"id": "e5967c05-de89-4853-b421-516eb483271e", "address": "fa:16:3e:c6:32:07", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5967c05-de", "ovs_interfaceid": "e5967c05-de89-4853-b421-516eb483271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Created schema index Interface.name {{(pid=74611) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Created schema index Port.name {{(pid=74611) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Created schema index Bridge.name {{(pid=74611) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2725149f-9f58-49ff-a7e5-355994de57cd req-afa6908c-7237-4bae-9a14-43ef22ccd028 service nova] Acquired lock "refresh_cache-f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.network.neutron [req-2725149f-9f58-49ff-a7e5-355994de57cd req-afa6908c-7237-4bae-9a14-43ef22ccd028 service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Refreshing network info cache for port e5967c05-de89-4853-b421-516eb483271e {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Start _get_guest_xml network_info=[{"id": "e5967c05-de89-4853-b421-516eb483271e", "address": "fa:16:3e:c6:32:07", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5967c05-de", "ovs_interfaceid": "e5967c05-de89-4853-b421-516eb483271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [POLLOUT] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6067f44a-f860-54db-a9b3-156620673ae5', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:53:46 user nova-compute[74611]: INFO oslo.privsep.daemon [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp_kf4vb4v/privsep.sock']
Nov 13 09:53:46 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:53:46 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:53:46 user sudo[83936]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp_kf4vb4v/privsep.sock
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:53:46 user sudo[83936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-806042334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-806042334',id=2,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83e3b3233a5b43d682200d91f29a80b4',ramdisk_id='',reservation_id='r-ouqg89w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-182847603',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:53:40Z,user_data=None,user_id='6bc911a5649643a6a3606d8b80e20eb0',uuid=f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5967c05-de89-4853-b421-516eb483271e", "address": "fa:16:3e:c6:32:07", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5967c05-de", "ovs_interfaceid": "e5967c05-de89-4853-b421-516eb483271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converting VIF {"id": "e5967c05-de89-4853-b421-516eb483271e", "address": "fa:16:3e:c6:32:07", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5967c05-de", "ovs_interfaceid": "e5967c05-de89-4853-b421-516eb483271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:32:07,bridge_name='br-int',has_traffic_filtering=True,id=e5967c05-de89-4853-b421-516eb483271e,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5967c05-de') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.objects.instance [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'pci_devices' on Instance uuid f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:53:46 user nova-compute[74611]:   <uuid>f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28</uuid>
Nov 13 09:53:46 user nova-compute[74611]:   <name>instance-00000002</name>
Nov 13 09:53:46 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:53:46 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:53:46 user nova-compute[74611]:   <metadata>
Nov 13 09:53:46 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:53:46 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:53:46 user nova-compute[74611]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-806042334</nova:name>
Nov 13 09:53:46 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:53:46</nova:creationTime>
Nov 13 09:53:46 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:53:46 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:53:46 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:53:46 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:53:46 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:53:46 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:53:46 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:53:46 user nova-compute[74611]:       <nova:owner>
Nov 13 09:53:46 user nova-compute[74611]:         <nova:user uuid="6bc911a5649643a6a3606d8b80e20eb0">tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member</nova:user>
Nov 13 09:53:46 user nova-compute[74611]:         <nova:project uuid="83e3b3233a5b43d682200d91f29a80b4">tempest-ServerBootFromVolumeStableRescueTest-182847603</nova:project>
Nov 13 09:53:46 user nova-compute[74611]:       </nova:owner>
Nov 13 09:53:46 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:53:46 user nova-compute[74611]:       <nova:ports>
Nov 13 09:53:46 user nova-compute[74611]:         <nova:port uuid="e5967c05-de89-4853-b421-516eb483271e">
Nov 13 09:53:46 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 09:53:46 user nova-compute[74611]:         </nova:port>
Nov 13 09:53:46 user nova-compute[74611]:       </nova:ports>
Nov 13 09:53:46 user nova-compute[74611]:     </nova:instance>
Nov 13 09:53:46 user nova-compute[74611]:   </metadata>
Nov 13 09:53:46 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:53:46 user nova-compute[74611]:     <system>
Nov 13 09:53:46 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:53:46 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:53:46 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:53:46 user nova-compute[74611]:       <entry name="serial">f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28</entry>
Nov 13 09:53:46 user nova-compute[74611]:       <entry name="uuid">f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28</entry>
Nov 13 09:53:46 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:53:46 user nova-compute[74611]:     </system>
Nov 13 09:53:46 user nova-compute[74611]:   </sysinfo>
Nov 13 09:53:46 user nova-compute[74611]:   <os>
Nov 13 09:53:46 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:53:46 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:53:46 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:53:46 user nova-compute[74611]:   </os>
Nov 13 09:53:46 user nova-compute[74611]:   <features>
Nov 13 09:53:46 user nova-compute[74611]:     <acpi/>
Nov 13 09:53:46 user nova-compute[74611]:     <apic/>
Nov 13 09:53:46 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:53:46 user nova-compute[74611]:   </features>
Nov 13 09:53:46 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:53:46 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:53:46 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:53:46 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:53:46 user nova-compute[74611]:   </clock>
Nov 13 09:53:46 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:53:46 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:53:46 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:53:46 user nova-compute[74611]:   </cpu>
Nov 13 09:53:46 user nova-compute[74611]:   <devices>
Nov 13 09:53:46 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:53:46 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:53:46 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk"/>
Nov 13 09:53:46 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:53:46 user nova-compute[74611]:     </disk>
Nov 13 09:53:46 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:53:46 user nova-compute[74611]:       <mac address="fa:16:3e:c6:32:07"/>
Nov 13 09:53:46 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:53:46 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:53:46 user nova-compute[74611]:       <target dev="tape5967c05-de"/>
Nov 13 09:53:46 user nova-compute[74611]:     </interface>
Nov 13 09:53:46 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:53:46 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/console.log" append="off"/>
Nov 13 09:53:46 user nova-compute[74611]:     </serial>
Nov 13 09:53:46 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:53:46 user nova-compute[74611]:     <video>
Nov 13 09:53:46 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:53:46 user nova-compute[74611]:     </video>
Nov 13 09:53:46 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:53:46 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:53:46 user nova-compute[74611]:     </rng>
Nov 13 09:53:46 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:53:46 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:53:46 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:53:46 user nova-compute[74611]:     </memballoon>
Nov 13 09:53:46 user nova-compute[74611]:   </devices>
Nov 13 09:53:46 user nova-compute[74611]: </domain>
Nov 13 09:53:46 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-806042334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-806042334',id=2,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83e3b3233a5b43d682200d91f29a80b4',ramdisk_id='',reservation_id='r-ouqg89w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-182847603',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:53:40Z,user_data=None,user_id='6bc911a5649643a6a3606d8b80e20eb0',uuid=f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5967c05-de89-4853-b421-516eb483271e", "address": "fa:16:3e:c6:32:07", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5967c05-de", "ovs_interfaceid": "e5967c05-de89-4853-b421-516eb483271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converting VIF {"id": "e5967c05-de89-4853-b421-516eb483271e", "address": "fa:16:3e:c6:32:07", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5967c05-de", "ovs_interfaceid": "e5967c05-de89-4853-b421-516eb483271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:32:07,bridge_name='br-int',has_traffic_filtering=True,id=e5967c05-de89-4853-b421-516eb483271e,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5967c05-de') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG os_vif [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:32:07,bridge_name='br-int',has_traffic_filtering=True,id=e5967c05-de89-4853-b421-516eb483271e,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5967c05-de') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f19e1449-7055-5ce1-bdb1-9d45546d5b66', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.network.neutron [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Successfully updated port: 7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "refresh_cache-85cb3adb-b2b3-49ec-92ab-c2b7a028241a" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquired lock "refresh_cache-85cb3adb-b2b3-49ec-92ab-c2b7a028241a" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.network.neutron [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.717s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:53:46 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:53:46 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Creating image(s)
Nov 13 09:53:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "/opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "/opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "/opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:46 user nova-compute[74611]: DEBUG nova.policy [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '008616dff48b4bdeb2ea0f2be72a2934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a6f570a7e7404680bd5809be8b0378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.network.neutron [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.167s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk 1073741824" returned: 0 in 0.042s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.compute.manager [req-fae37950-39eb-44b3-a584-d8ad3291b2bd req-0b54fdc2-ffe5-49db-9b37-206c08c2c6ac service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received event network-changed-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.compute.manager [req-fae37950-39eb-44b3-a584-d8ad3291b2bd req-0b54fdc2-ffe5-49db-9b37-206c08c2c6ac service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Refreshing instance network info cache due to event network-changed-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fae37950-39eb-44b3-a584-d8ad3291b2bd req-0b54fdc2-ffe5-49db-9b37-206c08c2c6ac service nova] Acquiring lock "refresh_cache-85cb3adb-b2b3-49ec-92ab-c2b7a028241a" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.network.neutron [req-f9da8e3c-fc5e-46db-921a-eb911c805c0b req-8c88c62c-0266-4743-b49f-8c462e679f4f service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Updated VIF entry in instance network info cache for port 18262a82-8847-4594-98ce-2ad50387fbf2. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.network.neutron [req-f9da8e3c-fc5e-46db-921a-eb911c805c0b req-8c88c62c-0266-4743-b49f-8c462e679f4f service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Updating instance_info_cache with network_info: [{"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f9da8e3c-fc5e-46db-921a-eb911c805c0b req-8c88c62c-0266-4743-b49f-8c462e679f4f service nova] Releasing lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Cannot resize image /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Ensure instance console log exists: /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:47 user sudo[83936]: pam_unix(sudo:session): session closed for user root
Nov 13 09:53:47 user nova-compute[74611]: INFO oslo.privsep.daemon [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Spawned new privsep daemon via rootwrap
Nov 13 09:53:47 user nova-compute[74611]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 13 09:53:47 user nova-compute[74611]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 13 09:53:47 user nova-compute[74611]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 13 09:53:47 user nova-compute[74611]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83952
Nov 13 09:53:47 user nova-compute[74611]: WARNING oslo_privsep.priv_context [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] privsep daemon already running
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.network.neutron [req-2725149f-9f58-49ff-a7e5-355994de57cd req-afa6908c-7237-4bae-9a14-43ef22ccd028 service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Updated VIF entry in instance network info cache for port e5967c05-de89-4853-b421-516eb483271e. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.network.neutron [req-2725149f-9f58-49ff-a7e5-355994de57cd req-afa6908c-7237-4bae-9a14-43ef22ccd028 service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Updating instance_info_cache with network_info: [{"id": "e5967c05-de89-4853-b421-516eb483271e", "address": "fa:16:3e:c6:32:07", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5967c05-de", "ovs_interfaceid": "e5967c05-de89-4853-b421-516eb483271e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2725149f-9f58-49ff-a7e5-355994de57cd req-afa6908c-7237-4bae-9a14-43ef22ccd028 service nova] Releasing lock "refresh_cache-f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.network.neutron [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Updating instance_info_cache with network_info: [{"id": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "address": "fa:16:3e:ea:e8:de", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e875b56-fd", "ovs_interfaceid": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Releasing lock "refresh_cache-85cb3adb-b2b3-49ec-92ab-c2b7a028241a" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Instance network_info: |[{"id": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "address": "fa:16:3e:ea:e8:de", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e875b56-fd", "ovs_interfaceid": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fae37950-39eb-44b3-a584-d8ad3291b2bd req-0b54fdc2-ffe5-49db-9b37-206c08c2c6ac service nova] Acquired lock "refresh_cache-85cb3adb-b2b3-49ec-92ab-c2b7a028241a" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.network.neutron [req-fae37950-39eb-44b3-a584-d8ad3291b2bd req-0b54fdc2-ffe5-49db-9b37-206c08c2c6ac service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Refreshing network info cache for port 7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Start _get_guest_xml network_info=[{"id": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "address": "fa:16:3e:ea:e8:de", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e875b56-fd", "ovs_interfaceid": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:53:47 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:53:47 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-500108257',display_name='tempest-ServerRescueNegativeTestJSON-server-500108257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-500108257',id=3,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae9ab18bb67e4db19e6c3366771ad218',ramdisk_id='',reservation_id='r-vpxab583',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-961432289',owner_user_name='tempest-ServerRescueNegativeTestJSON-961432289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:53:42Z,user_data=None,user_id='863471360be04ab5acb07ef3e99007c4',uuid=85cb3adb-b2b3-49ec-92ab-c2b7a028241a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "address": "fa:16:3e:ea:e8:de", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e875b56-fd", "ovs_interfaceid": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converting VIF {"id": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "address": "fa:16:3e:ea:e8:de", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e875b56-fd", "ovs_interfaceid": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e8:de,bridge_name='br-int',has_traffic_filtering=True,id=7e875b56-fd2e-4ec6-9303-ef3965a6c7ae,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e875b56-fd') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.objects.instance [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'pci_devices' on Instance uuid 85cb3adb-b2b3-49ec-92ab-c2b7a028241a {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:53:47 user nova-compute[74611]:   <uuid>85cb3adb-b2b3-49ec-92ab-c2b7a028241a</uuid>
Nov 13 09:53:47 user nova-compute[74611]:   <name>instance-00000003</name>
Nov 13 09:53:47 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:53:47 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:53:47 user nova-compute[74611]:   <metadata>
Nov 13 09:53:47 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:53:47 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:53:47 user nova-compute[74611]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-500108257</nova:name>
Nov 13 09:53:47 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:53:47</nova:creationTime>
Nov 13 09:53:47 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:53:47 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:53:47 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:53:47 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:53:47 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:53:47 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:53:47 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:53:47 user nova-compute[74611]:       <nova:owner>
Nov 13 09:53:47 user nova-compute[74611]:         <nova:user uuid="863471360be04ab5acb07ef3e99007c4">tempest-ServerRescueNegativeTestJSON-961432289-project-member</nova:user>
Nov 13 09:53:47 user nova-compute[74611]:         <nova:project uuid="ae9ab18bb67e4db19e6c3366771ad218">tempest-ServerRescueNegativeTestJSON-961432289</nova:project>
Nov 13 09:53:47 user nova-compute[74611]:       </nova:owner>
Nov 13 09:53:47 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:53:47 user nova-compute[74611]:       <nova:ports>
Nov 13 09:53:47 user nova-compute[74611]:         <nova:port uuid="7e875b56-fd2e-4ec6-9303-ef3965a6c7ae">
Nov 13 09:53:47 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 09:53:47 user nova-compute[74611]:         </nova:port>
Nov 13 09:53:47 user nova-compute[74611]:       </nova:ports>
Nov 13 09:53:47 user nova-compute[74611]:     </nova:instance>
Nov 13 09:53:47 user nova-compute[74611]:   </metadata>
Nov 13 09:53:47 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:53:47 user nova-compute[74611]:     <system>
Nov 13 09:53:47 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:53:47 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:53:47 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:53:47 user nova-compute[74611]:       <entry name="serial">85cb3adb-b2b3-49ec-92ab-c2b7a028241a</entry>
Nov 13 09:53:47 user nova-compute[74611]:       <entry name="uuid">85cb3adb-b2b3-49ec-92ab-c2b7a028241a</entry>
Nov 13 09:53:47 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:53:47 user nova-compute[74611]:     </system>
Nov 13 09:53:47 user nova-compute[74611]:   </sysinfo>
Nov 13 09:53:47 user nova-compute[74611]:   <os>
Nov 13 09:53:47 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:53:47 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:53:47 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:53:47 user nova-compute[74611]:   </os>
Nov 13 09:53:47 user nova-compute[74611]:   <features>
Nov 13 09:53:47 user nova-compute[74611]:     <acpi/>
Nov 13 09:53:47 user nova-compute[74611]:     <apic/>
Nov 13 09:53:47 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:53:47 user nova-compute[74611]:   </features>
Nov 13 09:53:47 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:53:47 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:53:47 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:53:47 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:53:47 user nova-compute[74611]:   </clock>
Nov 13 09:53:47 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:53:47 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:53:47 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:53:47 user nova-compute[74611]:   </cpu>
Nov 13 09:53:47 user nova-compute[74611]:   <devices>
Nov 13 09:53:47 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:53:47 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:53:47 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk"/>
Nov 13 09:53:47 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:53:47 user nova-compute[74611]:     </disk>
Nov 13 09:53:47 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:53:47 user nova-compute[74611]:       <mac address="fa:16:3e:ea:e8:de"/>
Nov 13 09:53:47 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:53:47 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:53:47 user nova-compute[74611]:       <target dev="tap7e875b56-fd"/>
Nov 13 09:53:47 user nova-compute[74611]:     </interface>
Nov 13 09:53:47 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:53:47 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/console.log" append="off"/>
Nov 13 09:53:47 user nova-compute[74611]:     </serial>
Nov 13 09:53:47 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:53:47 user nova-compute[74611]:     <video>
Nov 13 09:53:47 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:53:47 user nova-compute[74611]:     </video>
Nov 13 09:53:47 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:53:47 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:53:47 user nova-compute[74611]:     </rng>
Nov 13 09:53:47 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:53:47 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:53:47 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:53:47 user nova-compute[74611]:     </memballoon>
Nov 13 09:53:47 user nova-compute[74611]:   </devices>
Nov 13 09:53:47 user nova-compute[74611]: </domain>
Nov 13 09:53:47 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-500108257',display_name='tempest-ServerRescueNegativeTestJSON-server-500108257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-500108257',id=3,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae9ab18bb67e4db19e6c3366771ad218',ramdisk_id='',reservation_id='r-vpxab583',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-961432289',owner_user_name='tempest-ServerRescueNegativeTestJSON-961432289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:53:42Z,user_data=None,user_id='863471360be04ab5acb07ef3e99007c4',uuid=85cb3adb-b2b3-49ec-92ab-c2b7a028241a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "address": "fa:16:3e:ea:e8:de", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e875b56-fd", "ovs_interfaceid": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converting VIF {"id": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "address": "fa:16:3e:ea:e8:de", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e875b56-fd", "ovs_interfaceid": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e8:de,bridge_name='br-int',has_traffic_filtering=True,id=7e875b56-fd2e-4ec6-9303-ef3965a6c7ae,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e875b56-fd') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG os_vif [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e8:de,bridge_name='br-int',has_traffic_filtering=True,id=7e875b56-fd2e-4ec6-9303-ef3965a6c7ae,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e875b56-fd') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8969b808-d903-50cc-956e-a363863571dc', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5967c05-de, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5967c05-de, col_values=(('qos', UUID('80670a0e-2cf0-4180-927f-8cf24cb9fba3')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5967c05-de, col_values=(('external_ids', {'iface-id': 'e5967c05-de89-4853-b421-516eb483271e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:32:07', 'vm-uuid': 'f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG nova.network.neutron [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Successfully updated port: af98cec6-7e77-428e-b0df-8901c45fafe5 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:53:48 user nova-compute[74611]: INFO os_vif [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:32:07,bridge_name='br-int',has_traffic_filtering=True,id=e5967c05-de89-4853-b421-516eb483271e,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5967c05-de')
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e875b56-fd, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e875b56-fd, col_values=(('qos', UUID('33fce92d-c4bf-43a5-8c6f-8608a452b27f')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e875b56-fd, col_values=(('external_ids', {'iface-id': '7e875b56-fd2e-4ec6-9303-ef3965a6c7ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:e8:de', 'vm-uuid': '85cb3adb-b2b3-49ec-92ab-c2b7a028241a'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "refresh_cache-1c66c8a8-abb5-4f60-8464-074627c213d8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquired lock "refresh_cache-1c66c8a8-abb5-4f60-8464-074627c213d8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG nova.network.neutron [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18262a82-88, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18262a82-88, col_values=(('qos', UUID('030abefa-033f-415f-be20-853fc03372cd')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18262a82-88, col_values=(('external_ids', {'iface-id': '18262a82-8847-4594-98ce-2ad50387fbf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:7e:57', 'vm-uuid': 'ccd219ab-ccdc-4eee-a7d4-484e3cc597c6'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:48 user nova-compute[74611]: INFO os_vif [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e8:de,bridge_name='br-int',has_traffic_filtering=True,id=7e875b56-fd2e-4ec6-9303-ef3965a6c7ae,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e875b56-fd')
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:53:48 user nova-compute[74611]: INFO nova.compute.claims [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Claim successful on node user
Nov 13 09:53:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:48 user nova-compute[74611]: INFO os_vif [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:7e:57,bridge_name='br-int',has_traffic_filtering=True,id=18262a82-8847-4594-98ce-2ad50387fbf2,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18262a82-88')
Nov 13 09:53:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] No VIF found with MAC fa:16:3e:c6:32:07, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No VIF found with MAC fa:16:3e:ea:e8:de, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No VIF found with MAC fa:16:3e:47:7e:57, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG nova.network.neutron [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:53:49 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:53:49 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Creating image(s)
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "/opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "/opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.143s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.network.neutron [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Updating instance_info_cache with network_info: [{"id": "af98cec6-7e77-428e-b0df-8901c45fafe5", "address": "fa:16:3e:49:ed:03", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98cec6-7e", "ovs_interfaceid": "af98cec6-7e77-428e-b0df-8901c45fafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Successfully created port: e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.network.neutron [req-fae37950-39eb-44b3-a584-d8ad3291b2bd req-0b54fdc2-ffe5-49db-9b37-206c08c2c6ac service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Updated VIF entry in instance network info cache for port 7e875b56-fd2e-4ec6-9303-ef3965a6c7ae. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.network.neutron [req-fae37950-39eb-44b3-a584-d8ad3291b2bd req-0b54fdc2-ffe5-49db-9b37-206c08c2c6ac service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Updating instance_info_cache with network_info: [{"id": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "address": "fa:16:3e:ea:e8:de", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e875b56-fd", "ovs_interfaceid": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.policy [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd93cfc3fb54b41ceb9f9657de0059043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1384599c1e484e54ae29b024377dbd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Releasing lock "refresh_cache-1c66c8a8-abb5-4f60-8464-074627c213d8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.compute.manager [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Instance network_info: |[{"id": "af98cec6-7e77-428e-b0df-8901c45fafe5", "address": "fa:16:3e:49:ed:03", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98cec6-7e", "ovs_interfaceid": "af98cec6-7e77-428e-b0df-8901c45fafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Start _get_guest_xml network_info=[{"id": "af98cec6-7e77-428e-b0df-8901c45fafe5", "address": "fa:16:3e:49:ed:03", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98cec6-7e", "ovs_interfaceid": "af98cec6-7e77-428e-b0df-8901c45fafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fae37950-39eb-44b3-a584-d8ad3291b2bd req-0b54fdc2-ffe5-49db-9b37-206c08c2c6ac service nova] Releasing lock "refresh_cache-85cb3adb-b2b3-49ec-92ab-c2b7a028241a" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:53:49 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:53:49 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-172245589',display_name='tempest-ServersNegativeTestJSON-server-172245589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-172245589',id=4,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afd392465e2d4ff0b511c9e543972244',ramdisk_id='',reservation_id='r-9nnmj03v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1786337240',owner_user_name='tempest-ServersNegativeTestJSON-1786337240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:53:44Z,user_data=None,user_id='21adb30d68754dba856e5d0a3ae6727e',uuid=1c66c8a8-abb5-4f60-8464-074627c213d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af98cec6-7e77-428e-b0df-8901c45fafe5", "address": "fa:16:3e:49:ed:03", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98cec6-7e", "ovs_interfaceid": "af98cec6-7e77-428e-b0df-8901c45fafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Converting VIF {"id": "af98cec6-7e77-428e-b0df-8901c45fafe5", "address": "fa:16:3e:49:ed:03", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98cec6-7e", "ovs_interfaceid": "af98cec6-7e77-428e-b0df-8901c45fafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:ed:03,bridge_name='br-int',has_traffic_filtering=True,id=af98cec6-7e77-428e-b0df-8901c45fafe5,network=Network(4d389398-6662-48ae-83f4-1db7fafb4ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf98cec6-7e') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.objects.instance [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c66c8a8-abb5-4f60-8464-074627c213d8 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.compute.manager [req-cf5d6491-1917-420f-9d18-258440bfc8cf req-c2ca94ca-b6df-4a51-a56b-0dabf434f6f5 service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Received event network-changed-af98cec6-7e77-428e-b0df-8901c45fafe5 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.compute.manager [req-cf5d6491-1917-420f-9d18-258440bfc8cf req-c2ca94ca-b6df-4a51-a56b-0dabf434f6f5 service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Refreshing instance network info cache due to event network-changed-af98cec6-7e77-428e-b0df-8901c45fafe5. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cf5d6491-1917-420f-9d18-258440bfc8cf req-c2ca94ca-b6df-4a51-a56b-0dabf434f6f5 service nova] Acquiring lock "refresh_cache-1c66c8a8-abb5-4f60-8464-074627c213d8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cf5d6491-1917-420f-9d18-258440bfc8cf req-c2ca94ca-b6df-4a51-a56b-0dabf434f6f5 service nova] Acquired lock "refresh_cache-1c66c8a8-abb5-4f60-8464-074627c213d8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.network.neutron [req-cf5d6491-1917-420f-9d18-258440bfc8cf req-c2ca94ca-b6df-4a51-a56b-0dabf434f6f5 service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Refreshing network info cache for port af98cec6-7e77-428e-b0df-8901c45fafe5 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:53:49 user nova-compute[74611]:   <uuid>1c66c8a8-abb5-4f60-8464-074627c213d8</uuid>
Nov 13 09:53:49 user nova-compute[74611]:   <name>instance-00000004</name>
Nov 13 09:53:49 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:53:49 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:53:49 user nova-compute[74611]:   <metadata>
Nov 13 09:53:49 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:53:49 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:53:49 user nova-compute[74611]:       <nova:name>tempest-ServersNegativeTestJSON-server-172245589</nova:name>
Nov 13 09:53:49 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:53:49</nova:creationTime>
Nov 13 09:53:49 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:53:49 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:53:49 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:53:49 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:53:49 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:53:49 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:53:49 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:53:49 user nova-compute[74611]:       <nova:owner>
Nov 13 09:53:49 user nova-compute[74611]:         <nova:user uuid="21adb30d68754dba856e5d0a3ae6727e">tempest-ServersNegativeTestJSON-1786337240-project-member</nova:user>
Nov 13 09:53:49 user nova-compute[74611]:         <nova:project uuid="afd392465e2d4ff0b511c9e543972244">tempest-ServersNegativeTestJSON-1786337240</nova:project>
Nov 13 09:53:49 user nova-compute[74611]:       </nova:owner>
Nov 13 09:53:49 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:53:49 user nova-compute[74611]:       <nova:ports>
Nov 13 09:53:49 user nova-compute[74611]:         <nova:port uuid="af98cec6-7e77-428e-b0df-8901c45fafe5">
Nov 13 09:53:49 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 09:53:49 user nova-compute[74611]:         </nova:port>
Nov 13 09:53:49 user nova-compute[74611]:       </nova:ports>
Nov 13 09:53:49 user nova-compute[74611]:     </nova:instance>
Nov 13 09:53:49 user nova-compute[74611]:   </metadata>
Nov 13 09:53:49 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:53:49 user nova-compute[74611]:     <system>
Nov 13 09:53:49 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:53:49 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:53:49 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:53:49 user nova-compute[74611]:       <entry name="serial">1c66c8a8-abb5-4f60-8464-074627c213d8</entry>
Nov 13 09:53:49 user nova-compute[74611]:       <entry name="uuid">1c66c8a8-abb5-4f60-8464-074627c213d8</entry>
Nov 13 09:53:49 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:53:49 user nova-compute[74611]:     </system>
Nov 13 09:53:49 user nova-compute[74611]:   </sysinfo>
Nov 13 09:53:49 user nova-compute[74611]:   <os>
Nov 13 09:53:49 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:53:49 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:53:49 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:53:49 user nova-compute[74611]:   </os>
Nov 13 09:53:49 user nova-compute[74611]:   <features>
Nov 13 09:53:49 user nova-compute[74611]:     <acpi/>
Nov 13 09:53:49 user nova-compute[74611]:     <apic/>
Nov 13 09:53:49 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:53:49 user nova-compute[74611]:   </features>
Nov 13 09:53:49 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:53:49 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:53:49 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:53:49 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:53:49 user nova-compute[74611]:   </clock>
Nov 13 09:53:49 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:53:49 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:53:49 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:53:49 user nova-compute[74611]:   </cpu>
Nov 13 09:53:49 user nova-compute[74611]:   <devices>
Nov 13 09:53:49 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:53:49 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:53:49 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk"/>
Nov 13 09:53:49 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:53:49 user nova-compute[74611]:     </disk>
Nov 13 09:53:49 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:53:49 user nova-compute[74611]:       <mac address="fa:16:3e:49:ed:03"/>
Nov 13 09:53:49 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:53:49 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:53:49 user nova-compute[74611]:       <target dev="tapaf98cec6-7e"/>
Nov 13 09:53:49 user nova-compute[74611]:     </interface>
Nov 13 09:53:49 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:53:49 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/console.log" append="off"/>
Nov 13 09:53:49 user nova-compute[74611]:     </serial>
Nov 13 09:53:49 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:53:49 user nova-compute[74611]:     <video>
Nov 13 09:53:49 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:53:49 user nova-compute[74611]:     </video>
Nov 13 09:53:49 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:53:49 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:53:49 user nova-compute[74611]:     </rng>
Nov 13 09:53:49 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:53:49 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:53:49 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:53:49 user nova-compute[74611]:     </memballoon>
Nov 13 09:53:49 user nova-compute[74611]:   </devices>
Nov 13 09:53:49 user nova-compute[74611]: </domain>
Nov 13 09:53:49 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-172245589',display_name='tempest-ServersNegativeTestJSON-server-172245589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-172245589',id=4,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afd392465e2d4ff0b511c9e543972244',ramdisk_id='',reservation_id='r-9nnmj03v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1786337240',owner_user_name='tempest-ServersNegativeTestJSON-1786337240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:53:44Z,user_data=None,user_id='21adb30d68754dba856e5d0a3ae6727e',uuid=1c66c8a8-abb5-4f60-8464-074627c213d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af98cec6-7e77-428e-b0df-8901c45fafe5", "address": "fa:16:3e:49:ed:03", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98cec6-7e", "ovs_interfaceid": "af98cec6-7e77-428e-b0df-8901c45fafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Converting VIF {"id": "af98cec6-7e77-428e-b0df-8901c45fafe5", "address": "fa:16:3e:49:ed:03", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98cec6-7e", "ovs_interfaceid": "af98cec6-7e77-428e-b0df-8901c45fafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:ed:03,bridge_name='br-int',has_traffic_filtering=True,id=af98cec6-7e77-428e-b0df-8901c45fafe5,network=Network(4d389398-6662-48ae-83f4-1db7fafb4ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf98cec6-7e') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG os_vif [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:ed:03,bridge_name='br-int',has_traffic_filtering=True,id=af98cec6-7e77-428e-b0df-8901c45fafe5,network=Network(4d389398-6662-48ae-83f4-1db7fafb4ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf98cec6-7e') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc43ee20-3891-5a5a-bd8b-aeeaf5ce8143', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf98cec6-7e, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf98cec6-7e, col_values=(('qos', UUID('b337b8dc-72f0-4efb-b5e5-4f2a4f5d7ca7')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf98cec6-7e, col_values=(('external_ids', {'iface-id': 'af98cec6-7e77-428e-b0df-8901c45fafe5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:ed:03', 'vm-uuid': '1c66c8a8-abb5-4f60-8464-074627c213d8'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.190s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:49 user nova-compute[74611]: INFO os_vif [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:ed:03,bridge_name='br-int',has_traffic_filtering=True,id=af98cec6-7e77-428e-b0df-8901c45fafe5,network=Network(4d389398-6662-48ae-83f4-1db7fafb4ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf98cec6-7e')
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] No VIF found with MAC fa:16:3e:49:ed:03, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.183s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk 1073741824" returned: 0 in 0.044s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:50 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:53:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:53:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:53:50 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Cannot resize image /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:53:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:53:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Ensure instance console log exists: /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:53:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:53:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:53:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:50 user nova-compute[74611]: DEBUG nova.network.neutron [req-cf5d6491-1917-420f-9d18-258440bfc8cf req-c2ca94ca-b6df-4a51-a56b-0dabf434f6f5 service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Updated VIF entry in instance network info cache for port af98cec6-7e77-428e-b0df-8901c45fafe5. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:53:50 user nova-compute[74611]: DEBUG nova.network.neutron [req-cf5d6491-1917-420f-9d18-258440bfc8cf req-c2ca94ca-b6df-4a51-a56b-0dabf434f6f5 service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Updating instance_info_cache with network_info: [{"id": "af98cec6-7e77-428e-b0df-8901c45fafe5", "address": "fa:16:3e:49:ed:03", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98cec6-7e", "ovs_interfaceid": "af98cec6-7e77-428e-b0df-8901c45fafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:53:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cf5d6491-1917-420f-9d18-258440bfc8cf req-c2ca94ca-b6df-4a51-a56b-0dabf434f6f5 service nova] Releasing lock "refresh_cache-1c66c8a8-abb5-4f60-8464-074627c213d8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:53:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:51 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Successfully updated port: e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:53:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:53:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquired lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:53:51 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:53:51 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Successfully created port: 443f1230-01cb-4e7e-8ce7-bc254e125fff {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:53:52 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:53:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-218c7708-7695-4a55-a813-b9847a1393ce req-ada244bb-5dbc-4568-acb9-36f9336f0c49 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received event network-changed-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:53:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-218c7708-7695-4a55-a813-b9847a1393ce req-ada244bb-5dbc-4568-acb9-36f9336f0c49 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Refreshing instance network info cache due to event network-changed-e730080f-c599-449b-b366-a642be4f9ac7. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:53:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-218c7708-7695-4a55-a813-b9847a1393ce req-ada244bb-5dbc-4568-acb9-36f9336f0c49 service nova] Acquiring lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:53:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updating instance_info_cache with network_info: [{"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Releasing lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Instance network_info: |[{"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-218c7708-7695-4a55-a813-b9847a1393ce req-ada244bb-5dbc-4568-acb9-36f9336f0c49 service nova] Acquired lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.network.neutron [req-218c7708-7695-4a55-a813-b9847a1393ce req-ada244bb-5dbc-4568-acb9-36f9336f0c49 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Refreshing network info cache for port e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Start _get_guest_xml network_info=[{"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:53 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:53:53 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Successfully updated port: 443f1230-01cb-4e7e-8ce7-bc254e125fff {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "refresh_cache-fe53a1a8-de5b-4679-bddb-1da5204dbab8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquired lock "refresh_cache-fe53a1a8-de5b-4679-bddb-1da5204dbab8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-610781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-610781',id=5,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsTret5b3iXWCuFDtJbfayGvRYlI07teJzdTCJFhqHq6mblu7HCq3e+QCXP3zDlNZ1sgvWyIl5dD63UFzJqtDj1HFz9fXZTyR+iHl22i4km+t7rGy8XkpvMx9Gjduo9mw==',key_name='tempest-keypair-1489015223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5a6f570a7e7404680bd5809be8b0378',ramdisk_id='',reservation_id='r-yu0u8g36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-55203260',owner_user_name='tempest-AttachVolumeShelveTestJSON-55203260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:53:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008616dff48b4bdeb2ea0f2be72a2934',uuid=8cdb9561-3b40-44cc-abf7-2cbff7e60a17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converting VIF {"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:96:5e,bridge_name='br-int',has_traffic_filtering=True,id=e730080f-c599-449b-b366-a642be4f9ac7,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape730080f-c5') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.objects.instance [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:53:53 user nova-compute[74611]:   <uuid>8cdb9561-3b40-44cc-abf7-2cbff7e60a17</uuid>
Nov 13 09:53:53 user nova-compute[74611]:   <name>instance-00000005</name>
Nov 13 09:53:53 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:53:53 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:53:53 user nova-compute[74611]:   <metadata>
Nov 13 09:53:53 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:53:53 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:53:53 user nova-compute[74611]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-610781</nova:name>
Nov 13 09:53:53 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:53:53</nova:creationTime>
Nov 13 09:53:53 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:53:53 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:53:53 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:53:53 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:53:53 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:53:53 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:53:53 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:53:53 user nova-compute[74611]:       <nova:owner>
Nov 13 09:53:53 user nova-compute[74611]:         <nova:user uuid="008616dff48b4bdeb2ea0f2be72a2934">tempest-AttachVolumeShelveTestJSON-55203260-project-member</nova:user>
Nov 13 09:53:53 user nova-compute[74611]:         <nova:project uuid="d5a6f570a7e7404680bd5809be8b0378">tempest-AttachVolumeShelveTestJSON-55203260</nova:project>
Nov 13 09:53:53 user nova-compute[74611]:       </nova:owner>
Nov 13 09:53:53 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:53:53 user nova-compute[74611]:       <nova:ports>
Nov 13 09:53:53 user nova-compute[74611]:         <nova:port uuid="e730080f-c599-449b-b366-a642be4f9ac7">
Nov 13 09:53:53 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 09:53:53 user nova-compute[74611]:         </nova:port>
Nov 13 09:53:53 user nova-compute[74611]:       </nova:ports>
Nov 13 09:53:53 user nova-compute[74611]:     </nova:instance>
Nov 13 09:53:53 user nova-compute[74611]:   </metadata>
Nov 13 09:53:53 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:53:53 user nova-compute[74611]:     <system>
Nov 13 09:53:53 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:53:53 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:53:53 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:53:53 user nova-compute[74611]:       <entry name="serial">8cdb9561-3b40-44cc-abf7-2cbff7e60a17</entry>
Nov 13 09:53:53 user nova-compute[74611]:       <entry name="uuid">8cdb9561-3b40-44cc-abf7-2cbff7e60a17</entry>
Nov 13 09:53:53 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:53:53 user nova-compute[74611]:     </system>
Nov 13 09:53:53 user nova-compute[74611]:   </sysinfo>
Nov 13 09:53:53 user nova-compute[74611]:   <os>
Nov 13 09:53:53 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:53:53 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:53:53 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:53:53 user nova-compute[74611]:   </os>
Nov 13 09:53:53 user nova-compute[74611]:   <features>
Nov 13 09:53:53 user nova-compute[74611]:     <acpi/>
Nov 13 09:53:53 user nova-compute[74611]:     <apic/>
Nov 13 09:53:53 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:53:53 user nova-compute[74611]:   </features>
Nov 13 09:53:53 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:53:53 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:53:53 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:53:53 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:53:53 user nova-compute[74611]:   </clock>
Nov 13 09:53:53 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:53:53 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:53:53 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:53:53 user nova-compute[74611]:   </cpu>
Nov 13 09:53:53 user nova-compute[74611]:   <devices>
Nov 13 09:53:53 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:53:53 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:53:53 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk"/>
Nov 13 09:53:53 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:53:53 user nova-compute[74611]:     </disk>
Nov 13 09:53:53 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:53:53 user nova-compute[74611]:       <mac address="fa:16:3e:c0:96:5e"/>
Nov 13 09:53:53 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:53:53 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:53:53 user nova-compute[74611]:       <target dev="tape730080f-c5"/>
Nov 13 09:53:53 user nova-compute[74611]:     </interface>
Nov 13 09:53:53 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:53:53 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/console.log" append="off"/>
Nov 13 09:53:53 user nova-compute[74611]:     </serial>
Nov 13 09:53:53 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:53:53 user nova-compute[74611]:     <video>
Nov 13 09:53:53 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:53:53 user nova-compute[74611]:     </video>
Nov 13 09:53:53 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:53:53 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:53:53 user nova-compute[74611]:     </rng>
Nov 13 09:53:53 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:53:53 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:53:53 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:53:53 user nova-compute[74611]:     </memballoon>
Nov 13 09:53:53 user nova-compute[74611]:   </devices>
Nov 13 09:53:53 user nova-compute[74611]: </domain>
Nov 13 09:53:53 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-610781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-610781',id=5,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsTret5b3iXWCuFDtJbfayGvRYlI07teJzdTCJFhqHq6mblu7HCq3e+QCXP3zDlNZ1sgvWyIl5dD63UFzJqtDj1HFz9fXZTyR+iHl22i4km+t7rGy8XkpvMx9Gjduo9mw==',key_name='tempest-keypair-1489015223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5a6f570a7e7404680bd5809be8b0378',ramdisk_id='',reservation_id='r-yu0u8g36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-55203260',owner_user_name='tempest-AttachVolumeShelveTestJSON-55203260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:53:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008616dff48b4bdeb2ea0f2be72a2934',uuid=8cdb9561-3b40-44cc-abf7-2cbff7e60a17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converting VIF {"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:96:5e,bridge_name='br-int',has_traffic_filtering=True,id=e730080f-c599-449b-b366-a642be4f9ac7,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape730080f-c5') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG os_vif [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:96:5e,bridge_name='br-int',has_traffic_filtering=True,id=e730080f-c599-449b-b366-a642be4f9ac7,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape730080f-c5') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '449d04c7-7a10-501d-9d11-d021d57d17fd', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape730080f-c5, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape730080f-c5, col_values=(('qos', UUID('2acd252f-8c5e-43cb-bdd4-326315b45313')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape730080f-c5, col_values=(('external_ids', {'iface-id': 'e730080f-c599-449b-b366-a642be4f9ac7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:96:5e', 'vm-uuid': '8cdb9561-3b40-44cc-abf7-2cbff7e60a17'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.compute.manager [req-ca2b37ca-3df5-43f7-85c2-a52da575b994 req-98721b62-e050-43a6-ae27-3827fea9eaa9 service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Received event network-changed-443f1230-01cb-4e7e-8ce7-bc254e125fff {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.compute.manager [req-ca2b37ca-3df5-43f7-85c2-a52da575b994 req-98721b62-e050-43a6-ae27-3827fea9eaa9 service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Refreshing instance network info cache due to event network-changed-443f1230-01cb-4e7e-8ce7-bc254e125fff. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ca2b37ca-3df5-43f7-85c2-a52da575b994 req-98721b62-e050-43a6-ae27-3827fea9eaa9 service nova] Acquiring lock "refresh_cache-fe53a1a8-de5b-4679-bddb-1da5204dbab8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:53 user nova-compute[74611]: INFO os_vif [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:96:5e,bridge_name='br-int',has_traffic_filtering=True,id=e730080f-c599-449b-b366-a642be4f9ac7,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape730080f-c5')
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] No VIF found with MAC fa:16:3e:c0:96:5e, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:53:53 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Updating instance_info_cache with network_info: [{"id": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "address": "fa:16:3e:47:f4:bd", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443f1230-01", "ovs_interfaceid": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Releasing lock "refresh_cache-fe53a1a8-de5b-4679-bddb-1da5204dbab8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Instance network_info: |[{"id": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "address": "fa:16:3e:47:f4:bd", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443f1230-01", "ovs_interfaceid": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ca2b37ca-3df5-43f7-85c2-a52da575b994 req-98721b62-e050-43a6-ae27-3827fea9eaa9 service nova] Acquired lock "refresh_cache-fe53a1a8-de5b-4679-bddb-1da5204dbab8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG nova.network.neutron [req-ca2b37ca-3df5-43f7-85c2-a52da575b994 req-98721b62-e050-43a6-ae27-3827fea9eaa9 service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Refreshing network info cache for port 443f1230-01cb-4e7e-8ce7-bc254e125fff {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Start _get_guest_xml network_info=[{"id": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "address": "fa:16:3e:47:f4:bd", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443f1230-01", "ovs_interfaceid": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG nova.network.neutron [req-218c7708-7695-4a55-a813-b9847a1393ce req-ada244bb-5dbc-4568-acb9-36f9336f0c49 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updated VIF entry in instance network info cache for port e730080f-c599-449b-b366-a642be4f9ac7. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG nova.network.neutron [req-218c7708-7695-4a55-a813-b9847a1393ce req-ada244bb-5dbc-4568-acb9-36f9336f0c49 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updating instance_info_cache with network_info: [{"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-218c7708-7695-4a55-a813-b9847a1393ce req-ada244bb-5dbc-4568-acb9-36f9336f0c49 service nova] Releasing lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG nova.network.neutron [req-ca2b37ca-3df5-43f7-85c2-a52da575b994 req-98721b62-e050-43a6-ae27-3827fea9eaa9 service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Updated VIF entry in instance network info cache for port 443f1230-01cb-4e7e-8ce7-bc254e125fff. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG nova.network.neutron [req-ca2b37ca-3df5-43f7-85c2-a52da575b994 req-98721b62-e050-43a6-ae27-3827fea9eaa9 service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Updating instance_info_cache with network_info: [{"id": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "address": "fa:16:3e:47:f4:bd", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443f1230-01", "ovs_interfaceid": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ca2b37ca-3df5-43f7-85c2-a52da575b994 req-98721b62-e050-43a6-ae27-3827fea9eaa9 service nova] Releasing lock "refresh_cache-fe53a1a8-de5b-4679-bddb-1da5204dbab8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:53:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.compute.manager [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:53:57 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Instance spawned successfully.
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:53:57 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:53:57 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:53:57 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Instance spawned successfully.
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1448705948',display_name='tempest-AttachVolumeNegativeTest-server-1448705948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1448705948',id=6,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGW9OU854oBQK0ROYe3KE2gcm4kHgQGrTKE0dXsaLlu+wZxF8g9fFfjK971IoLjoM38zWAzX1pw8eMP/ejBzam7om+EuYqwAe6KTDLJdW+eS48xv5863cBvX5WRI5dMEEg==',key_name='tempest-keypair-537423740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1384599c1e484e54ae29b024377dbd04',ramdisk_id='',reservation_id='r-i8g823lz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1307038303',owner_user_name='tempest-AttachVolumeNegativeTest-1307038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:53:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d93cfc3fb54b41ceb9f9657de0059043',uuid=fe53a1a8-de5b-4679-bddb-1da5204dbab8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "address": "fa:16:3e:47:f4:bd", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443f1230-01", "ovs_interfaceid": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converting VIF {"id": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "address": "fa:16:3e:47:f4:bd", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443f1230-01", "ovs_interfaceid": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:f4:bd,bridge_name='br-int',has_traffic_filtering=True,id=443f1230-01cb-4e7e-8ce7-bc254e125fff,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443f1230-01') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.objects.instance [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'pci_devices' on Instance uuid fe53a1a8-de5b-4679-bddb-1da5204dbab8 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:53:57 user nova-compute[74611]:   <uuid>fe53a1a8-de5b-4679-bddb-1da5204dbab8</uuid>
Nov 13 09:53:57 user nova-compute[74611]:   <name>instance-00000006</name>
Nov 13 09:53:57 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:53:57 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:53:57 user nova-compute[74611]:   <metadata>
Nov 13 09:53:57 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:53:57 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:53:57 user nova-compute[74611]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1448705948</nova:name>
Nov 13 09:53:57 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:53:57</nova:creationTime>
Nov 13 09:53:57 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:53:57 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:53:57 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:53:57 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:53:57 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:53:57 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:53:57 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:53:57 user nova-compute[74611]:       <nova:owner>
Nov 13 09:53:57 user nova-compute[74611]:         <nova:user uuid="d93cfc3fb54b41ceb9f9657de0059043">tempest-AttachVolumeNegativeTest-1307038303-project-member</nova:user>
Nov 13 09:53:57 user nova-compute[74611]:         <nova:project uuid="1384599c1e484e54ae29b024377dbd04">tempest-AttachVolumeNegativeTest-1307038303</nova:project>
Nov 13 09:53:57 user nova-compute[74611]:       </nova:owner>
Nov 13 09:53:57 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:53:57 user nova-compute[74611]:       <nova:ports>
Nov 13 09:53:57 user nova-compute[74611]:         <nova:port uuid="443f1230-01cb-4e7e-8ce7-bc254e125fff">
Nov 13 09:53:57 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 09:53:57 user nova-compute[74611]:         </nova:port>
Nov 13 09:53:57 user nova-compute[74611]:       </nova:ports>
Nov 13 09:53:57 user nova-compute[74611]:     </nova:instance>
Nov 13 09:53:57 user nova-compute[74611]:   </metadata>
Nov 13 09:53:57 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:53:57 user nova-compute[74611]:     <system>
Nov 13 09:53:57 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:53:57 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:53:57 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:53:57 user nova-compute[74611]:       <entry name="serial">fe53a1a8-de5b-4679-bddb-1da5204dbab8</entry>
Nov 13 09:53:57 user nova-compute[74611]:       <entry name="uuid">fe53a1a8-de5b-4679-bddb-1da5204dbab8</entry>
Nov 13 09:53:57 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:53:57 user nova-compute[74611]:     </system>
Nov 13 09:53:57 user nova-compute[74611]:   </sysinfo>
Nov 13 09:53:57 user nova-compute[74611]:   <os>
Nov 13 09:53:57 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:53:57 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:53:57 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:53:57 user nova-compute[74611]:   </os>
Nov 13 09:53:57 user nova-compute[74611]:   <features>
Nov 13 09:53:57 user nova-compute[74611]:     <acpi/>
Nov 13 09:53:57 user nova-compute[74611]:     <apic/>
Nov 13 09:53:57 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:53:57 user nova-compute[74611]:   </features>
Nov 13 09:53:57 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:53:57 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:53:57 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:53:57 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:53:57 user nova-compute[74611]:   </clock>
Nov 13 09:53:57 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:53:57 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:53:57 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:53:57 user nova-compute[74611]:   </cpu>
Nov 13 09:53:57 user nova-compute[74611]:   <devices>
Nov 13 09:53:57 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:53:57 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:53:57 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk"/>
Nov 13 09:53:57 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:53:57 user nova-compute[74611]:     </disk>
Nov 13 09:53:57 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:53:57 user nova-compute[74611]:       <mac address="fa:16:3e:47:f4:bd"/>
Nov 13 09:53:57 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:53:57 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:53:57 user nova-compute[74611]:       <target dev="tap443f1230-01"/>
Nov 13 09:53:57 user nova-compute[74611]:     </interface>
Nov 13 09:53:57 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:53:57 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/console.log" append="off"/>
Nov 13 09:53:57 user nova-compute[74611]:     </serial>
Nov 13 09:53:57 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:53:57 user nova-compute[74611]:     <video>
Nov 13 09:53:57 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:53:57 user nova-compute[74611]:     </video>
Nov 13 09:53:57 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:53:57 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:53:57 user nova-compute[74611]:     </rng>
Nov 13 09:53:57 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:53:57 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:53:57 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:53:57 user nova-compute[74611]:     </memballoon>
Nov 13 09:53:57 user nova-compute[74611]:   </devices>
Nov 13 09:53:57 user nova-compute[74611]: </domain>
Nov 13 09:53:57 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1448705948',display_name='tempest-AttachVolumeNegativeTest-server-1448705948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1448705948',id=6,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGW9OU854oBQK0ROYe3KE2gcm4kHgQGrTKE0dXsaLlu+wZxF8g9fFfjK971IoLjoM38zWAzX1pw8eMP/ejBzam7om+EuYqwAe6KTDLJdW+eS48xv5863cBvX5WRI5dMEEg==',key_name='tempest-keypair-537423740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1384599c1e484e54ae29b024377dbd04',ramdisk_id='',reservation_id='r-i8g823lz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1307038303',owner_user_name='tempest-AttachVolumeNegativeTest-1307038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:53:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d93cfc3fb54b41ceb9f9657de0059043',uuid=fe53a1a8-de5b-4679-bddb-1da5204dbab8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "address": "fa:16:3e:47:f4:bd", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443f1230-01", "ovs_interfaceid": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converting VIF {"id": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "address": "fa:16:3e:47:f4:bd", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443f1230-01", "ovs_interfaceid": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:f4:bd,bridge_name='br-int',has_traffic_filtering=True,id=443f1230-01cb-4e7e-8ce7-bc254e125fff,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443f1230-01') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG os_vif [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:f4:bd,bridge_name='br-int',has_traffic_filtering=True,id=443f1230-01cb-4e7e-8ce7-bc254e125fff,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443f1230-01') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63824e77-220e-535d-a1c6-fba0314530da', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap443f1230-01, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap443f1230-01, col_values=(('qos', UUID('de487bc8-2751-454d-864b-1a3b88430f79')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap443f1230-01, col_values=(('external_ids', {'iface-id': '443f1230-01cb-4e7e-8ce7-bc254e125fff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:f4:bd', 'vm-uuid': 'fe53a1a8-de5b-4679-bddb-1da5204dbab8'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:57 user nova-compute[74611]: INFO os_vif [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:f4:bd,bridge_name='br-int',has_traffic_filtering=True,id=443f1230-01cb-4e7e-8ce7-bc254e125fff,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443f1230-01')
Nov 13 09:53:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No VIF found with MAC fa:16:3e:47:f4:bd, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:53:57 user nova-compute[74611]: INFO nova.compute.manager [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Took 17.23 seconds to spawn the instance on the hypervisor.
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:53:57 user nova-compute[74611]: INFO nova.compute.manager [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Took 15.68 seconds to spawn the instance on the hypervisor.
Nov 13 09:53:57 user nova-compute[74611]: DEBUG nova.compute.manager [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.compute.manager [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:53:58 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Instance spawned successfully.
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:53:58 user nova-compute[74611]: INFO nova.compute.manager [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Took 18.64 seconds to build instance.
Nov 13 09:53:58 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Instance spawned successfully.
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5a4da058-0886-4949-8463-acc650b763bd tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.906s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:58 user nova-compute[74611]: INFO nova.compute.manager [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Took 14.33 seconds to spawn the instance on the hypervisor.
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.compute.manager [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:53:58 user nova-compute[74611]: INFO nova.compute.manager [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Took 16.86 seconds to build instance.
Nov 13 09:53:58 user nova-compute[74611]: INFO nova.compute.manager [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Took 18.68 seconds to spawn the instance on the hypervisor.
Nov 13 09:53:58 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-641a49e4-15ee-45a2-9b6d-1cb56adc2757 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.038s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:58 user nova-compute[74611]: INFO nova.compute.manager [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Took 15.85 seconds to build instance.
Nov 13 09:53:58 user nova-compute[74611]: INFO nova.compute.manager [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Took 20.29 seconds to build instance.
Nov 13 09:53:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-66175b3a-7b5b-4217-b7d5-63fdee645653 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "1c66c8a8-abb5-4f60-8464-074627c213d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.144s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b642bbe-012e-4a25-adbc-2c9e087c723c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.641s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:53:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:59 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:53:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:53:59 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Instance spawned successfully.
Nov 13 09:53:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:53:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:53:59 user nova-compute[74611]: INFO nova.compute.manager [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Took 12.65 seconds to spawn the instance on the hypervisor.
Nov 13 09:53:59 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:53:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:53:59 user nova-compute[74611]: INFO nova.compute.manager [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Took 13.92 seconds to build instance.
Nov 13 09:53:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b46f745a-b96c-4681-9fb1-40511d239820 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.036s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-26c0fe25-3d51-43c4-9c3b-e186e167087e req-df54802f-4e0f-4a90-8703-f546d2271de3 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received event network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-26c0fe25-3d51-43c4-9c3b-e186e167087e req-df54802f-4e0f-4a90-8703-f546d2271de3 service nova] Acquiring lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-26c0fe25-3d51-43c4-9c3b-e186e167087e req-df54802f-4e0f-4a90-8703-f546d2271de3 service nova] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-26c0fe25-3d51-43c4-9c3b-e186e167087e req-df54802f-4e0f-4a90-8703-f546d2271de3 service nova] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-26c0fe25-3d51-43c4-9c3b-e186e167087e req-df54802f-4e0f-4a90-8703-f546d2271de3 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] No waiting events found dispatching network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:02 user nova-compute[74611]: WARNING nova.compute.manager [req-26c0fe25-3d51-43c4-9c3b-e186e167087e req-df54802f-4e0f-4a90-8703-f546d2271de3 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received unexpected event network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 for instance with vm_state active and task_state None.
Nov 13 09:54:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-f4583266-680d-44d0-bbe1-555df2db5970 req-1ac05c28-713e-4b45-89d0-6df6b319661c service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Received event network-vif-plugged-e5967c05-de89-4853-b421-516eb483271e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f4583266-680d-44d0-bbe1-555df2db5970 req-1ac05c28-713e-4b45-89d0-6df6b319661c service nova] Acquiring lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f4583266-680d-44d0-bbe1-555df2db5970 req-1ac05c28-713e-4b45-89d0-6df6b319661c service nova] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f4583266-680d-44d0-bbe1-555df2db5970 req-1ac05c28-713e-4b45-89d0-6df6b319661c service nova] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-f4583266-680d-44d0-bbe1-555df2db5970 req-1ac05c28-713e-4b45-89d0-6df6b319661c service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] No waiting events found dispatching network-vif-plugged-e5967c05-de89-4853-b421-516eb483271e {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:02 user nova-compute[74611]: WARNING nova.compute.manager [req-f4583266-680d-44d0-bbe1-555df2db5970 req-1ac05c28-713e-4b45-89d0-6df6b319661c service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Received unexpected event network-vif-plugged-e5967c05-de89-4853-b421-516eb483271e for instance with vm_state active and task_state None.
Nov 13 09:54:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:03 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:54:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:54:03 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Instance spawned successfully.
Nov 13 09:54:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:54:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:04 user nova-compute[74611]: INFO nova.compute.manager [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Took 14.88 seconds to spawn the instance on the hypervisor.
Nov 13 09:54:04 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:54:04 user nova-compute[74611]: INFO nova.compute.manager [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Took 15.90 seconds to build instance.
Nov 13 09:54:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b3485b-e9a6-46bf-ad21-4ddd0b94e69f tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.065s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-a970b696-82dc-4422-9ee2-4cb13980c7f0 req-c6c171f1-a8ed-4dc6-a9bd-560e06817230 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received event network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a970b696-82dc-4422-9ee2-4cb13980c7f0 req-c6c171f1-a8ed-4dc6-a9bd-560e06817230 service nova] Acquiring lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a970b696-82dc-4422-9ee2-4cb13980c7f0 req-c6c171f1-a8ed-4dc6-a9bd-560e06817230 service nova] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a970b696-82dc-4422-9ee2-4cb13980c7f0 req-c6c171f1-a8ed-4dc6-a9bd-560e06817230 service nova] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-a970b696-82dc-4422-9ee2-4cb13980c7f0 req-c6c171f1-a8ed-4dc6-a9bd-560e06817230 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] No waiting events found dispatching network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:04 user nova-compute[74611]: WARNING nova.compute.manager [req-a970b696-82dc-4422-9ee2-4cb13980c7f0 req-c6c171f1-a8ed-4dc6-a9bd-560e06817230 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received unexpected event network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 for instance with vm_state active and task_state None.
Nov 13 09:54:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Received event network-vif-plugged-e5967c05-de89-4853-b421-516eb483271e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] Acquiring lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] No waiting events found dispatching network-vif-plugged-e5967c05-de89-4853-b421-516eb483271e {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:04 user nova-compute[74611]: WARNING nova.compute.manager [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Received unexpected event network-vif-plugged-e5967c05-de89-4853-b421-516eb483271e for instance with vm_state active and task_state None.
Nov 13 09:54:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received event network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] Acquiring lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] No waiting events found dispatching network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:04 user nova-compute[74611]: WARNING nova.compute.manager [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received unexpected event network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae for instance with vm_state active and task_state None.
Nov 13 09:54:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received event network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] Acquiring lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] No waiting events found dispatching network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:04 user nova-compute[74611]: WARNING nova.compute.manager [req-b07fdc1d-0322-497f-95b4-054896d434a2 req-876f7fbd-cd57-46ec-b28d-6f4071df4103 service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received unexpected event network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae for instance with vm_state active and task_state None.
Nov 13 09:54:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Acquiring lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:54:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:10 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:54:10 user nova-compute[74611]: INFO nova.compute.claims [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Claim successful on node user
Nov 13 09:54:11 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:54:11 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:54:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.774s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:11 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:54:11 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:54:11 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:54:11 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:54:11 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:54:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "eea01f90-3c79-4304-913e-8cf7e9749480" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "eea01f90-3c79-4304-913e-8cf7e9749480" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:11 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG nova.policy [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8a64c0b83054c428413ccdb33464864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b6ac63cf4a4e7b8a3c5db0242d4612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:54:12 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Creating image(s)
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "/opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "/opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:54:12 user nova-compute[74611]: INFO nova.compute.claims [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Claim successful on node user
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.269s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.267s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk 1073741824" returned: 0 in 0.082s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquiring lock "54fdbd33-6f7c-440b-968b-cd743e2562c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.441s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.163s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:54:13 user nova-compute[74611]: INFO nova.compute.claims [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Claim successful on node user
Nov 13 09:54:13 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Successfully created port: c17146c8-a3ec-4289-b41d-751fff2e490f {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk --force-share --output=json" returned: 0 in 0.410s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Cannot resize image /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Ensure instance console log exists: /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:13 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:54:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG nova.policy [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4627e309322495f90a6e412f7e36c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6f36a09d514934ab7e11e7e945658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:54:13 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Creating image(s)
Nov 13 09:54:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.459s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:14 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:54:14 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:54:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.248s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:54:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.352s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:54:14 user nova-compute[74611]: DEBUG nova.network.neutron [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:54:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk 1073741824" returned: 0 in 0.144s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.511s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:15 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 13 09:54:15 user nova-compute[74611]: DEBUG nova.compute.manager [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Successfully updated port: c17146c8-a3ec-4289-b41d-751fff2e490f {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG nova.compute.manager [req-46dce1f8-0018-4cc7-848f-c7e209cf11e8 req-57d0e67a-5078-4520-a5c7-0fc7236397d8 service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Received event network-changed-c17146c8-a3ec-4289-b41d-751fff2e490f {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG nova.compute.manager [req-46dce1f8-0018-4cc7-848f-c7e209cf11e8 req-57d0e67a-5078-4520-a5c7-0fc7236397d8 service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Refreshing instance network info cache due to event network-changed-c17146c8-a3ec-4289-b41d-751fff2e490f. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-46dce1f8-0018-4cc7-848f-c7e209cf11e8 req-57d0e67a-5078-4520-a5c7-0fc7236397d8 service nova] Acquiring lock "refresh_cache-5b70fc11-140f-4c9a-9e75-2b33705d8c6d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-46dce1f8-0018-4cc7-848f-c7e209cf11e8 req-57d0e67a-5078-4520-a5c7-0fc7236397d8 service nova] Acquired lock "refresh_cache-5b70fc11-140f-4c9a-9e75-2b33705d8c6d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG nova.network.neutron [req-46dce1f8-0018-4cc7-848f-c7e209cf11e8 req-57d0e67a-5078-4520-a5c7-0fc7236397d8 service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Refreshing network info cache for port c17146c8-a3ec-4289-b41d-751fff2e490f {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Acquiring lock "refresh_cache-5b70fc11-140f-4c9a-9e75-2b33705d8c6d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG nova.policy [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a35ffdeb7c9d495791868be7cb705abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d4b071d0124c118e77acf5595e7c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG nova.network.neutron [req-46dce1f8-0018-4cc7-848f-c7e209cf11e8 req-57d0e67a-5078-4520-a5c7-0fc7236397d8 service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.535s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG nova.compute.manager [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:54:15 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Creating image(s)
Nov 13 09:54:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquiring lock "/opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "/opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "/opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquiring lock "2caa0348060be914dfdb4919bc14bc1e9d5954f7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "2caa0348060be914dfdb4919bc14bc1e9d5954f7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7.part --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk --force-share --output=json" returned: 0 in 0.898s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG nova.network.neutron [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Successfully created port: b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Cannot resize image /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Ensure instance console log exists: /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG nova.network.neutron [req-46dce1f8-0018-4cc7-848f-c7e209cf11e8 req-57d0e67a-5078-4520-a5c7-0fc7236397d8 service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-46dce1f8-0018-4cc7-848f-c7e209cf11e8 req-57d0e67a-5078-4520-a5c7-0fc7236397d8 service nova] Releasing lock "refresh_cache-5b70fc11-140f-4c9a-9e75-2b33705d8c6d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Acquired lock "refresh_cache-5b70fc11-140f-4c9a-9e75-2b33705d8c6d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Successfully created port: 805b4d7d-b250-40e4-af31-e9f281182115 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7.part --force-share --output=json" returned: 0 in 0.398s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG nova.virt.images [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] 3f3da546-6a65-4512-82f8-1d9c387985df was qcow2, converting to raw {{(pid=74611) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7.part /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7.converted {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:16 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:54:17 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7.part /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7.converted" returned: 0 in 0.636s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:17 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7.converted --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:17 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7.converted --force-share --output=json" returned: 0 in 0.305s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "2caa0348060be914dfdb4919bc14bc1e9d5954f7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.116s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:17 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:17 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Updating instance_info_cache with network_info: [{"id": "c17146c8-a3ec-4289-b41d-751fff2e490f", "address": "fa:16:3e:88:fb:1e", "network": {"id": "3594b817-94b7-461b-9cc7-b7f99c0605c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-143737876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b6ac63cf4a4e7b8a3c5db0242d4612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17146c8-a3", "ovs_interfaceid": "c17146c8-a3ec-4289-b41d-751fff2e490f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Releasing lock "refresh_cache-5b70fc11-140f-4c9a-9e75-2b33705d8c6d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Instance network_info: |[{"id": "c17146c8-a3ec-4289-b41d-751fff2e490f", "address": "fa:16:3e:88:fb:1e", "network": {"id": "3594b817-94b7-461b-9cc7-b7f99c0605c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-143737876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b6ac63cf4a4e7b8a3c5db0242d4612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17146c8-a3", "ovs_interfaceid": "c17146c8-a3ec-4289-b41d-751fff2e490f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Start _get_guest_xml network_info=[{"id": "c17146c8-a3ec-4289-b41d-751fff2e490f", "address": "fa:16:3e:88:fb:1e", "network": {"id": "3594b817-94b7-461b-9cc7-b7f99c0605c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-143737876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b6ac63cf4a4e7b8a3c5db0242d4612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17146c8-a3", "ovs_interfaceid": "c17146c8-a3ec-4289-b41d-751fff2e490f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:54:18 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:54:18 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:54:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7 --force-share --output=json" returned: 0 in 0.362s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquiring lock "2caa0348060be914dfdb4919bc14bc1e9d5954f7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "2caa0348060be914dfdb4919bc14bc1e9d5954f7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:54:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1946762089',display_name='tempest-TestVolumeSwap-server-1946762089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1946762089',id=7,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt1we8u0Tg5fbB4Zfz1mK38cJ9vYiLUNrJkgmCeapO9kscK4KLAH0Umww9UKCtaaDjNQuzuccrsbA2t/N19Rn0uEd+U4bWVsruczoFc3J+cL5iEyBvdBaDPn8QhZCG/DA==',key_name='tempest-keypair-51357756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67b6ac63cf4a4e7b8a3c5db0242d4612',ramdisk_id='',reservation_id='r-gzev0n0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1312910266',owner_user_name='tempest-TestVolumeSwap-1312910266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8a64c0b83054c428413ccdb33464864',uuid=5b70fc11-140f-4c9a-9e75-2b33705d8c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c17146c8-a3ec-4289-b41d-751fff2e490f", "address": "fa:16:3e:88:fb:1e", "network": {"id": "3594b817-94b7-461b-9cc7-b7f99c0605c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-143737876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b6ac63cf4a4e7b8a3c5db0242d4612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17146c8-a3", "ovs_interfaceid": "c17146c8-a3ec-4289-b41d-751fff2e490f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Converting VIF {"id": "c17146c8-a3ec-4289-b41d-751fff2e490f", "address": "fa:16:3e:88:fb:1e", "network": {"id": "3594b817-94b7-461b-9cc7-b7f99c0605c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-143737876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b6ac63cf4a4e7b8a3c5db0242d4612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17146c8-a3", "ovs_interfaceid": "c17146c8-a3ec-4289-b41d-751fff2e490f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:fb:1e,bridge_name='br-int',has_traffic_filtering=True,id=c17146c8-a3ec-4289-b41d-751fff2e490f,network=Network(3594b817-94b7-461b-9cc7-b7f99c0605c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17146c8-a3') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.objects.instance [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b70fc11-140f-4c9a-9e75-2b33705d8c6d {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7 --force-share --output=json" returned: 0 in 0.427s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7,backing_fmt=raw /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:54:18 user nova-compute[74611]:   <uuid>5b70fc11-140f-4c9a-9e75-2b33705d8c6d</uuid>
Nov 13 09:54:18 user nova-compute[74611]:   <name>instance-00000007</name>
Nov 13 09:54:18 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:54:18 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:54:18 user nova-compute[74611]:   <metadata>
Nov 13 09:54:18 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:54:18 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:54:18 user nova-compute[74611]:       <nova:name>tempest-TestVolumeSwap-server-1946762089</nova:name>
Nov 13 09:54:18 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:54:18</nova:creationTime>
Nov 13 09:54:18 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:54:18 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:54:18 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:54:18 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:54:18 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:54:18 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:54:18 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:54:18 user nova-compute[74611]:       <nova:owner>
Nov 13 09:54:18 user nova-compute[74611]:         <nova:user uuid="c8a64c0b83054c428413ccdb33464864">tempest-TestVolumeSwap-1312910266-project-member</nova:user>
Nov 13 09:54:18 user nova-compute[74611]:         <nova:project uuid="67b6ac63cf4a4e7b8a3c5db0242d4612">tempest-TestVolumeSwap-1312910266</nova:project>
Nov 13 09:54:18 user nova-compute[74611]:       </nova:owner>
Nov 13 09:54:18 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:54:18 user nova-compute[74611]:       <nova:ports>
Nov 13 09:54:18 user nova-compute[74611]:         <nova:port uuid="c17146c8-a3ec-4289-b41d-751fff2e490f">
Nov 13 09:54:18 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 09:54:18 user nova-compute[74611]:         </nova:port>
Nov 13 09:54:18 user nova-compute[74611]:       </nova:ports>
Nov 13 09:54:18 user nova-compute[74611]:     </nova:instance>
Nov 13 09:54:18 user nova-compute[74611]:   </metadata>
Nov 13 09:54:18 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:54:18 user nova-compute[74611]:     <system>
Nov 13 09:54:18 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:54:18 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:54:18 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:54:18 user nova-compute[74611]:       <entry name="serial">5b70fc11-140f-4c9a-9e75-2b33705d8c6d</entry>
Nov 13 09:54:18 user nova-compute[74611]:       <entry name="uuid">5b70fc11-140f-4c9a-9e75-2b33705d8c6d</entry>
Nov 13 09:54:18 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:54:18 user nova-compute[74611]:     </system>
Nov 13 09:54:18 user nova-compute[74611]:   </sysinfo>
Nov 13 09:54:18 user nova-compute[74611]:   <os>
Nov 13 09:54:18 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:54:18 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:54:18 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:54:18 user nova-compute[74611]:   </os>
Nov 13 09:54:18 user nova-compute[74611]:   <features>
Nov 13 09:54:18 user nova-compute[74611]:     <acpi/>
Nov 13 09:54:18 user nova-compute[74611]:     <apic/>
Nov 13 09:54:18 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:54:18 user nova-compute[74611]:   </features>
Nov 13 09:54:18 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:54:18 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:54:18 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:54:18 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:54:18 user nova-compute[74611]:   </clock>
Nov 13 09:54:18 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:54:18 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:54:18 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:54:18 user nova-compute[74611]:   </cpu>
Nov 13 09:54:18 user nova-compute[74611]:   <devices>
Nov 13 09:54:18 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:54:18 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:54:18 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk"/>
Nov 13 09:54:18 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:54:18 user nova-compute[74611]:     </disk>
Nov 13 09:54:18 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:54:18 user nova-compute[74611]:       <mac address="fa:16:3e:88:fb:1e"/>
Nov 13 09:54:18 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:54:18 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:54:18 user nova-compute[74611]:       <target dev="tapc17146c8-a3"/>
Nov 13 09:54:18 user nova-compute[74611]:     </interface>
Nov 13 09:54:18 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:54:18 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/console.log" append="off"/>
Nov 13 09:54:18 user nova-compute[74611]:     </serial>
Nov 13 09:54:18 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:54:18 user nova-compute[74611]:     <video>
Nov 13 09:54:18 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:54:18 user nova-compute[74611]:     </video>
Nov 13 09:54:18 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:54:18 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:54:18 user nova-compute[74611]:     </rng>
Nov 13 09:54:18 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:54:18 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:54:18 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:54:18 user nova-compute[74611]:     </memballoon>
Nov 13 09:54:18 user nova-compute[74611]:   </devices>
Nov 13 09:54:18 user nova-compute[74611]: </domain>
Nov 13 09:54:18 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:54:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1946762089',display_name='tempest-TestVolumeSwap-server-1946762089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1946762089',id=7,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt1we8u0Tg5fbB4Zfz1mK38cJ9vYiLUNrJkgmCeapO9kscK4KLAH0Umww9UKCtaaDjNQuzuccrsbA2t/N19Rn0uEd+U4bWVsruczoFc3J+cL5iEyBvdBaDPn8QhZCG/DA==',key_name='tempest-keypair-51357756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67b6ac63cf4a4e7b8a3c5db0242d4612',ramdisk_id='',reservation_id='r-gzev0n0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1312910266',owner_user_name='tempest-TestVolumeSwap-1312910266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8a64c0b83054c428413ccdb33464864',uuid=5b70fc11-140f-4c9a-9e75-2b33705d8c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c17146c8-a3ec-4289-b41d-751fff2e490f", "address": "fa:16:3e:88:fb:1e", "network": {"id": "3594b817-94b7-461b-9cc7-b7f99c0605c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-143737876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b6ac63cf4a4e7b8a3c5db0242d4612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17146c8-a3", "ovs_interfaceid": "c17146c8-a3ec-4289-b41d-751fff2e490f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Converting VIF {"id": "c17146c8-a3ec-4289-b41d-751fff2e490f", "address": "fa:16:3e:88:fb:1e", "network": {"id": "3594b817-94b7-461b-9cc7-b7f99c0605c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-143737876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b6ac63cf4a4e7b8a3c5db0242d4612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17146c8-a3", "ovs_interfaceid": "c17146c8-a3ec-4289-b41d-751fff2e490f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:fb:1e,bridge_name='br-int',has_traffic_filtering=True,id=c17146c8-a3ec-4289-b41d-751fff2e490f,network=Network(3594b817-94b7-461b-9cc7-b7f99c0605c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17146c8-a3') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG os_vif [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:fb:1e,bridge_name='br-int',has_traffic_filtering=True,id=c17146c8-a3ec-4289-b41d-751fff2e490f,network=Network(3594b817-94b7-461b-9cc7-b7f99c0605c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17146c8-a3') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '327607f0-7e4b-5b4e-94e5-2bf0eb41267a', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc17146c8-a3, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc17146c8-a3, col_values=(('qos', UUID('8aadf3f9-65ab-4aba-83bc-28888af860a1')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc17146c8-a3, col_values=(('external_ids', {'iface-id': 'c17146c8-a3ec-4289-b41d-751fff2e490f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:fb:1e', 'vm-uuid': '5b70fc11-140f-4c9a-9e75-2b33705d8c6d'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7,backing_fmt=raw /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk 1073741824" returned: 0 in 0.354s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "2caa0348060be914dfdb4919bc14bc1e9d5954f7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.785s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:19 user nova-compute[74611]: INFO os_vif [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:fb:1e,bridge_name='br-int',has_traffic_filtering=True,id=c17146c8-a3ec-4289-b41d-751fff2e490f,network=Network(3594b817-94b7-461b-9cc7-b7f99c0605c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17146c8-a3')
Nov 13 09:54:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] No VIF found with MAC fa:16:3e:88:fb:1e, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7 --force-share --output=json" returned: 0 in 0.366s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Cannot resize image /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Ensure instance console log exists: /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.005s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG nova.network.neutron [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Successfully updated port: b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-80dcd7c0-6696-48e8-97f6-2de3b597d47d req-72fe6073-73cc-4070-b9b9-226ff662bbde service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Received event network-changed-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-80dcd7c0-6696-48e8-97f6-2de3b597d47d req-72fe6073-73cc-4070-b9b9-226ff662bbde service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Refreshing instance network info cache due to event network-changed-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-80dcd7c0-6696-48e8-97f6-2de3b597d47d req-72fe6073-73cc-4070-b9b9-226ff662bbde service nova] Acquiring lock "refresh_cache-54fdbd33-6f7c-440b-968b-cd743e2562c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-80dcd7c0-6696-48e8-97f6-2de3b597d47d req-72fe6073-73cc-4070-b9b9-226ff662bbde service nova] Acquired lock "refresh_cache-54fdbd33-6f7c-440b-968b-cd743e2562c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG nova.network.neutron [req-80dcd7c0-6696-48e8-97f6-2de3b597d47d req-72fe6073-73cc-4070-b9b9-226ff662bbde service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Refreshing network info cache for port b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquiring lock "refresh_cache-54fdbd33-6f7c-440b-968b-cd743e2562c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:19 user nova-compute[74611]: DEBUG nova.network.neutron [req-80dcd7c0-6696-48e8-97f6-2de3b597d47d req-72fe6073-73cc-4070-b9b9-226ff662bbde service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:54:20 user nova-compute[74611]: DEBUG nova.network.neutron [req-80dcd7c0-6696-48e8-97f6-2de3b597d47d req-72fe6073-73cc-4070-b9b9-226ff662bbde service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-80dcd7c0-6696-48e8-97f6-2de3b597d47d req-72fe6073-73cc-4070-b9b9-226ff662bbde service nova] Releasing lock "refresh_cache-54fdbd33-6f7c-440b-968b-cd743e2562c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquired lock "refresh_cache-54fdbd33-6f7c-440b-968b-cd743e2562c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:20 user nova-compute[74611]: DEBUG nova.network.neutron [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:54:20 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Successfully updated port: 805b4d7d-b250-40e4-af31-e9f281182115 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:54:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquired lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:20 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:54:20 user nova-compute[74611]: DEBUG nova.network.neutron [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:54:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-020bdf3d-0b2a-4965-b831-5d5b7d87eb37 req-319bdd62-368b-4b04-ab44-f84001c4a7d9 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received event network-changed-805b4d7d-b250-40e4-af31-e9f281182115 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-020bdf3d-0b2a-4965-b831-5d5b7d87eb37 req-319bdd62-368b-4b04-ab44-f84001c4a7d9 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Refreshing instance network info cache due to event network-changed-805b4d7d-b250-40e4-af31-e9f281182115. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:54:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-020bdf3d-0b2a-4965-b831-5d5b7d87eb37 req-319bdd62-368b-4b04-ab44-f84001c4a7d9 service nova] Acquiring lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:20 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Updating instance_info_cache with network_info: [{"id": "805b4d7d-b250-40e4-af31-e9f281182115", "address": "fa:16:3e:05:dc:a6", "network": {"id": "76b58f11-8450-4eea-b1c5-996e7112fd8b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1065019570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap805b4d7d-b2", "ovs_interfaceid": "805b4d7d-b250-40e4-af31-e9f281182115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.network.neutron [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Updating instance_info_cache with network_info: [{"id": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "address": "fa:16:3e:7d:87:b9", "network": {"id": "02ef9d76-af74-4ee0-85f4-f7655b4d4d9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1671331735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d4b071d0124c118e77acf5595e7c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bcb0be-cc", "ovs_interfaceid": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Releasing lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Instance network_info: |[{"id": "805b4d7d-b250-40e4-af31-e9f281182115", "address": "fa:16:3e:05:dc:a6", "network": {"id": "76b58f11-8450-4eea-b1c5-996e7112fd8b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1065019570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap805b4d7d-b2", "ovs_interfaceid": "805b4d7d-b250-40e4-af31-e9f281182115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-020bdf3d-0b2a-4965-b831-5d5b7d87eb37 req-319bdd62-368b-4b04-ab44-f84001c4a7d9 service nova] Acquired lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.network.neutron [req-020bdf3d-0b2a-4965-b831-5d5b7d87eb37 req-319bdd62-368b-4b04-ab44-f84001c4a7d9 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Refreshing network info cache for port 805b4d7d-b250-40e4-af31-e9f281182115 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Start _get_guest_xml network_info=[{"id": "805b4d7d-b250-40e4-af31-e9f281182115", "address": "fa:16:3e:05:dc:a6", "network": {"id": "76b58f11-8450-4eea-b1c5-996e7112fd8b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1065019570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap805b4d7d-b2", "ovs_interfaceid": "805b4d7d-b250-40e4-af31-e9f281182115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Releasing lock "refresh_cache-54fdbd33-6f7c-440b-968b-cd743e2562c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.compute.manager [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Instance network_info: |[{"id": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "address": "fa:16:3e:7d:87:b9", "network": {"id": "02ef9d76-af74-4ee0-85f4-f7655b4d4d9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1671331735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d4b071d0124c118e77acf5595e7c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bcb0be-cc", "ovs_interfaceid": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Start _get_guest_xml network_info=[{"id": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "address": "fa:16:3e:7d:87:b9", "network": {"id": "02ef9d76-af74-4ee0-85f4-f7655b4d4d9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1671331735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d4b071d0124c118e77acf5595e7c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bcb0be-cc", "ovs_interfaceid": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:54:00Z,direct_url=<?>,disk_format='qcow2',id=3f3da546-6a65-4512-82f8-1d9c387985df,min_disk=0,min_ram=0,name='',owner='cf2a03d62d554901b63ac61146e3eb4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:54:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '3f3da546-6a65-4512-82f8-1d9c387985df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:54:21 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:54:21 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:54:21 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:54:21 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-560513437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-560513437',id=8,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeQwNIdKbZkcJ1bL6vxLyRaw/tiXK1lBMCzqrmneLrH3GH4oV5/eRe+ZKc6KvSL9xj8s0omUXtq4rOBJVCBpsYTYfMFZFh2iLGaIRkl6/UO9iRuPbpk3z3yXYcyxqHiGw==',key_name='tempest-keypair-788651981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f6f36a09d514934ab7e11e7e945658f',ramdisk_id='',reservation_id='r-o8x6c9da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-987448261',owner_user_name='tempest-TaggedAttachmentsTest-987448261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4627e309322495f90a6e412f7e36c75',uuid=eea01f90-3c79-4304-913e-8cf7e9749480,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "805b4d7d-b250-40e4-af31-e9f281182115", "address": "fa:16:3e:05:dc:a6", "network": {"id": "76b58f11-8450-4eea-b1c5-996e7112fd8b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1065019570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap805b4d7d-b2", "ovs_interfaceid": "805b4d7d-b250-40e4-af31-e9f281182115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Converting VIF {"id": "805b4d7d-b250-40e4-af31-e9f281182115", "address": "fa:16:3e:05:dc:a6", "network": {"id": "76b58f11-8450-4eea-b1c5-996e7112fd8b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1065019570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap805b4d7d-b2", "ovs_interfaceid": "805b4d7d-b250-40e4-af31-e9f281182115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:dc:a6,bridge_name='br-int',has_traffic_filtering=True,id=805b4d7d-b250-40e4-af31-e9f281182115,network=Network(76b58f11-8450-4eea-b1c5-996e7112fd8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap805b4d7d-b2') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.objects.instance [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lazy-loading 'pci_devices' on Instance uuid eea01f90-3c79-4304-913e-8cf7e9749480 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:54:00Z,direct_url=<?>,disk_format='qcow2',id=3f3da546-6a65-4512-82f8-1d9c387985df,min_disk=0,min_ram=0,name='',owner='cf2a03d62d554901b63ac61146e3eb4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:54:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1703896712',display_name='tempest-AttachSCSIVolumeTestJSON-server-1703896712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1703896712',id=9,image_ref='3f3da546-6a65-4512-82f8-1d9c387985df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOe2LY8QjJ7Fu3Zrkp9Lu+RFNKW9A0N4TA+GoElOwfIjxUP6qw9rv3J0cPyjZMKgcW8Q8j9f3tlqlcKE7xBEWJwA1Uxl2XaoB7HbroZIyblZKnsHvbzCLSQUpm/+viGNg==',key_name='tempest-keypair-548196098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41d4b071d0124c118e77acf5595e7c00',ramdisk_id='',reservation_id='r-3f5knjok',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f3da546-6a65-4512-82f8-1d9c387985df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1150883813',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1150883813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a35ffdeb7c9d495791868be7cb705abd',uuid=54fdbd33-6f7c-440b-968b-cd743e2562c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "address": "fa:16:3e:7d:87:b9", "network": {"id": "02ef9d76-af74-4ee0-85f4-f7655b4d4d9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1671331735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d4b071d0124c118e77acf5595e7c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bcb0be-cc", "ovs_interfaceid": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Converting VIF {"id": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "address": "fa:16:3e:7d:87:b9", "network": {"id": "02ef9d76-af74-4ee0-85f4-f7655b4d4d9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1671331735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d4b071d0124c118e77acf5595e7c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bcb0be-cc", "ovs_interfaceid": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:87:b9,bridge_name='br-int',has_traffic_filtering=True,id=b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6,network=Network(02ef9d76-af74-4ee0-85f4-f7655b4d4d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bcb0be-cc') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.objects.instance [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lazy-loading 'pci_devices' on Instance uuid 54fdbd33-6f7c-440b-968b-cd743e2562c4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:54:21 user nova-compute[74611]:   <uuid>eea01f90-3c79-4304-913e-8cf7e9749480</uuid>
Nov 13 09:54:21 user nova-compute[74611]:   <name>instance-00000008</name>
Nov 13 09:54:21 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:54:21 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:54:21 user nova-compute[74611]:   <metadata>
Nov 13 09:54:21 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:54:21 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:54:21 user nova-compute[74611]:       <nova:name>tempest-device-tagging-server-560513437</nova:name>
Nov 13 09:54:21 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:54:21</nova:creationTime>
Nov 13 09:54:21 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:54:21 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:54:21 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:54:21 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:54:21 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:54:21 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:54:21 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:54:21 user nova-compute[74611]:       <nova:owner>
Nov 13 09:54:21 user nova-compute[74611]:         <nova:user uuid="a4627e309322495f90a6e412f7e36c75">tempest-TaggedAttachmentsTest-987448261-project-member</nova:user>
Nov 13 09:54:21 user nova-compute[74611]:         <nova:project uuid="9f6f36a09d514934ab7e11e7e945658f">tempest-TaggedAttachmentsTest-987448261</nova:project>
Nov 13 09:54:21 user nova-compute[74611]:       </nova:owner>
Nov 13 09:54:21 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:54:21 user nova-compute[74611]:       <nova:ports>
Nov 13 09:54:21 user nova-compute[74611]:         <nova:port uuid="805b4d7d-b250-40e4-af31-e9f281182115">
Nov 13 09:54:21 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 09:54:21 user nova-compute[74611]:         </nova:port>
Nov 13 09:54:21 user nova-compute[74611]:       </nova:ports>
Nov 13 09:54:21 user nova-compute[74611]:     </nova:instance>
Nov 13 09:54:21 user nova-compute[74611]:   </metadata>
Nov 13 09:54:21 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:54:21 user nova-compute[74611]:     <system>
Nov 13 09:54:21 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:54:21 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:54:21 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:54:21 user nova-compute[74611]:       <entry name="serial">eea01f90-3c79-4304-913e-8cf7e9749480</entry>
Nov 13 09:54:21 user nova-compute[74611]:       <entry name="uuid">eea01f90-3c79-4304-913e-8cf7e9749480</entry>
Nov 13 09:54:21 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:54:21 user nova-compute[74611]:     </system>
Nov 13 09:54:21 user nova-compute[74611]:   </sysinfo>
Nov 13 09:54:21 user nova-compute[74611]:   <os>
Nov 13 09:54:21 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:54:21 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:54:21 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:54:21 user nova-compute[74611]:   </os>
Nov 13 09:54:21 user nova-compute[74611]:   <features>
Nov 13 09:54:21 user nova-compute[74611]:     <acpi/>
Nov 13 09:54:21 user nova-compute[74611]:     <apic/>
Nov 13 09:54:21 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:54:21 user nova-compute[74611]:   </features>
Nov 13 09:54:21 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:54:21 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:54:21 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:54:21 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:54:21 user nova-compute[74611]:   </clock>
Nov 13 09:54:21 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:54:21 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:54:21 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:54:21 user nova-compute[74611]:   </cpu>
Nov 13 09:54:21 user nova-compute[74611]:   <devices>
Nov 13 09:54:21 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:54:21 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:54:21 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk"/>
Nov 13 09:54:21 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:54:21 user nova-compute[74611]:     </disk>
Nov 13 09:54:21 user nova-compute[74611]:     <disk type="file" device="cdrom">
Nov 13 09:54:21 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 09:54:21 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk.config"/>
Nov 13 09:54:21 user nova-compute[74611]:       <target dev="hda" bus="ide"/>
Nov 13 09:54:21 user nova-compute[74611]:     </disk>
Nov 13 09:54:21 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:54:21 user nova-compute[74611]:       <mac address="fa:16:3e:05:dc:a6"/>
Nov 13 09:54:21 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:54:21 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:54:21 user nova-compute[74611]:       <target dev="tap805b4d7d-b2"/>
Nov 13 09:54:21 user nova-compute[74611]:     </interface>
Nov 13 09:54:21 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:54:21 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/console.log" append="off"/>
Nov 13 09:54:21 user nova-compute[74611]:     </serial>
Nov 13 09:54:21 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:54:21 user nova-compute[74611]:     <video>
Nov 13 09:54:21 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:54:21 user nova-compute[74611]:     </video>
Nov 13 09:54:21 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:54:21 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:54:21 user nova-compute[74611]:     </rng>
Nov 13 09:54:21 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:54:21 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:54:21 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:54:21 user nova-compute[74611]:     </memballoon>
Nov 13 09:54:21 user nova-compute[74611]:   </devices>
Nov 13 09:54:21 user nova-compute[74611]: </domain>
Nov 13 09:54:21 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-560513437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-560513437',id=8,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeQwNIdKbZkcJ1bL6vxLyRaw/tiXK1lBMCzqrmneLrH3GH4oV5/eRe+ZKc6KvSL9xj8s0omUXtq4rOBJVCBpsYTYfMFZFh2iLGaIRkl6/UO9iRuPbpk3z3yXYcyxqHiGw==',key_name='tempest-keypair-788651981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f6f36a09d514934ab7e11e7e945658f',ramdisk_id='',reservation_id='r-o8x6c9da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-987448261',owner_user_name='tempest-TaggedAttachmentsTest-987448261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4627e309322495f90a6e412f7e36c75',uuid=eea01f90-3c79-4304-913e-8cf7e9749480,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "805b4d7d-b250-40e4-af31-e9f281182115", "address": "fa:16:3e:05:dc:a6", "network": {"id": "76b58f11-8450-4eea-b1c5-996e7112fd8b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1065019570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap805b4d7d-b2", "ovs_interfaceid": "805b4d7d-b250-40e4-af31-e9f281182115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Converting VIF {"id": "805b4d7d-b250-40e4-af31-e9f281182115", "address": "fa:16:3e:05:dc:a6", "network": {"id": "76b58f11-8450-4eea-b1c5-996e7112fd8b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1065019570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap805b4d7d-b2", "ovs_interfaceid": "805b4d7d-b250-40e4-af31-e9f281182115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:dc:a6,bridge_name='br-int',has_traffic_filtering=True,id=805b4d7d-b250-40e4-af31-e9f281182115,network=Network(76b58f11-8450-4eea-b1c5-996e7112fd8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap805b4d7d-b2') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG os_vif [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:dc:a6,bridge_name='br-int',has_traffic_filtering=True,id=805b4d7d-b250-40e4-af31-e9f281182115,network=Network(76b58f11-8450-4eea-b1c5-996e7112fd8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap805b4d7d-b2') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0591d9cb-543d-5542-b2bf-82fdc3ae3f75', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:54:21 user nova-compute[74611]:   <uuid>54fdbd33-6f7c-440b-968b-cd743e2562c4</uuid>
Nov 13 09:54:21 user nova-compute[74611]:   <name>instance-00000009</name>
Nov 13 09:54:21 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:54:21 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:54:21 user nova-compute[74611]:   <metadata>
Nov 13 09:54:21 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:54:21 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:54:21 user nova-compute[74611]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1703896712</nova:name>
Nov 13 09:54:21 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:54:21</nova:creationTime>
Nov 13 09:54:21 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:54:21 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:54:21 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:54:21 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:54:21 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:54:21 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:54:21 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:54:21 user nova-compute[74611]:       <nova:owner>
Nov 13 09:54:21 user nova-compute[74611]:         <nova:user uuid="a35ffdeb7c9d495791868be7cb705abd">tempest-AttachSCSIVolumeTestJSON-1150883813-project-member</nova:user>
Nov 13 09:54:21 user nova-compute[74611]:         <nova:project uuid="41d4b071d0124c118e77acf5595e7c00">tempest-AttachSCSIVolumeTestJSON-1150883813</nova:project>
Nov 13 09:54:21 user nova-compute[74611]:       </nova:owner>
Nov 13 09:54:21 user nova-compute[74611]:       <nova:root type="image" uuid="3f3da546-6a65-4512-82f8-1d9c387985df"/>
Nov 13 09:54:21 user nova-compute[74611]:       <nova:ports>
Nov 13 09:54:21 user nova-compute[74611]:         <nova:port uuid="b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6">
Nov 13 09:54:21 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 09:54:21 user nova-compute[74611]:         </nova:port>
Nov 13 09:54:21 user nova-compute[74611]:       </nova:ports>
Nov 13 09:54:21 user nova-compute[74611]:     </nova:instance>
Nov 13 09:54:21 user nova-compute[74611]:   </metadata>
Nov 13 09:54:21 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:54:21 user nova-compute[74611]:     <system>
Nov 13 09:54:21 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:54:21 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:54:21 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:54:21 user nova-compute[74611]:       <entry name="serial">54fdbd33-6f7c-440b-968b-cd743e2562c4</entry>
Nov 13 09:54:21 user nova-compute[74611]:       <entry name="uuid">54fdbd33-6f7c-440b-968b-cd743e2562c4</entry>
Nov 13 09:54:21 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:54:21 user nova-compute[74611]:     </system>
Nov 13 09:54:21 user nova-compute[74611]:   </sysinfo>
Nov 13 09:54:21 user nova-compute[74611]:   <os>
Nov 13 09:54:21 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:54:21 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:54:21 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:54:21 user nova-compute[74611]:   </os>
Nov 13 09:54:21 user nova-compute[74611]:   <features>
Nov 13 09:54:21 user nova-compute[74611]:     <acpi/>
Nov 13 09:54:21 user nova-compute[74611]:     <apic/>
Nov 13 09:54:21 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:54:21 user nova-compute[74611]:   </features>
Nov 13 09:54:21 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:54:21 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:54:21 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:54:21 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:54:21 user nova-compute[74611]:   </clock>
Nov 13 09:54:21 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:54:21 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:54:21 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:54:21 user nova-compute[74611]:   </cpu>
Nov 13 09:54:21 user nova-compute[74611]:   <devices>
Nov 13 09:54:21 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:54:21 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:54:21 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk"/>
Nov 13 09:54:21 user nova-compute[74611]:       <target dev="sda" bus="scsi"/>
Nov 13 09:54:21 user nova-compute[74611]:       <address type="drive" controller="0" unit="0"/>
Nov 13 09:54:21 user nova-compute[74611]:     </disk>
Nov 13 09:54:21 user nova-compute[74611]:     <disk type="file" device="cdrom">
Nov 13 09:54:21 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 09:54:21 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk.config"/>
Nov 13 09:54:21 user nova-compute[74611]:       <target dev="sdb" bus="scsi"/>
Nov 13 09:54:21 user nova-compute[74611]:       <address type="drive" controller="0" unit="1"/>
Nov 13 09:54:21 user nova-compute[74611]:     </disk>
Nov 13 09:54:21 user nova-compute[74611]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 13 09:54:21 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:54:21 user nova-compute[74611]:       <mac address="fa:16:3e:7d:87:b9"/>
Nov 13 09:54:21 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:54:21 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:54:21 user nova-compute[74611]:       <target dev="tapb4bcb0be-cc"/>
Nov 13 09:54:21 user nova-compute[74611]:     </interface>
Nov 13 09:54:21 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:54:21 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/console.log" append="off"/>
Nov 13 09:54:21 user nova-compute[74611]:     </serial>
Nov 13 09:54:21 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:54:21 user nova-compute[74611]:     <video>
Nov 13 09:54:21 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:54:21 user nova-compute[74611]:     </video>
Nov 13 09:54:21 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:54:21 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:54:21 user nova-compute[74611]:     </rng>
Nov 13 09:54:21 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:54:21 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:54:21 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:54:21 user nova-compute[74611]:     </memballoon>
Nov 13 09:54:21 user nova-compute[74611]:   </devices>
Nov 13 09:54:21 user nova-compute[74611]: </domain>
Nov 13 09:54:21 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1703896712',display_name='tempest-AttachSCSIVolumeTestJSON-server-1703896712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1703896712',id=9,image_ref='3f3da546-6a65-4512-82f8-1d9c387985df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOe2LY8QjJ7Fu3Zrkp9Lu+RFNKW9A0N4TA+GoElOwfIjxUP6qw9rv3J0cPyjZMKgcW8Q8j9f3tlqlcKE7xBEWJwA1Uxl2XaoB7HbroZIyblZKnsHvbzCLSQUpm/+viGNg==',key_name='tempest-keypair-548196098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41d4b071d0124c118e77acf5595e7c00',ramdisk_id='',reservation_id='r-3f5knjok',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f3da546-6a65-4512-82f8-1d9c387985df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1150883813',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1150883813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a35ffdeb7c9d495791868be7cb705abd',uuid=54fdbd33-6f7c-440b-968b-cd743e2562c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "address": "fa:16:3e:7d:87:b9", "network": {"id": "02ef9d76-af74-4ee0-85f4-f7655b4d4d9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1671331735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d4b071d0124c118e77acf5595e7c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bcb0be-cc", "ovs_interfaceid": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Converting VIF {"id": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "address": "fa:16:3e:7d:87:b9", "network": {"id": "02ef9d76-af74-4ee0-85f4-f7655b4d4d9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1671331735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d4b071d0124c118e77acf5595e7c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bcb0be-cc", "ovs_interfaceid": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:87:b9,bridge_name='br-int',has_traffic_filtering=True,id=b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6,network=Network(02ef9d76-af74-4ee0-85f4-f7655b4d4d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bcb0be-cc') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG os_vif [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:87:b9,bridge_name='br-int',has_traffic_filtering=True,id=b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6,network=Network(02ef9d76-af74-4ee0-85f4-f7655b4d4d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bcb0be-cc') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25888b86-4488-517d-bafb-8db2a1316714', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap805b4d7d-b2, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap805b4d7d-b2, col_values=(('qos', UUID('5eea3ea4-982f-45eb-b6eb-b10d0ec96c39')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap805b4d7d-b2, col_values=(('external_ids', {'iface-id': '805b4d7d-b250-40e4-af31-e9f281182115', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:dc:a6', 'vm-uuid': 'eea01f90-3c79-4304-913e-8cf7e9749480'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: INFO os_vif [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:dc:a6,bridge_name='br-int',has_traffic_filtering=True,id=805b4d7d-b250-40e4-af31-e9f281182115,network=Network(76b58f11-8450-4eea-b1c5-996e7112fd8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap805b4d7d-b2')
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4bcb0be-cc, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4bcb0be-cc, col_values=(('qos', UUID('295a2dc4-a799-404b-b753-524d31c47355')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4bcb0be-cc, col_values=(('external_ids', {'iface-id': 'b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:87:b9', 'vm-uuid': '54fdbd33-6f7c-440b-968b-cd743e2562c4'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: INFO os_vif [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:87:b9,bridge_name='br-int',has_traffic_filtering=True,id=b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6,network=Network(02ef9d76-af74-4ee0-85f4-f7655b4d4d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bcb0be-cc')
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] No BDM found with device name hda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] No VIF found with MAC fa:16:3e:05:dc:a6, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:54:21 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Using config drive
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] No BDM found with device name sda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] No VIF found with MAC fa:16:3e:7d:87:b9, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:54:21 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Using config drive
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:22 user nova-compute[74611]: DEBUG nova.network.neutron [req-020bdf3d-0b2a-4965-b831-5d5b7d87eb37 req-319bdd62-368b-4b04-ab44-f84001c4a7d9 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Updated VIF entry in instance network info cache for port 805b4d7d-b250-40e4-af31-e9f281182115. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:54:22 user nova-compute[74611]: DEBUG nova.network.neutron [req-020bdf3d-0b2a-4965-b831-5d5b7d87eb37 req-319bdd62-368b-4b04-ab44-f84001c4a7d9 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Updating instance_info_cache with network_info: [{"id": "805b4d7d-b250-40e4-af31-e9f281182115", "address": "fa:16:3e:05:dc:a6", "network": {"id": "76b58f11-8450-4eea-b1c5-996e7112fd8b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1065019570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap805b4d7d-b2", "ovs_interfaceid": "805b4d7d-b250-40e4-af31-e9f281182115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-020bdf3d-0b2a-4965-b831-5d5b7d87eb37 req-319bdd62-368b-4b04-ab44-f84001c4a7d9 service nova] Releasing lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:22 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Creating config drive at /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk.config
Nov 13 09:54:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk2c6n4x0 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk2c6n4x0" returned: 0 in 0.077s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:22 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Creating config drive at /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk.config
Nov 13 09:54:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5jkqpx08 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5jkqpx08" returned: 0 in 0.065s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Acquiring lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.compute.manager [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:54:24 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Instance spawned successfully.
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:54:24 user nova-compute[74611]: INFO nova.compute.claims [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Claim successful on node user
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:24 user nova-compute[74611]: INFO nova.compute.manager [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Took 12.34 seconds to spawn the instance on the hypervisor.
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:54:24 user nova-compute[74611]: INFO nova.compute.manager [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Took 14.14 seconds to build instance.
Nov 13 09:54:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd8aa5-a28e-463f-92bc-eb9152aeb4b8 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.354s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.compute.manager [req-509f983e-bbd0-4eda-a4ee-7f4d509cca78 req-b1201a70-3969-40a8-94f2-8ca3264a72c6 service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Received event network-vif-plugged-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-509f983e-bbd0-4eda-a4ee-7f4d509cca78 req-b1201a70-3969-40a8-94f2-8ca3264a72c6 service nova] Acquiring lock "54fdbd33-6f7c-440b-968b-cd743e2562c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-509f983e-bbd0-4eda-a4ee-7f4d509cca78 req-b1201a70-3969-40a8-94f2-8ca3264a72c6 service nova] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-509f983e-bbd0-4eda-a4ee-7f4d509cca78 req-b1201a70-3969-40a8-94f2-8ca3264a72c6 service nova] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.compute.manager [req-509f983e-bbd0-4eda-a4ee-7f4d509cca78 req-b1201a70-3969-40a8-94f2-8ca3264a72c6 service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] No waiting events found dispatching network-vif-plugged-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:24 user nova-compute[74611]: WARNING nova.compute.manager [req-509f983e-bbd0-4eda-a4ee-7f4d509cca78 req-b1201a70-3969-40a8-94f2-8ca3264a72c6 service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Received unexpected event network-vif-plugged-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 for instance with vm_state building and task_state spawning.
Nov 13 09:54:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.642s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.compute.manager [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.compute.manager [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:54:24 user nova-compute[74611]: DEBUG nova.network.neutron [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:54:24 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:54:25 user nova-compute[74611]: DEBUG nova.compute.manager [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG nova.policy [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc02d92b8a6a48beb1518025204db76f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd8a9b04d5a4f65817ea43a6d5b1d65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG nova.compute.manager [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:54:25 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Creating image(s)
Nov 13 09:54:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Acquiring lock "/opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lock "/opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lock "/opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.235s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.246s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk 1073741824" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.433s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.251s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Cannot resize image /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Ensure instance console log exists: /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG nova.network.neutron [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Successfully created port: 488eb964-98e4-4e75-ba87-fc1840497377 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Received event network-vif-plugged-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] Acquiring lock "54fdbd33-6f7c-440b-968b-cd743e2562c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] No waiting events found dispatching network-vif-plugged-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:26 user nova-compute[74611]: WARNING nova.compute.manager [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Received unexpected event network-vif-plugged-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 for instance with vm_state building and task_state spawning.
Nov 13 09:54:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received event network-vif-plugged-805b4d7d-b250-40e4-af31-e9f281182115 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] Acquiring lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] No waiting events found dispatching network-vif-plugged-805b4d7d-b250-40e4-af31-e9f281182115 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:26 user nova-compute[74611]: WARNING nova.compute.manager [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received unexpected event network-vif-plugged-805b4d7d-b250-40e4-af31-e9f281182115 for instance with vm_state building and task_state spawning.
Nov 13 09:54:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received event network-vif-plugged-805b4d7d-b250-40e4-af31-e9f281182115 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] Acquiring lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] No waiting events found dispatching network-vif-plugged-805b4d7d-b250-40e4-af31-e9f281182115 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:26 user nova-compute[74611]: WARNING nova.compute.manager [req-43a53e78-1358-4c31-804a-7770fabf69d8 req-2d76173b-0bf0-480d-9a1b-b50e647ff506 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received unexpected event network-vif-plugged-805b4d7d-b250-40e4-af31-e9f281182115 for instance with vm_state building and task_state spawning.
Nov 13 09:54:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:27 user nova-compute[74611]: DEBUG nova.compute.manager [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:54:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:54:27 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Instance spawned successfully.
Nov 13 09:54:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:54:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:54:28 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Instance spawned successfully.
Nov 13 09:54:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:28 user nova-compute[74611]: INFO nova.compute.manager [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Took 12.53 seconds to spawn the instance on the hypervisor.
Nov 13 09:54:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:54:28 user nova-compute[74611]: INFO nova.compute.manager [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Took 14.31 seconds to spawn the instance on the hypervisor.
Nov 13 09:54:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:54:28 user nova-compute[74611]: INFO nova.compute.manager [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Took 14.91 seconds to build instance.
Nov 13 09:54:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50b2b23d-7b38-486b-a63f-e4314db4916c tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.367s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG nova.network.neutron [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Successfully updated port: 488eb964-98e4-4e75-ba87-fc1840497377 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-37213389-47af-4b89-90df-4e9b70203166 req-58c1f89f-9964-4145-ab74-1c5ac57c8e8f service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Received event network-changed-488eb964-98e4-4e75-ba87-fc1840497377 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-37213389-47af-4b89-90df-4e9b70203166 req-58c1f89f-9964-4145-ab74-1c5ac57c8e8f service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Refreshing instance network info cache due to event network-changed-488eb964-98e4-4e75-ba87-fc1840497377. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-37213389-47af-4b89-90df-4e9b70203166 req-58c1f89f-9964-4145-ab74-1c5ac57c8e8f service nova] Acquiring lock "refresh_cache-8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-37213389-47af-4b89-90df-4e9b70203166 req-58c1f89f-9964-4145-ab74-1c5ac57c8e8f service nova] Acquired lock "refresh_cache-8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG nova.network.neutron [req-37213389-47af-4b89-90df-4e9b70203166 req-58c1f89f-9964-4145-ab74-1c5ac57c8e8f service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Refreshing network info cache for port 488eb964-98e4-4e75-ba87-fc1840497377 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Acquiring lock "refresh_cache-8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:28 user nova-compute[74611]: INFO nova.compute.manager [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Took 16.42 seconds to build instance.
Nov 13 09:54:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c758fd48-030b-4f19-b948-d908b6cd699c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "eea01f90-3c79-4304-913e-8cf7e9749480" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.722s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG nova.network.neutron [req-37213389-47af-4b89-90df-4e9b70203166 req-58c1f89f-9964-4145-ab74-1c5ac57c8e8f service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:54:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:29 user nova-compute[74611]: DEBUG nova.network.neutron [req-37213389-47af-4b89-90df-4e9b70203166 req-58c1f89f-9964-4145-ab74-1c5ac57c8e8f service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-37213389-47af-4b89-90df-4e9b70203166 req-58c1f89f-9964-4145-ab74-1c5ac57c8e8f service nova] Releasing lock "refresh_cache-8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Acquired lock "refresh_cache-8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:29 user nova-compute[74611]: DEBUG nova.network.neutron [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:54:29 user nova-compute[74611]: DEBUG nova.network.neutron [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:54:29 user nova-compute[74611]: DEBUG nova.network.neutron [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Updating instance_info_cache with network_info: [{"id": "488eb964-98e4-4e75-ba87-fc1840497377", "address": "fa:16:3e:e4:cf:27", "network": {"id": "7f214546-77f6-41eb-862b-32bc271a8a52", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028523718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd8a9b04d5a4f65817ea43a6d5b1d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488eb964-98", "ovs_interfaceid": "488eb964-98e4-4e75-ba87-fc1840497377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Releasing lock "refresh_cache-8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.compute.manager [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Instance network_info: |[{"id": "488eb964-98e4-4e75-ba87-fc1840497377", "address": "fa:16:3e:e4:cf:27", "network": {"id": "7f214546-77f6-41eb-862b-32bc271a8a52", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028523718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd8a9b04d5a4f65817ea43a6d5b1d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488eb964-98", "ovs_interfaceid": "488eb964-98e4-4e75-ba87-fc1840497377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Start _get_guest_xml network_info=[{"id": "488eb964-98e4-4e75-ba87-fc1840497377", "address": "fa:16:3e:e4:cf:27", "network": {"id": "7f214546-77f6-41eb-862b-32bc271a8a52", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028523718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd8a9b04d5a4f65817ea43a6d5b1d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488eb964-98", "ovs_interfaceid": "488eb964-98e4-4e75-ba87-fc1840497377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:54:30 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:54:30 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:54:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-210550892',display_name='tempest-VolumesAssistedSnapshotsTest-server-210550892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-210550892',id=10,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMevTcN51U344Uj6IgiNad9WHrnVuYlpXcxeCPuJoMVj/APulAW9stjZetOFUMz2G8xBULlnAS3oQ+mWtCt84m7RQNvkpluMiw5AhnCK+Po9mCs9NGa2hOU9LtNCfa3zQ==',key_name='tempest-keypair-1584324317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abd8a9b04d5a4f65817ea43a6d5b1d65',ramdisk_id='',reservation_id='r-v31hagif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-715196711',owner_user_name='tempest-VolumesAssistedSnapshotsTest-715196711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc02d92b8a6a48beb1518025204db76f',uuid=8daf2c72-3fcb-42dc-804f-8ba92ffebd7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "488eb964-98e4-4e75-ba87-fc1840497377", "address": "fa:16:3e:e4:cf:27", "network": {"id": "7f214546-77f6-41eb-862b-32bc271a8a52", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028523718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd8a9b04d5a4f65817ea43a6d5b1d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488eb964-98", "ovs_interfaceid": "488eb964-98e4-4e75-ba87-fc1840497377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Converting VIF {"id": "488eb964-98e4-4e75-ba87-fc1840497377", "address": "fa:16:3e:e4:cf:27", "network": {"id": "7f214546-77f6-41eb-862b-32bc271a8a52", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028523718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd8a9b04d5a4f65817ea43a6d5b1d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488eb964-98", "ovs_interfaceid": "488eb964-98e4-4e75-ba87-fc1840497377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cf:27,bridge_name='br-int',has_traffic_filtering=True,id=488eb964-98e4-4e75-ba87-fc1840497377,network=Network(7f214546-77f6-41eb-862b-32bc271a8a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap488eb964-98') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.objects.instance [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lazy-loading 'pci_devices' on Instance uuid 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:54:30 user nova-compute[74611]:   <uuid>8daf2c72-3fcb-42dc-804f-8ba92ffebd7c</uuid>
Nov 13 09:54:30 user nova-compute[74611]:   <name>instance-0000000a</name>
Nov 13 09:54:30 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:54:30 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:54:30 user nova-compute[74611]:   <metadata>
Nov 13 09:54:30 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:54:30 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:54:30 user nova-compute[74611]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-210550892</nova:name>
Nov 13 09:54:30 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:54:30</nova:creationTime>
Nov 13 09:54:30 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:54:30 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:54:30 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:54:30 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:54:30 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:54:30 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:54:30 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:54:30 user nova-compute[74611]:       <nova:owner>
Nov 13 09:54:30 user nova-compute[74611]:         <nova:user uuid="dc02d92b8a6a48beb1518025204db76f">tempest-VolumesAssistedSnapshotsTest-715196711-project-member</nova:user>
Nov 13 09:54:30 user nova-compute[74611]:         <nova:project uuid="abd8a9b04d5a4f65817ea43a6d5b1d65">tempest-VolumesAssistedSnapshotsTest-715196711</nova:project>
Nov 13 09:54:30 user nova-compute[74611]:       </nova:owner>
Nov 13 09:54:30 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:54:30 user nova-compute[74611]:       <nova:ports>
Nov 13 09:54:30 user nova-compute[74611]:         <nova:port uuid="488eb964-98e4-4e75-ba87-fc1840497377">
Nov 13 09:54:30 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 09:54:30 user nova-compute[74611]:         </nova:port>
Nov 13 09:54:30 user nova-compute[74611]:       </nova:ports>
Nov 13 09:54:30 user nova-compute[74611]:     </nova:instance>
Nov 13 09:54:30 user nova-compute[74611]:   </metadata>
Nov 13 09:54:30 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:54:30 user nova-compute[74611]:     <system>
Nov 13 09:54:30 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:54:30 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:54:30 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:54:30 user nova-compute[74611]:       <entry name="serial">8daf2c72-3fcb-42dc-804f-8ba92ffebd7c</entry>
Nov 13 09:54:30 user nova-compute[74611]:       <entry name="uuid">8daf2c72-3fcb-42dc-804f-8ba92ffebd7c</entry>
Nov 13 09:54:30 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:54:30 user nova-compute[74611]:     </system>
Nov 13 09:54:30 user nova-compute[74611]:   </sysinfo>
Nov 13 09:54:30 user nova-compute[74611]:   <os>
Nov 13 09:54:30 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:54:30 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:54:30 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:54:30 user nova-compute[74611]:   </os>
Nov 13 09:54:30 user nova-compute[74611]:   <features>
Nov 13 09:54:30 user nova-compute[74611]:     <acpi/>
Nov 13 09:54:30 user nova-compute[74611]:     <apic/>
Nov 13 09:54:30 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:54:30 user nova-compute[74611]:   </features>
Nov 13 09:54:30 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:54:30 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:54:30 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:54:30 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:54:30 user nova-compute[74611]:   </clock>
Nov 13 09:54:30 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:54:30 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:54:30 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:54:30 user nova-compute[74611]:   </cpu>
Nov 13 09:54:30 user nova-compute[74611]:   <devices>
Nov 13 09:54:30 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:54:30 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:54:30 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk"/>
Nov 13 09:54:30 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:54:30 user nova-compute[74611]:     </disk>
Nov 13 09:54:30 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:54:30 user nova-compute[74611]:       <mac address="fa:16:3e:e4:cf:27"/>
Nov 13 09:54:30 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:54:30 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:54:30 user nova-compute[74611]:       <target dev="tap488eb964-98"/>
Nov 13 09:54:30 user nova-compute[74611]:     </interface>
Nov 13 09:54:30 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:54:30 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/console.log" append="off"/>
Nov 13 09:54:30 user nova-compute[74611]:     </serial>
Nov 13 09:54:30 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:54:30 user nova-compute[74611]:     <video>
Nov 13 09:54:30 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:54:30 user nova-compute[74611]:     </video>
Nov 13 09:54:30 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:54:30 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:54:30 user nova-compute[74611]:     </rng>
Nov 13 09:54:30 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:54:30 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:54:30 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:54:30 user nova-compute[74611]:     </memballoon>
Nov 13 09:54:30 user nova-compute[74611]:   </devices>
Nov 13 09:54:30 user nova-compute[74611]: </domain>
Nov 13 09:54:30 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:54:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-210550892',display_name='tempest-VolumesAssistedSnapshotsTest-server-210550892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-210550892',id=10,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMevTcN51U344Uj6IgiNad9WHrnVuYlpXcxeCPuJoMVj/APulAW9stjZetOFUMz2G8xBULlnAS3oQ+mWtCt84m7RQNvkpluMiw5AhnCK+Po9mCs9NGa2hOU9LtNCfa3zQ==',key_name='tempest-keypair-1584324317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abd8a9b04d5a4f65817ea43a6d5b1d65',ramdisk_id='',reservation_id='r-v31hagif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-715196711',owner_user_name='tempest-VolumesAssistedSnapshotsTest-715196711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc02d92b8a6a48beb1518025204db76f',uuid=8daf2c72-3fcb-42dc-804f-8ba92ffebd7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "488eb964-98e4-4e75-ba87-fc1840497377", "address": "fa:16:3e:e4:cf:27", "network": {"id": "7f214546-77f6-41eb-862b-32bc271a8a52", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028523718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd8a9b04d5a4f65817ea43a6d5b1d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488eb964-98", "ovs_interfaceid": "488eb964-98e4-4e75-ba87-fc1840497377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Converting VIF {"id": "488eb964-98e4-4e75-ba87-fc1840497377", "address": "fa:16:3e:e4:cf:27", "network": {"id": "7f214546-77f6-41eb-862b-32bc271a8a52", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028523718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd8a9b04d5a4f65817ea43a6d5b1d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488eb964-98", "ovs_interfaceid": "488eb964-98e4-4e75-ba87-fc1840497377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cf:27,bridge_name='br-int',has_traffic_filtering=True,id=488eb964-98e4-4e75-ba87-fc1840497377,network=Network(7f214546-77f6-41eb-862b-32bc271a8a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap488eb964-98') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG os_vif [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cf:27,bridge_name='br-int',has_traffic_filtering=True,id=488eb964-98e4-4e75-ba87-fc1840497377,network=Network(7f214546-77f6-41eb-862b-32bc271a8a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap488eb964-98') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b129f986-53ad-52c9-853a-0b0adbc650bb', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap488eb964-98, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap488eb964-98, col_values=(('qos', UUID('057dda03-795e-4532-9e3d-270793abf38f')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap488eb964-98, col_values=(('external_ids', {'iface-id': '488eb964-98e4-4e75-ba87-fc1840497377', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:cf:27', 'vm-uuid': '8daf2c72-3fcb-42dc-804f-8ba92ffebd7c'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:30 user nova-compute[74611]: INFO os_vif [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cf:27,bridge_name='br-int',has_traffic_filtering=True,id=488eb964-98e4-4e75-ba87-fc1840497377,network=Network(7f214546-77f6-41eb-862b-32bc271a8a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap488eb964-98')
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:54:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] No VIF found with MAC fa:16:3e:e4:cf:27, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:54:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:54:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 09:54:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] There are 0 instances to clean {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 09:54:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:54:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74611) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 09:54:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:54:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-3edafd57-b130-4d41-8be0-97c4d223e70c req-0df9d284-fdcd-4c42-b630-da4e0a459ac4 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Received event network-vif-plugged-488eb964-98e4-4e75-ba87-fc1840497377 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3edafd57-b130-4d41-8be0-97c4d223e70c req-0df9d284-fdcd-4c42-b630-da4e0a459ac4 service nova] Acquiring lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3edafd57-b130-4d41-8be0-97c4d223e70c req-0df9d284-fdcd-4c42-b630-da4e0a459ac4 service nova] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3edafd57-b130-4d41-8be0-97c4d223e70c req-0df9d284-fdcd-4c42-b630-da4e0a459ac4 service nova] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-3edafd57-b130-4d41-8be0-97c4d223e70c req-0df9d284-fdcd-4c42-b630-da4e0a459ac4 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] No waiting events found dispatching network-vif-plugged-488eb964-98e4-4e75-ba87-fc1840497377 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:33 user nova-compute[74611]: WARNING nova.compute.manager [req-3edafd57-b130-4d41-8be0-97c4d223e70c req-0df9d284-fdcd-4c42-b630-da4e0a459ac4 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Received unexpected event network-vif-plugged-488eb964-98e4-4e75-ba87-fc1840497377 for instance with vm_state building and task_state spawning.
Nov 13 09:54:34 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:54:34 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:54:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 09:54:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "794c6567-350a-409c-b1e1-2864b75d73c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "794c6567-350a-409c-b1e1-2864b75d73c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:54:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:54:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:54:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Instance spawned successfully.
Nov 13 09:54:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:54:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:34 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:54:34 user nova-compute[74611]: INFO nova.compute.claims [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Claim successful on node user
Nov 13 09:54:34 user nova-compute[74611]: INFO nova.compute.manager [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Took 9.80 seconds to spawn the instance on the hypervisor.
Nov 13 09:54:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:54:35 user nova-compute[74611]: INFO nova.compute.manager [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Took 10.89 seconds to build instance.
Nov 13 09:54:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1ad22c21-f76e-473e-961d-5f6262cae314 tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.041s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Skipping network cache update for instance because it is Building. {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-de46e34d-8ffb-4c22-9735-06191551ede9 req-3ed721bb-64c2-4607-97ed-7e4db5ff9c33 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Received event network-vif-plugged-488eb964-98e4-4e75-ba87-fc1840497377 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-de46e34d-8ffb-4c22-9735-06191551ede9 req-3ed721bb-64c2-4607-97ed-7e4db5ff9c33 service nova] Acquiring lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-de46e34d-8ffb-4c22-9735-06191551ede9 req-3ed721bb-64c2-4607-97ed-7e4db5ff9c33 service nova] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-de46e34d-8ffb-4c22-9735-06191551ede9 req-3ed721bb-64c2-4607-97ed-7e4db5ff9c33 service nova] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-de46e34d-8ffb-4c22-9735-06191551ede9 req-3ed721bb-64c2-4607-97ed-7e4db5ff9c33 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] No waiting events found dispatching network-vif-plugged-488eb964-98e4-4e75-ba87-fc1840497377 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:35 user nova-compute[74611]: WARNING nova.compute.manager [req-de46e34d-8ffb-4c22-9735-06191551ede9 req-3ed721bb-64c2-4607-97ed-7e4db5ff9c33 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Received unexpected event network-vif-plugged-488eb964-98e4-4e75-ba87-fc1840497377 for instance with vm_state active and task_state None.
Nov 13 09:54:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.777s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:54:35 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:54:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:54:35 user nova-compute[74611]: DEBUG nova.policy [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91e7d88000c1476abfb0df6bfca4e0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12e0c04622143f2a0c24258ab90e153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:54:35 user nova-compute[74611]: INFO nova.virt.block_device [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Booting with volume snapshot 2429dc08-ab87-47f2-91e3-3c5979533bc6 at /dev/vda
Nov 13 09:54:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-4e316ab8-eda3-4c59-a28e-d3f8b2a3d176 req-08c4e678-b33c-4479-aa67-7c12736a0872 service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4e316ab8-eda3-4c59-a28e-d3f8b2a3d176 req-08c4e678-b33c-4479-aa67-7c12736a0872 service nova] Acquiring lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4e316ab8-eda3-4c59-a28e-d3f8b2a3d176 req-08c4e678-b33c-4479-aa67-7c12736a0872 service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4e316ab8-eda3-4c59-a28e-d3f8b2a3d176 req-08c4e678-b33c-4479-aa67-7c12736a0872 service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-4e316ab8-eda3-4c59-a28e-d3f8b2a3d176 req-08c4e678-b33c-4479-aa67-7c12736a0872 service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] No waiting events found dispatching network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:36 user nova-compute[74611]: WARNING nova.compute.manager [req-4e316ab8-eda3-4c59-a28e-d3f8b2a3d176 req-08c4e678-b33c-4479-aa67-7c12736a0872 service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received unexpected event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 for instance with vm_state active and task_state None.
Nov 13 09:54:36 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Successfully created port: df64ea8f-f199-43b7-9328-245932527080 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:54:36 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Updating instance_info_cache with network_info: [{"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:36 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 09:54:36 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:54:36 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:54:36 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:54:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:36 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 09:54:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Successfully updated port: df64ea8f-f199-43b7-9328-245932527080 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "refresh_cache-794c6567-350a-409c-b1e1-2864b75d73c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquired lock "refresh_cache-794c6567-350a-409c-b1e1-2864b75d73c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-cb0525ff-92bf-440a-9256-43578e91d519 req-e6a1d232-7193-4cc5-85ac-7eba7027b30a service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Received event network-changed-df64ea8f-f199-43b7-9328-245932527080 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-cb0525ff-92bf-440a-9256-43578e91d519 req-e6a1d232-7193-4cc5-85ac-7eba7027b30a service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Refreshing instance network info cache due to event network-changed-df64ea8f-f199-43b7-9328-245932527080. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cb0525ff-92bf-440a-9256-43578e91d519 req-e6a1d232-7193-4cc5-85ac-7eba7027b30a service nova] Acquiring lock "refresh_cache-794c6567-350a-409c-b1e1-2864b75d73c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Updating instance_info_cache with network_info: [{"id": "df64ea8f-f199-43b7-9328-245932527080", "address": "fa:16:3e:23:b0:8b", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf64ea8f-f1", "ovs_interfaceid": "df64ea8f-f199-43b7-9328-245932527080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Releasing lock "refresh_cache-794c6567-350a-409c-b1e1-2864b75d73c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Instance network_info: |[{"id": "df64ea8f-f199-43b7-9328-245932527080", "address": "fa:16:3e:23:b0:8b", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf64ea8f-f1", "ovs_interfaceid": "df64ea8f-f199-43b7-9328-245932527080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cb0525ff-92bf-440a-9256-43578e91d519 req-e6a1d232-7193-4cc5-85ac-7eba7027b30a service nova] Acquired lock "refresh_cache-794c6567-350a-409c-b1e1-2864b75d73c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG nova.network.neutron [req-cb0525ff-92bf-440a-9256-43578e91d519 req-e6a1d232-7193-4cc5-85ac-7eba7027b30a service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Refreshing network info cache for port df64ea8f-f199-43b7-9328-245932527080 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-6816ae33-4ff0-4481-8366-a6bb0143953f req-e9ad0b0f-0194-4c8a-a086-80273a3285c0 service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6816ae33-4ff0-4481-8366-a6bb0143953f req-e9ad0b0f-0194-4c8a-a086-80273a3285c0 service nova] Acquiring lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6816ae33-4ff0-4481-8366-a6bb0143953f req-e9ad0b0f-0194-4c8a-a086-80273a3285c0 service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6816ae33-4ff0-4481-8366-a6bb0143953f req-e9ad0b0f-0194-4c8a-a086-80273a3285c0 service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-6816ae33-4ff0-4481-8366-a6bb0143953f req-e9ad0b0f-0194-4c8a-a086-80273a3285c0 service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] No waiting events found dispatching network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:38 user nova-compute[74611]: WARNING nova.compute.manager [req-6816ae33-4ff0-4481-8366-a6bb0143953f req-e9ad0b0f-0194-4c8a-a086-80273a3285c0 service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received unexpected event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 for instance with vm_state active and task_state None.
Nov 13 09:54:38 user nova-compute[74611]: DEBUG nova.network.neutron [req-cb0525ff-92bf-440a-9256-43578e91d519 req-e6a1d232-7193-4cc5-85ac-7eba7027b30a service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Updated VIF entry in instance network info cache for port df64ea8f-f199-43b7-9328-245932527080. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:54:38 user nova-compute[74611]: DEBUG nova.network.neutron [req-cb0525ff-92bf-440a-9256-43578e91d519 req-e6a1d232-7193-4cc5-85ac-7eba7027b30a service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Updating instance_info_cache with network_info: [{"id": "df64ea8f-f199-43b7-9328-245932527080", "address": "fa:16:3e:23:b0:8b", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf64ea8f-f1", "ovs_interfaceid": "df64ea8f-f199-43b7-9328-245932527080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cb0525ff-92bf-440a-9256-43578e91d519 req-e6a1d232-7193-4cc5-85ac-7eba7027b30a service nova] Releasing lock "refresh_cache-794c6567-350a-409c-b1e1-2864b75d73c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:40 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:54:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:40 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:54:40 user nova-compute[74611]: INFO nova.compute.claims [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Claim successful on node user
Nov 13 09:54:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:41 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:54:41 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:54:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.748s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:41 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:54:41 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:54:41 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:54:41 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:54:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:41 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:54:41 user nova-compute[74611]: INFO nova.virt.block_device [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Booting with volume 5b94a6b2-ce65-40bc-99b9-1263774b589e at /dev/vda
Nov 13 09:54:41 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:54:41 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:54:41 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=7339MB free_disk=25.741661071777344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 09:54:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:41 user nova-compute[74611]: DEBUG os_brick.utils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:54:41 user nova-compute[74611]: INFO oslo.privsep.daemon [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp408x96o_/privsep.sock']
Nov 13 09:54:41 user sudo[85752]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp408x96o_/privsep.sock
Nov 13 09:54:41 user sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.policy [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d0a21e69a79408f967e27e24e7aca9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3bd8dccd14bab978842976f64310f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG os_brick.utils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance fe53a1a8-de5b-4679-bddb-1da5204dbab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 47f298b4-50b7-4dac-b9ee-a904be6445b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 54fdbd33-6f7c-440b-968b-cd743e2562c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 5b70fc11-140f-4c9a-9e75-2b33705d8c6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance eea01f90-3c79-4304-913e-8cf7e9749480 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 85cb3adb-b2b3-49ec-92ab-c2b7a028241a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 1c66c8a8-abb5-4f60-8464-074627c213d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 794c6567-350a-409c-b1e1-2864b75d73c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing inventories for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating ProviderTree inventory for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating inventory in ProviderTree for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing aggregate associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, aggregates: None {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing trait associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Successfully created port: 0bcd0f90-f88f-45b7-a157-d8a879bbf7dc {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 09:54:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.087s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-21863f33-fbf5-4403-a8c1-1adc9478f470 req-00b7e59a-5b48-4762-abde-be52899434db service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Received event network-vif-plugged-af98cec6-7e77-428e-b0df-8901c45fafe5 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-21863f33-fbf5-4403-a8c1-1adc9478f470 req-00b7e59a-5b48-4762-abde-be52899434db service nova] Acquiring lock "1c66c8a8-abb5-4f60-8464-074627c213d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-21863f33-fbf5-4403-a8c1-1adc9478f470 req-00b7e59a-5b48-4762-abde-be52899434db service nova] Lock "1c66c8a8-abb5-4f60-8464-074627c213d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-21863f33-fbf5-4403-a8c1-1adc9478f470 req-00b7e59a-5b48-4762-abde-be52899434db service nova] Lock "1c66c8a8-abb5-4f60-8464-074627c213d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-21863f33-fbf5-4403-a8c1-1adc9478f470 req-00b7e59a-5b48-4762-abde-be52899434db service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] No waiting events found dispatching network-vif-plugged-af98cec6-7e77-428e-b0df-8901c45fafe5 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:43 user nova-compute[74611]: WARNING nova.compute.manager [req-21863f33-fbf5-4403-a8c1-1adc9478f470 req-00b7e59a-5b48-4762-abde-be52899434db service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Received unexpected event network-vif-plugged-af98cec6-7e77-428e-b0df-8901c45fafe5 for instance with vm_state active and task_state None.
Nov 13 09:54:43 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Successfully created port: 58c272d9-ef57-4958-95e8-baa49c651ab1 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:54:43 user sudo[85752]: pam_unix(sudo:session): session closed for user root
Nov 13 09:54:43 user nova-compute[74611]: INFO oslo.privsep.daemon [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Spawned new privsep daemon via rootwrap
Nov 13 09:54:43 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Successfully created port: 38783fd3-e90d-48ba-a670-41f195ccdfc8 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:54:43 user nova-compute[74611]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 13 09:54:43 user nova-compute[74611]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 13 09:54:43 user nova-compute[74611]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 13 09:54:43 user nova-compute[74611]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85776
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a3f4b2-9650-47f1-8aad-db532f84bcce]: (2,) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:43 user nova-compute[74611]: WARNING oslo_privsep.priv_context [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] privsep daemon already running
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8dd9f7-d7c6-45a1-89e9-8852ca6d5be6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:43 user nova-compute[74611]: WARNING os_brick.initiator.connectors.nvmeof [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef429eaa-38be-4123-9cbf-b672db5aa025]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[756bfc20-89f5-4a5a-a031-b5c115fec42f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9711e85a-b785-4bda-aac3-9a71b8c172ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfff189-2aee-42be-bd12-7fc9376b6e31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2a59ab-f86f-4cf7-b7aa-44d6e0dda088]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e5badd-2ee1-498e-a578-692b4b143f00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b02ef5-cefc-4b61-b316-db2a6af45aac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:54:44 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:54:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eab1234-d664-4b34-b205-7d419ad10626]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG os_brick.utils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] <== get_connector_properties: return (2142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updating existing volume attachment record: 1987f313-c2b2-4f78-9916-f08a181740d8 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:54:44 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:54:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94ae357-8c44-4958-8bd3-afb741ba75d1]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG os_brick.utils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== get_connector_properties: return (2026ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Updating existing volume attachment record: e8e5b9bb-d340-4dc4-bbee-c3e75fa172c0 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:54:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Successfully created port: 08ae2585-56bf-44f5-bf94-d06952b8a60d {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:54:45 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Successfully created port: 24fd98ca-fe56-4410-8409-68f9010bf1ae {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:54:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-9ba54749-f1f6-4cdd-8f53-53a057009c3e req-80399d02-d722-48a3-9236-4f4095205e3d service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Received event network-vif-plugged-af98cec6-7e77-428e-b0df-8901c45fafe5 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9ba54749-f1f6-4cdd-8f53-53a057009c3e req-80399d02-d722-48a3-9236-4f4095205e3d service nova] Acquiring lock "1c66c8a8-abb5-4f60-8464-074627c213d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9ba54749-f1f6-4cdd-8f53-53a057009c3e req-80399d02-d722-48a3-9236-4f4095205e3d service nova] Lock "1c66c8a8-abb5-4f60-8464-074627c213d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9ba54749-f1f6-4cdd-8f53-53a057009c3e req-80399d02-d722-48a3-9236-4f4095205e3d service nova] Lock "1c66c8a8-abb5-4f60-8464-074627c213d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-9ba54749-f1f6-4cdd-8f53-53a057009c3e req-80399d02-d722-48a3-9236-4f4095205e3d service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] No waiting events found dispatching network-vif-plugged-af98cec6-7e77-428e-b0df-8901c45fafe5 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:45 user nova-compute[74611]: WARNING nova.compute.manager [req-9ba54749-f1f6-4cdd-8f53-53a057009c3e req-80399d02-d722-48a3-9236-4f4095205e3d service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Received unexpected event network-vif-plugged-af98cec6-7e77-428e-b0df-8901c45fafe5 for instance with vm_state active and task_state None.
Nov 13 09:54:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:45 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Successfully updated port: 0bcd0f90-f88f-45b7-a157-d8a879bbf7dc {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:54:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-c8048e92-0f75-4024-8d0f-4d22b74a8fb0 req-2f08405c-2253-432e-b1ab-f2be88694df0 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-changed-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-c8048e92-0f75-4024-8d0f-4d22b74a8fb0 req-2f08405c-2253-432e-b1ab-f2be88694df0 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Refreshing instance network info cache due to event network-changed-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:54:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c8048e92-0f75-4024-8d0f-4d22b74a8fb0 req-2f08405c-2253-432e-b1ab-f2be88694df0 service nova] Acquiring lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c8048e92-0f75-4024-8d0f-4d22b74a8fb0 req-2f08405c-2253-432e-b1ab-f2be88694df0 service nova] Acquired lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:45 user nova-compute[74611]: DEBUG nova.network.neutron [req-c8048e92-0f75-4024-8d0f-4d22b74a8fb0 req-2f08405c-2253-432e-b1ab-f2be88694df0 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Refreshing network info cache for port 0bcd0f90-f88f-45b7-a157-d8a879bbf7dc {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:54:45 user nova-compute[74611]: DEBUG nova.network.neutron [req-c8048e92-0f75-4024-8d0f-4d22b74a8fb0 req-2f08405c-2253-432e-b1ab-f2be88694df0 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:54:46 user nova-compute[74611]: DEBUG nova.network.neutron [req-c8048e92-0f75-4024-8d0f-4d22b74a8fb0 req-2f08405c-2253-432e-b1ab-f2be88694df0 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c8048e92-0f75-4024-8d0f-4d22b74a8fb0 req-2f08405c-2253-432e-b1ab-f2be88694df0 service nova] Releasing lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:46 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Successfully updated port: 44a7351c-7369-4cd4-b7b6-5ec7d8691901 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:54:47 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Successfully updated port: 073dacdd-40ea-46ff-8d11-e64a22034430 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:54:47 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Successfully updated port: 58c272d9-ef57-4958-95e8-baa49c651ab1 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:54:47 user nova-compute[74611]: DEBUG nova.compute.manager [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-changed-44a7351c-7369-4cd4-b7b6-5ec7d8691901 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:47 user nova-compute[74611]: DEBUG nova.compute.manager [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Refreshing instance network info cache due to event network-changed-44a7351c-7369-4cd4-b7b6-5ec7d8691901. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:54:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] Acquiring lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] Acquired lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:47 user nova-compute[74611]: DEBUG nova.network.neutron [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Refreshing network info cache for port 44a7351c-7369-4cd4-b7b6-5ec7d8691901 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:54:47 user nova-compute[74611]: DEBUG nova.network.neutron [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:54:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.network.neutron [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] Releasing lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.compute.manager [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-changed-073dacdd-40ea-46ff-8d11-e64a22034430 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.compute.manager [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Refreshing instance network info cache due to event network-changed-073dacdd-40ea-46ff-8d11-e64a22034430. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] Acquiring lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] Acquired lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.network.neutron [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Refreshing network info cache for port 073dacdd-40ea-46ff-8d11-e64a22034430 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.network.neutron [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Successfully updated port: 38783fd3-e90d-48ba-a670-41f195ccdfc8 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.network.neutron [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] Releasing lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.compute.manager [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-changed-58c272d9-ef57-4958-95e8-baa49c651ab1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.compute.manager [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Refreshing instance network info cache due to event network-changed-58c272d9-ef57-4958-95e8-baa49c651ab1. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] Acquiring lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] Acquired lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.network.neutron [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Refreshing network info cache for port 58c272d9-ef57-4958-95e8-baa49c651ab1 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.network.neutron [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:54:48 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Creating image(s)
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Ensure instance console log exists: /opt/stack/data/nova/instances/794c6567-350a-409c-b1e1-2864b75d73c4/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Start _get_guest_xml network_info=[{"id": "df64ea8f-f199-43b7-9328-245932527080", "address": "fa:16:3e:23:b0:8b", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf64ea8f-f1", "ovs_interfaceid": "df64ea8f-f199-43b7-9328-245932527080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'e8e5b9bb-d340-4dc4-bbee-c3e75fa172c0', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLuBlvrS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '794c6567-350a-409c-b1e1-2864b75d73c4', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4139015-dce3-42af-a5f2-c40c54aa314f', 'serial': 'a4139015-dce3-42af-a5f2-c40c54aa314f'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:54:48 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:54:48 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG os_brick.initiator.connector [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Factory for ISCSI on None {{(pid=74611) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLuBlvrS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:54:48 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:54:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:54:48 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:54:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:54:48 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG nova.network.neutron [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[80320f98-c6dc-4faf-8ae9-63b04f14b970]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:54:48 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-db4a4753-2913-4edf-bf44-efe109fbfed0 req-5960345b-cf59-4178-aefb-947e7c71004c service nova] Releasing lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90737d1-2f60-482d-b363-ab89d6a1bda6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f] added
Nov 13 09:54:48 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.122s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[43209ef1-baf6-42ad-9ff0-7f878df6e685]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d442fb-06b9-42ed-a7b3-10ccc643d16d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dLuBlvrS {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dLuBlvrS" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbbf100-90c0-476b-b01c-bdb9066b686b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dLuBlvrS'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be10a9d-38df-493f-a825-211079717e80]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fed053-fe52-4394-864f-66f1e1082981]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 09:54:48 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:54:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 09:54:48 user nova-compute[74611]:  {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:54:48 user nova-compute[74611]: WARNING os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 09:54:48 user nova-compute[74611]: 
Nov 13 09:54:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:49 user nova-compute[74611]: INFO nova.virt.block_device [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Booting with volume b7762389-e6c5-4998-9147-658237a6be3e at /dev/vdb
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b72086-2c8f-42be-b875-03f8534d8893]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f, portal: 172.16.0.220,3260]
Nov 13 09:54:49 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f, portal: 172.16.0.220,3260] successful.
Nov 13 09:54:49 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[267b2918-5ed4-4d74-9d48-96621e8c7138]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG os_brick.utils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4187027-ef48-453b-9e96-e1e29044d1ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33542b4-7da4-47d6-9283-b73eceff955f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:54:49 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:54:49 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.031s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[910f8efb-edb4-4748-92d3-94c3d009b5d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.047s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a138e24-4478-4c0f-a617-2cb228b9184d]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[856871d3-b89c-4906-9c04-1e5f651df455]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLuBlvrS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG nova.compute.manager [req-78a1f260-97ee-43cf-84cd-e3cef636df25 req-09501b08-9954-42fa-9572-1f270e085e3f service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Received event network-vif-plugged-443f1230-01cb-4e7e-8ce7-bc254e125fff {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-78a1f260-97ee-43cf-84cd-e3cef636df25 req-09501b08-9954-42fa-9572-1f270e085e3f service nova] Acquiring lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-78a1f260-97ee-43cf-84cd-e3cef636df25 req-09501b08-9954-42fa-9572-1f270e085e3f service nova] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-78a1f260-97ee-43cf-84cd-e3cef636df25 req-09501b08-9954-42fa-9572-1f270e085e3f service nova] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG nova.compute.manager [req-78a1f260-97ee-43cf-84cd-e3cef636df25 req-09501b08-9954-42fa-9572-1f270e085e3f service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] No waiting events found dispatching network-vif-plugged-443f1230-01cb-4e7e-8ce7-bc254e125fff {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:49 user nova-compute[74611]: WARNING nova.compute.manager [req-78a1f260-97ee-43cf-84cd-e3cef636df25 req-09501b08-9954-42fa-9572-1f270e085e3f service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Received unexpected event network-vif-plugged-443f1230-01cb-4e7e-8ce7-bc254e125fff for instance with vm_state active and task_state None.
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7d17d7-6472-4b31-b2c8-90ccbea65722]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Successfully updated port: 08ae2585-56bf-44f5-bf94-d06952b8a60d {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:54:49 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[81634be2-d0a7-49be-966a-4afd589fe9a5]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG os_brick.utils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] <== get_connector_properties: return (281ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updating existing volume attachment record: 51d928d9-0d38-43f9-88cb-b91056778694 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG nova.compute.manager [req-61ad044b-743a-41ef-8448-186bf42c68d1 req-932392d8-4229-43c3-832d-f2a7a1f0ad1a service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-changed-38783fd3-e90d-48ba-a670-41f195ccdfc8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG nova.compute.manager [req-61ad044b-743a-41ef-8448-186bf42c68d1 req-932392d8-4229-43c3-832d-f2a7a1f0ad1a service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Refreshing instance network info cache due to event network-changed-38783fd3-e90d-48ba-a670-41f195ccdfc8. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-61ad044b-743a-41ef-8448-186bf42c68d1 req-932392d8-4229-43c3-832d-f2a7a1f0ad1a service nova] Acquiring lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-61ad044b-743a-41ef-8448-186bf42c68d1 req-932392d8-4229-43c3-832d-f2a7a1f0ad1a service nova] Acquired lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:49 user nova-compute[74611]: DEBUG nova.network.neutron [req-61ad044b-743a-41ef-8448-186bf42c68d1 req-932392d8-4229-43c3-832d-f2a7a1f0ad1a service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Refreshing network info cache for port 38783fd3-e90d-48ba-a670-41f195ccdfc8 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.network.neutron [req-61ad044b-743a-41ef-8448-186bf42c68d1 req-932392d8-4229-43c3-832d-f2a7a1f0ad1a service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Successfully updated port: 24fd98ca-fe56-4410-8409-68f9010bf1ae {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquiring lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.507s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== connect_volume: return (1508ms) {'type': 'block', 'scsi_wwn': '26539303434636264', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539303434636264', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:54:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-472750337',display_name='tempest-TestVolumeBootPattern-server-472750337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-472750337',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-9fyxhafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:36Z,user_data=None,user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=794c6567-350a-409c-b1e1-2864b75d73c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df64ea8f-f199-43b7-9328-245932527080", "address": "fa:16:3e:23:b0:8b", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf64ea8f-f1", "ovs_interfaceid": "df64ea8f-f199-43b7-9328-245932527080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "df64ea8f-f199-43b7-9328-245932527080", "address": "fa:16:3e:23:b0:8b", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf64ea8f-f1", "ovs_interfaceid": "df64ea8f-f199-43b7-9328-245932527080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=df64ea8f-f199-43b7-9328-245932527080,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf64ea8f-f1') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.objects.instance [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lazy-loading 'pci_devices' on Instance uuid 794c6567-350a-409c-b1e1-2864b75d73c4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:54:50 user nova-compute[74611]:   <uuid>794c6567-350a-409c-b1e1-2864b75d73c4</uuid>
Nov 13 09:54:50 user nova-compute[74611]:   <name>instance-0000000b</name>
Nov 13 09:54:50 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:54:50 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:54:50 user nova-compute[74611]:   <metadata>
Nov 13 09:54:50 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:54:50 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:54:50 user nova-compute[74611]:       <nova:name>tempest-TestVolumeBootPattern-server-472750337</nova:name>
Nov 13 09:54:50 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:54:48</nova:creationTime>
Nov 13 09:54:50 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:54:50 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:54:50 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:54:50 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:54:50 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:54:50 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:54:50 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:54:50 user nova-compute[74611]:       <nova:owner>
Nov 13 09:54:50 user nova-compute[74611]:         <nova:user uuid="91e7d88000c1476abfb0df6bfca4e0fb">tempest-TestVolumeBootPattern-633061604-project-member</nova:user>
Nov 13 09:54:50 user nova-compute[74611]:         <nova:project uuid="f12e0c04622143f2a0c24258ab90e153">tempest-TestVolumeBootPattern-633061604</nova:project>
Nov 13 09:54:50 user nova-compute[74611]:       </nova:owner>
Nov 13 09:54:50 user nova-compute[74611]:       <nova:ports>
Nov 13 09:54:50 user nova-compute[74611]:         <nova:port uuid="df64ea8f-f199-43b7-9328-245932527080">
Nov 13 09:54:50 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 09:54:50 user nova-compute[74611]:         </nova:port>
Nov 13 09:54:50 user nova-compute[74611]:       </nova:ports>
Nov 13 09:54:50 user nova-compute[74611]:     </nova:instance>
Nov 13 09:54:50 user nova-compute[74611]:   </metadata>
Nov 13 09:54:50 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:54:50 user nova-compute[74611]:     <system>
Nov 13 09:54:50 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:54:50 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:54:50 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:54:50 user nova-compute[74611]:       <entry name="serial">794c6567-350a-409c-b1e1-2864b75d73c4</entry>
Nov 13 09:54:50 user nova-compute[74611]:       <entry name="uuid">794c6567-350a-409c-b1e1-2864b75d73c4</entry>
Nov 13 09:54:50 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:54:50 user nova-compute[74611]:     </system>
Nov 13 09:54:50 user nova-compute[74611]:   </sysinfo>
Nov 13 09:54:50 user nova-compute[74611]:   <os>
Nov 13 09:54:50 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:54:50 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:54:50 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:54:50 user nova-compute[74611]:   </os>
Nov 13 09:54:50 user nova-compute[74611]:   <features>
Nov 13 09:54:50 user nova-compute[74611]:     <acpi/>
Nov 13 09:54:50 user nova-compute[74611]:     <apic/>
Nov 13 09:54:50 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:54:50 user nova-compute[74611]:   </features>
Nov 13 09:54:50 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:54:50 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:54:50 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:54:50 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:54:50 user nova-compute[74611]:   </clock>
Nov 13 09:54:50 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:54:50 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:54:50 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:54:50 user nova-compute[74611]:   </cpu>
Nov 13 09:54:50 user nova-compute[74611]:   <devices>
Nov 13 09:54:50 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 09:54:50 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:54:50 user nova-compute[74611]:       <source dev="/dev/sdb"/>
Nov 13 09:54:50 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:54:50 user nova-compute[74611]:       <serial>a4139015-dce3-42af-a5f2-c40c54aa314f</serial>
Nov 13 09:54:50 user nova-compute[74611]:     </disk>
Nov 13 09:54:50 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:54:50 user nova-compute[74611]:       <mac address="fa:16:3e:23:b0:8b"/>
Nov 13 09:54:50 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:54:50 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:54:50 user nova-compute[74611]:       <target dev="tapdf64ea8f-f1"/>
Nov 13 09:54:50 user nova-compute[74611]:     </interface>
Nov 13 09:54:50 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:54:50 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/794c6567-350a-409c-b1e1-2864b75d73c4/console.log" append="off"/>
Nov 13 09:54:50 user nova-compute[74611]:     </serial>
Nov 13 09:54:50 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:54:50 user nova-compute[74611]:     <video>
Nov 13 09:54:50 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:54:50 user nova-compute[74611]:     </video>
Nov 13 09:54:50 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:54:50 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:54:50 user nova-compute[74611]:     </rng>
Nov 13 09:54:50 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:54:50 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:54:50 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:54:50 user nova-compute[74611]:     </memballoon>
Nov 13 09:54:50 user nova-compute[74611]:   </devices>
Nov 13 09:54:50 user nova-compute[74611]: </domain>
Nov 13 09:54:50 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:54:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-472750337',display_name='tempest-TestVolumeBootPattern-server-472750337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-472750337',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-9fyxhafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:36Z,user_data=None,user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=794c6567-350a-409c-b1e1-2864b75d73c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df64ea8f-f199-43b7-9328-245932527080", "address": "fa:16:3e:23:b0:8b", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf64ea8f-f1", "ovs_interfaceid": "df64ea8f-f199-43b7-9328-245932527080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "df64ea8f-f199-43b7-9328-245932527080", "address": "fa:16:3e:23:b0:8b", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf64ea8f-f1", "ovs_interfaceid": "df64ea8f-f199-43b7-9328-245932527080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=df64ea8f-f199-43b7-9328-245932527080,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf64ea8f-f1') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG os_vif [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=df64ea8f-f199-43b7-9328-245932527080,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf64ea8f-f1') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2410f64e-bd1b-5b04-9162-1f6b77e98707', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.network.neutron [req-61ad044b-743a-41ef-8448-186bf42c68d1 req-932392d8-4229-43c3-832d-f2a7a1f0ad1a service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf64ea8f-f1, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf64ea8f-f1, col_values=(('qos', UUID('68e0bb61-4bf1-4338-b5e5-43184534ce96')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf64ea8f-f1, col_values=(('external_ids', {'iface-id': 'df64ea8f-f199-43b7-9328-245932527080', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:b0:8b', 'vm-uuid': '794c6567-350a-409c-b1e1-2864b75d73c4'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-61ad044b-743a-41ef-8448-186bf42c68d1 req-932392d8-4229-43c3-832d-f2a7a1f0ad1a service nova] Releasing lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-61ad044b-743a-41ef-8448-186bf42c68d1 req-932392d8-4229-43c3-832d-f2a7a1f0ad1a service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-changed-08ae2585-56bf-44f5-bf94-d06952b8a60d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-61ad044b-743a-41ef-8448-186bf42c68d1 req-932392d8-4229-43c3-832d-f2a7a1f0ad1a service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Refreshing instance network info cache due to event network-changed-08ae2585-56bf-44f5-bf94-d06952b8a60d. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-61ad044b-743a-41ef-8448-186bf42c68d1 req-932392d8-4229-43c3-832d-f2a7a1f0ad1a service nova] Acquiring lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-61ad044b-743a-41ef-8448-186bf42c68d1 req-932392d8-4229-43c3-832d-f2a7a1f0ad1a service nova] Acquired lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.network.neutron [req-61ad044b-743a-41ef-8448-186bf42c68d1 req-932392d8-4229-43c3-832d-f2a7a1f0ad1a service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Refreshing network info cache for port 08ae2585-56bf-44f5-bf94-d06952b8a60d {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:50 user nova-compute[74611]: INFO os_vif [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=df64ea8f-f199-43b7-9328-245932527080,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf64ea8f-f1')
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] No VIF found with MAC fa:16:3e:23:b0:8b, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.network.neutron [req-61ad044b-743a-41ef-8448-186bf42c68d1 req-932392d8-4229-43c3-832d-f2a7a1f0ad1a service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.network.neutron [req-61ad044b-743a-41ef-8448-186bf42c68d1 req-932392d8-4229-43c3-832d-f2a7a1f0ad1a service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-61ad044b-743a-41ef-8448-186bf42c68d1 req-932392d8-4229-43c3-832d-f2a7a1f0ad1a service nova] Releasing lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquired lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:54:50 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG nova.compute.manager [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Received event network-vif-plugged-443f1230-01cb-4e7e-8ce7-bc254e125fff {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] Acquiring lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG nova.compute.manager [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] No waiting events found dispatching network-vif-plugged-443f1230-01cb-4e7e-8ce7-bc254e125fff {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:51 user nova-compute[74611]: WARNING nova.compute.manager [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Received unexpected event network-vif-plugged-443f1230-01cb-4e7e-8ce7-bc254e125fff for instance with vm_state active and task_state None.
Nov 13 09:54:51 user nova-compute[74611]: DEBUG nova.compute.manager [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Received event network-vif-plugged-c17146c8-a3ec-4289-b41d-751fff2e490f {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] Acquiring lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG nova.compute.manager [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] No waiting events found dispatching network-vif-plugged-c17146c8-a3ec-4289-b41d-751fff2e490f {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:51 user nova-compute[74611]: WARNING nova.compute.manager [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Received unexpected event network-vif-plugged-c17146c8-a3ec-4289-b41d-751fff2e490f for instance with vm_state active and task_state None.
Nov 13 09:54:51 user nova-compute[74611]: DEBUG nova.compute.manager [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Received event network-vif-plugged-c17146c8-a3ec-4289-b41d-751fff2e490f {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] Acquiring lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG nova.compute.manager [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] No waiting events found dispatching network-vif-plugged-c17146c8-a3ec-4289-b41d-751fff2e490f {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:51 user nova-compute[74611]: WARNING nova.compute.manager [req-83b71277-1f6e-4bdf-80ec-06d25b47d55b req-0aa151af-6c30-4f06-a81a-4aa73c1963ae service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Received unexpected event network-vif-plugged-c17146c8-a3ec-4289-b41d-751fff2e490f for instance with vm_state active and task_state None.
Nov 13 09:54:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG nova.compute.manager [req-7e1fe942-acf8-4059-909c-40c9cf2b1406 req-0a495523-42de-4c70-ab26-c620e0eb9da3 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-changed-24fd98ca-fe56-4410-8409-68f9010bf1ae {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG nova.compute.manager [req-7e1fe942-acf8-4059-909c-40c9cf2b1406 req-0a495523-42de-4c70-ab26-c620e0eb9da3 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Refreshing instance network info cache due to event network-changed-24fd98ca-fe56-4410-8409-68f9010bf1ae. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:54:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7e1fe942-acf8-4059-909c-40c9cf2b1406 req-0a495523-42de-4c70-ab26-c620e0eb9da3 service nova] Acquiring lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:54:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:53 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updating instance_info_cache with network_info: [{"id": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "address": "fa:16:3e:43:a0:e7", "network": {"id": "2d22ba1e-7f3f-4914-a55d-505269e73606", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1880946265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bcd0f90-f8", "ovs_interfaceid": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "address": "fa:16:3e:0a:d3:f1", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44a7351c-73", "ovs_interfaceid": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073dacdd-40ea-46ff-8d11-e64a22034430", "address": "fa:16:3e:33:b1:80", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073dacdd-40", "ovs_interfaceid": "073dacdd-40ea-46ff-8d11-e64a22034430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58c272d9-ef57-4958-95e8-baa49c651ab1", "address": "fa:16:3e:95:46:59", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c272d9-ef", "ovs_interfaceid": "58c272d9-ef57-4958-95e8-baa49c651ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "address": "fa:16:3e:42:01:05", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38783fd3-e9", "ovs_interfaceid": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "address": "fa:16:3e:f1:aa:7c", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae2585-56", "ovs_interfaceid": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "address": "fa:16:3e:49:7a:2f", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24fd98ca-fe", "ovs_interfaceid": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Releasing lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:53 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Instance network_info: |[{"id": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "address": "fa:16:3e:43:a0:e7", "network": {"id": "2d22ba1e-7f3f-4914-a55d-505269e73606", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1880946265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bcd0f90-f8", "ovs_interfaceid": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "address": "fa:16:3e:0a:d3:f1", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44a7351c-73", "ovs_interfaceid": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073dacdd-40ea-46ff-8d11-e64a22034430", "address": "fa:16:3e:33:b1:80", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073dacdd-40", "ovs_interfaceid": "073dacdd-40ea-46ff-8d11-e64a22034430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58c272d9-ef57-4958-95e8-baa49c651ab1", "address": "fa:16:3e:95:46:59", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c272d9-ef", "ovs_interfaceid": "58c272d9-ef57-4958-95e8-baa49c651ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "address": "fa:16:3e:42:01:05", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38783fd3-e9", "ovs_interfaceid": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "address": "fa:16:3e:f1:aa:7c", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae2585-56", "ovs_interfaceid": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "address": "fa:16:3e:49:7a:2f", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24fd98ca-fe", "ovs_interfaceid": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:54:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7e1fe942-acf8-4059-909c-40c9cf2b1406 req-0a495523-42de-4c70-ab26-c620e0eb9da3 service nova] Acquired lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:54:53 user nova-compute[74611]: DEBUG nova.network.neutron [req-7e1fe942-acf8-4059-909c-40c9cf2b1406 req-0a495523-42de-4c70-ab26-c620e0eb9da3 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Refreshing network info cache for port 24fd98ca-fe56-4410-8409-68f9010bf1ae {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:54:53 user nova-compute[74611]: DEBUG nova.network.neutron [req-7e1fe942-acf8-4059-909c-40c9cf2b1406 req-0a495523-42de-4c70-ab26-c620e0eb9da3 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updated VIF entry in instance network info cache for port 24fd98ca-fe56-4410-8409-68f9010bf1ae. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:54:53 user nova-compute[74611]: DEBUG nova.network.neutron [req-7e1fe942-acf8-4059-909c-40c9cf2b1406 req-0a495523-42de-4c70-ab26-c620e0eb9da3 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updating instance_info_cache with network_info: [{"id": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "address": "fa:16:3e:43:a0:e7", "network": {"id": "2d22ba1e-7f3f-4914-a55d-505269e73606", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1880946265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bcd0f90-f8", "ovs_interfaceid": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "address": "fa:16:3e:0a:d3:f1", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44a7351c-73", "ovs_interfaceid": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073dacdd-40ea-46ff-8d11-e64a22034430", "address": "fa:16:3e:33:b1:80", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073dacdd-40", "ovs_interfaceid": "073dacdd-40ea-46ff-8d11-e64a22034430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58c272d9-ef57-4958-95e8-baa49c651ab1", "address": "fa:16:3e:95:46:59", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c272d9-ef", "ovs_interfaceid": "58c272d9-ef57-4958-95e8-baa49c651ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "address": "fa:16:3e:42:01:05", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38783fd3-e9", "ovs_interfaceid": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "address": "fa:16:3e:f1:aa:7c", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae2585-56", "ovs_interfaceid": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "address": "fa:16:3e:49:7a:2f", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24fd98ca-fe", "ovs_interfaceid": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:54:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7e1fe942-acf8-4059-909c-40c9cf2b1406 req-0a495523-42de-4c70-ab26-c620e0eb9da3 service nova] Releasing lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-de7f87a7-835f-47b2-8543-50a91164ce03 req-40205fa1-fa20-40ea-bbdf-0926b3220860 service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Received event network-vif-plugged-df64ea8f-f199-43b7-9328-245932527080 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-de7f87a7-835f-47b2-8543-50a91164ce03 req-40205fa1-fa20-40ea-bbdf-0926b3220860 service nova] Acquiring lock "794c6567-350a-409c-b1e1-2864b75d73c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-de7f87a7-835f-47b2-8543-50a91164ce03 req-40205fa1-fa20-40ea-bbdf-0926b3220860 service nova] Lock "794c6567-350a-409c-b1e1-2864b75d73c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-de7f87a7-835f-47b2-8543-50a91164ce03 req-40205fa1-fa20-40ea-bbdf-0926b3220860 service nova] Lock "794c6567-350a-409c-b1e1-2864b75d73c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-de7f87a7-835f-47b2-8543-50a91164ce03 req-40205fa1-fa20-40ea-bbdf-0926b3220860 service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] No waiting events found dispatching network-vif-plugged-df64ea8f-f199-43b7-9328-245932527080 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:54 user nova-compute[74611]: WARNING nova.compute.manager [req-de7f87a7-835f-47b2-8543-50a91164ce03 req-40205fa1-fa20-40ea-bbdf-0926b3220860 service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Received unexpected event network-vif-plugged-df64ea8f-f199-43b7-9328-245932527080 for instance with vm_state building and task_state spawning.
Nov 13 09:54:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-de7f87a7-835f-47b2-8543-50a91164ce03 req-40205fa1-fa20-40ea-bbdf-0926b3220860 service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Received event network-vif-plugged-df64ea8f-f199-43b7-9328-245932527080 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-de7f87a7-835f-47b2-8543-50a91164ce03 req-40205fa1-fa20-40ea-bbdf-0926b3220860 service nova] Acquiring lock "794c6567-350a-409c-b1e1-2864b75d73c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-de7f87a7-835f-47b2-8543-50a91164ce03 req-40205fa1-fa20-40ea-bbdf-0926b3220860 service nova] Lock "794c6567-350a-409c-b1e1-2864b75d73c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-de7f87a7-835f-47b2-8543-50a91164ce03 req-40205fa1-fa20-40ea-bbdf-0926b3220860 service nova] Lock "794c6567-350a-409c-b1e1-2864b75d73c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-de7f87a7-835f-47b2-8543-50a91164ce03 req-40205fa1-fa20-40ea-bbdf-0926b3220860 service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] No waiting events found dispatching network-vif-plugged-df64ea8f-f199-43b7-9328-245932527080 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:54:54 user nova-compute[74611]: WARNING nova.compute.manager [req-de7f87a7-835f-47b2-8543-50a91164ce03 req-40205fa1-fa20-40ea-bbdf-0926b3220860 service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Received unexpected event network-vif-plugged-df64ea8f-f199-43b7-9328-245932527080 for instance with vm_state building and task_state spawning.
Nov 13 09:54:54 user nova-compute[74611]: INFO nova.virt.block_device [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Booting with volume 0c1186c1-b67c-4ca8-9c85-4e95a74840f4 at /dev/vdc
Nov 13 09:54:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:54:54 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Instance spawned successfully.
Nov 13 09:54:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG os_brick.utils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[853501e1-5298-4e96-bdf3-c831e60a7fd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0cab1f-8b77-4afa-ae14-162c34478eb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9e2efa-227d-4276-b607-9a43f1ac3267]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c006371-d6e7-4c9a-931d-b0a0ca1d2c83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:54:54 user nova-compute[74611]: INFO nova.compute.manager [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 13 09:54:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:54:54 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f002fb8c-f606-4e23-b3a4-2942980589ca]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG os_brick.utils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:54:54 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updating existing volume attachment record: e08dfeba-e49e-4606-ad11-db55ef1b62d2 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:54:54 user nova-compute[74611]: INFO nova.compute.manager [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Took 19.64 seconds to build instance.
Nov 13 09:54:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e43f992f-d586-4f30-ac00-0a160b6c4808 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "794c6567-350a-409c-b1e1-2864b75d73c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.818s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:54:58 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Creating image(s)
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Ensure instance console log exists: /opt/stack/data/nova/instances/47f298b4-50b7-4dac-b9ee-a904be6445b9/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Start _get_guest_xml network_info=[{"id": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "address": "fa:16:3e:43:a0:e7", "network": {"id": "2d22ba1e-7f3f-4914-a55d-505269e73606", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1880946265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bcd0f90-f8", "ovs_interfaceid": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "address": "fa:16:3e:0a:d3:f1", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44a7351c-73", "ovs_interfaceid": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073dacdd-40ea-46ff-8d11-e64a22034430", "address": "fa:16:3e:33:b1:80", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073dacdd-40", "ovs_interfaceid": "073dacdd-40ea-46ff-8d11-e64a22034430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58c272d9-ef57-4958-95e8-baa49c651ab1", "address": "fa:16:3e:95:46:59", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c272d9-ef", "ovs_interfaceid": "58c272d9-ef57-4958-95e8-baa49c651ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "address": "fa:16:3e:42:01:05", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38783fd3-e9", "ovs_interfaceid": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "address": "fa:16:3e:f1:aa:7c", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae2585-56", "ovs_interfaceid": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "address": "fa:16:3e:49:7a:2f", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24fd98ca-fe", "ovs_interfaceid": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '1987f313-c2b2-4f78-9916-f08a181740d8', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTbCPZVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '47f298b4-50b7-4dac-b9ee-a904be6445b9', 'attached_at': '', 'detached_at': '', 'volume_id': '5b94a6b2-ce65-40bc-99b9-1263774b589e', 'serial': '5b94a6b2-ce65-40bc-99b9-1263774b589e'}, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'attachment_id': '51d928d9-0d38-43f9-88cb-b91056778694', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsGRiqFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '47f298b4-50b7-4dac-b9ee-a904be6445b9', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7762389-e6c5-4998-9147-658237a6be3e', 'serial': 'b7762389-e6c5-4998-9147-658237a6be3e'}, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'attachment_id': 'e08dfeba-e49e-4606-ad11-db55ef1b62d2', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VcWOGCFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '47f298b4-50b7-4dac-b9ee-a904be6445b9', 'attached_at': '', 'detached_at': '', 'volume_id': '0c1186c1-b67c-4ca8-9c85-4e95a74840f4', 'serial': '0c1186c1-b67c-4ca8-9c85-4e95a74840f4'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:54:58 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:54:58 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTbCPZVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:54:58 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:54:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:54:58 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:54:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:54:58 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f93c89-9825-4daa-98cf-4e468ab1b8b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:54:58 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bd64ee-4724-4287-8aff-3fc327a1d9af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e] added
Nov 13 09:54:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7675ba7-5e5c-421e-b4df-8270c7ac90c5]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[42707fd4-85bf-4e8c-8e5f-fa2c2e6c7cd4]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RTbCPZVx {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RTbCPZVx" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fe095e-41e4-47c5-bd1c-d9012ee6df91]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RTbCPZVx'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5952fd-df9c-459c-85d0-5ed273715374]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb82f26-05de-4557-80b2-bd60ac199f79]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:54:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:54:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[177c1acb-16da-4665-9494-169b34da3941]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e, portal: 172.16.0.220,3260]
Nov 13 09:54:58 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e, portal: 172.16.0.220,3260] successful.
Nov 13 09:54:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:54:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.077s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b50b756-1f6c-46d0-93e3-16825a7b85b8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3e647f-c941-4126-9cc7-6b2a74a189f1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:54:59 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:54:59 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:54:59 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:54:59 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.047s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af52176-8041-4822-ab71-7db32cbca4da]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:54:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTbCPZVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23336653739633236', 'path': '/dev/sdc'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336653739633236', 'path': '/dev/sdc'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsGRiqFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:55:00 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:55:00 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:55:00 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[902fa03a-ec2c-4d2d-bc52-69fbc77cd33d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:55:00 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea69644-042b-4d17-876f-505ff8fda58f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e] added
Nov 13 09:55:00 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[51246d4b-27c5-4e27-8b89-f7dd4dba4e25]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de098c4-2011-47e8-bf28-a4b8421adb31]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsGRiqFU {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsGRiqFU" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3e9e07-a3d7-415c-b188-abee83405d32]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fsGRiqFU'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9d29c7-5f90-44be-8816-b4da8f547721]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c7b475-6e7b-4f51-a198-007c60c1dede]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:55:00 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:55:00 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:55:00 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:55:00 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e514cc1e-003e-4244-8d2a-72f90b1d06f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e, portal: 172.16.0.220,3260]
Nov 13 09:55:00 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e, portal: 172.16.0.220,3260] successful.
Nov 13 09:55:00 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db1301f-72f7-45ad-aa4c-b766cef9b67a]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeba5b0-ebff-4837-8bbd-8d4ae79659c2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:55:00 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:55:00 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:55:00 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:55:00 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:55:00 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:55:00 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[076f11c7-9cc9-4d8b-a54d-7a63fc1df84d]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:55:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsGRiqFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26637626537633964', 'path': '/dev/sdd'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637626537633964', 'path': '/dev/sdd'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VcWOGCFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:55:01 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:55:01 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:55:01 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[439418ac-4aea-4488-801b-2661ccf29288]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:55:01 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf28de98-92c4-40d5-be2b-fc56b675de88]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4] added
Nov 13 09:55:01 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4ce388-7925-4670-8379-10e3466afb58]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dec1238-b858-45d7-a57d-1b61c9536b51]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VcWOGCFf {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VcWOGCFf" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a421085-31fc-41c5-9007-5e16e2f0fa4a]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VcWOGCFf'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[107c0e19-54a5-4552-b428-aa7bd8975c45]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[70519d23-3a2c-4e66-ae43-d2c1c577a639]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:55:01 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:55:01 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:55:01 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:55:01 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:55:01 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:55:01 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34f3df3-9930-458b-95ec-62e373fd5087]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4, portal: 172.16.0.220,3260]
Nov 13 09:55:01 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4, portal: 172.16.0.220,3260] successful.
Nov 13 09:55:01 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[527a2dae-42ee-4e88-80c3-3e7131e737be]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0a7ce2-7f94-4925-af67-3937cfce664f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:55:01 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:55:01 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:55:01 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:55:01 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:55:01 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:55:01 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:55:01 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:55:01 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f651a9ce-bd94-427a-b759-a2dcd5adad9c]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:55:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VcWOGCFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23865636236353163', 'path': '/dev/sde'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865636236353163', 'path': '/dev/sde'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "address": "fa:16:3e:43:a0:e7", "network": {"id": "2d22ba1e-7f3f-4914-a55d-505269e73606", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1880946265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bcd0f90-f8", "ovs_interfaceid": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "address": "fa:16:3e:43:a0:e7", "network": {"id": "2d22ba1e-7f3f-4914-a55d-505269e73606", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1880946265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bcd0f90-f8", "ovs_interfaceid": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:a0:e7,bridge_name='br-int',has_traffic_filtering=True,id=0bcd0f90-f88f-45b7-a157-d8a879bbf7dc,network=Network(2d22ba1e-7f3f-4914-a55d-505269e73606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bcd0f90-f8') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "address": "fa:16:3e:0a:d3:f1", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44a7351c-73", "ovs_interfaceid": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "address": "fa:16:3e:0a:d3:f1", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44a7351c-73", "ovs_interfaceid": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d3:f1,bridge_name='br-int',has_traffic_filtering=True,id=44a7351c-7369-4cd4-b7b6-5ec7d8691901,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44a7351c-73') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "073dacdd-40ea-46ff-8d11-e64a22034430", "address": "fa:16:3e:33:b1:80", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073dacdd-40", "ovs_interfaceid": "073dacdd-40ea-46ff-8d11-e64a22034430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "073dacdd-40ea-46ff-8d11-e64a22034430", "address": "fa:16:3e:33:b1:80", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073dacdd-40", "ovs_interfaceid": "073dacdd-40ea-46ff-8d11-e64a22034430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:b1:80,bridge_name='br-int',has_traffic_filtering=True,id=073dacdd-40ea-46ff-8d11-e64a22034430,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap073dacdd-40') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58c272d9-ef57-4958-95e8-baa49c651ab1", "address": "fa:16:3e:95:46:59", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c272d9-ef", "ovs_interfaceid": "58c272d9-ef57-4958-95e8-baa49c651ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "58c272d9-ef57-4958-95e8-baa49c651ab1", "address": "fa:16:3e:95:46:59", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c272d9-ef", "ovs_interfaceid": "58c272d9-ef57-4958-95e8-baa49c651ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:46:59,bridge_name='br-int',has_traffic_filtering=True,id=58c272d9-ef57-4958-95e8-baa49c651ab1,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c272d9-ef') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "address": "fa:16:3e:42:01:05", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38783fd3-e9", "ovs_interfaceid": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "address": "fa:16:3e:42:01:05", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38783fd3-e9", "ovs_interfaceid": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:01:05,bridge_name='br-int',has_traffic_filtering=True,id=38783fd3-e90d-48ba-a670-41f195ccdfc8,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38783fd3-e9') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "address": "fa:16:3e:f1:aa:7c", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae2585-56", "ovs_interfaceid": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "address": "fa:16:3e:f1:aa:7c", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae2585-56", "ovs_interfaceid": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:aa:7c,bridge_name='br-int',has_traffic_filtering=True,id=08ae2585-56bf-44f5-bf94-d06952b8a60d,network=Network(21f8ed5b-00f0-404f-b533-220e84f88c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ae2585-56') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "address": "fa:16:3e:49:7a:2f", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24fd98ca-fe", "ovs_interfaceid": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "address": "fa:16:3e:49:7a:2f", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24fd98ca-fe", "ovs_interfaceid": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:7a:2f,bridge_name='br-int',has_traffic_filtering=True,id=24fd98ca-fe56-4410-8409-68f9010bf1ae,network=Network(21f8ed5b-00f0-404f-b533-220e84f88c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24fd98ca-fe') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lazy-loading 'pci_devices' on Instance uuid 47f298b4-50b7-4dac-b9ee-a904be6445b9 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:55:02 user nova-compute[74611]:   <uuid>47f298b4-50b7-4dac-b9ee-a904be6445b9</uuid>
Nov 13 09:55:02 user nova-compute[74611]:   <name>instance-0000000c</name>
Nov 13 09:55:02 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:55:02 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:55:02 user nova-compute[74611]:   <metadata>
Nov 13 09:55:02 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:55:02 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:55:02 user nova-compute[74611]:       <nova:name>tempest-device-tagging-server-1854338987</nova:name>
Nov 13 09:55:02 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:54:58</nova:creationTime>
Nov 13 09:55:02 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:55:02 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:55:02 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:55:02 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:55:02 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:55:02 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:55:02 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:55:02 user nova-compute[74611]:       <nova:owner>
Nov 13 09:55:02 user nova-compute[74611]:         <nova:user uuid="8d0a21e69a79408f967e27e24e7aca9d">tempest-TaggedBootDevicesTest-570022671-project-member</nova:user>
Nov 13 09:55:02 user nova-compute[74611]:         <nova:project uuid="2aa3bd8dccd14bab978842976f64310f">tempest-TaggedBootDevicesTest-570022671</nova:project>
Nov 13 09:55:02 user nova-compute[74611]:       </nova:owner>
Nov 13 09:55:02 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:55:02 user nova-compute[74611]:       <nova:ports>
Nov 13 09:55:02 user nova-compute[74611]:         <nova:port uuid="0bcd0f90-f88f-45b7-a157-d8a879bbf7dc">
Nov 13 09:55:02 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 09:55:02 user nova-compute[74611]:         </nova:port>
Nov 13 09:55:02 user nova-compute[74611]:         <nova:port uuid="44a7351c-7369-4cd4-b7b6-5ec7d8691901">
Nov 13 09:55:02 user nova-compute[74611]:           <nova:ip type="fixed" address="10.1.1.79" ipVersion="4"/>
Nov 13 09:55:02 user nova-compute[74611]:         </nova:port>
Nov 13 09:55:02 user nova-compute[74611]:         <nova:port uuid="073dacdd-40ea-46ff-8d11-e64a22034430">
Nov 13 09:55:02 user nova-compute[74611]:           <nova:ip type="fixed" address="10.1.1.120" ipVersion="4"/>
Nov 13 09:55:02 user nova-compute[74611]:         </nova:port>
Nov 13 09:55:02 user nova-compute[74611]:         <nova:port uuid="58c272d9-ef57-4958-95e8-baa49c651ab1">
Nov 13 09:55:02 user nova-compute[74611]:           <nova:ip type="fixed" address="10.1.1.77" ipVersion="4"/>
Nov 13 09:55:02 user nova-compute[74611]:         </nova:port>
Nov 13 09:55:02 user nova-compute[74611]:         <nova:port uuid="38783fd3-e90d-48ba-a670-41f195ccdfc8">
Nov 13 09:55:02 user nova-compute[74611]:           <nova:ip type="fixed" address="10.1.1.37" ipVersion="4"/>
Nov 13 09:55:02 user nova-compute[74611]:         </nova:port>
Nov 13 09:55:02 user nova-compute[74611]:         <nova:port uuid="08ae2585-56bf-44f5-bf94-d06952b8a60d">
Nov 13 09:55:02 user nova-compute[74611]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 13 09:55:02 user nova-compute[74611]:         </nova:port>
Nov 13 09:55:02 user nova-compute[74611]:         <nova:port uuid="24fd98ca-fe56-4410-8409-68f9010bf1ae">
Nov 13 09:55:02 user nova-compute[74611]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 13 09:55:02 user nova-compute[74611]:         </nova:port>
Nov 13 09:55:02 user nova-compute[74611]:       </nova:ports>
Nov 13 09:55:02 user nova-compute[74611]:     </nova:instance>
Nov 13 09:55:02 user nova-compute[74611]:   </metadata>
Nov 13 09:55:02 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:55:02 user nova-compute[74611]:     <system>
Nov 13 09:55:02 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:55:02 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:55:02 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:55:02 user nova-compute[74611]:       <entry name="serial">47f298b4-50b7-4dac-b9ee-a904be6445b9</entry>
Nov 13 09:55:02 user nova-compute[74611]:       <entry name="uuid">47f298b4-50b7-4dac-b9ee-a904be6445b9</entry>
Nov 13 09:55:02 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:55:02 user nova-compute[74611]:     </system>
Nov 13 09:55:02 user nova-compute[74611]:   </sysinfo>
Nov 13 09:55:02 user nova-compute[74611]:   <os>
Nov 13 09:55:02 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:55:02 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:55:02 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:55:02 user nova-compute[74611]:   </os>
Nov 13 09:55:02 user nova-compute[74611]:   <features>
Nov 13 09:55:02 user nova-compute[74611]:     <acpi/>
Nov 13 09:55:02 user nova-compute[74611]:     <apic/>
Nov 13 09:55:02 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:55:02 user nova-compute[74611]:   </features>
Nov 13 09:55:02 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:55:02 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:55:02 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:55:02 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:55:02 user nova-compute[74611]:   </clock>
Nov 13 09:55:02 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:55:02 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:55:02 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:55:02 user nova-compute[74611]:   </cpu>
Nov 13 09:55:02 user nova-compute[74611]:   <devices>
Nov 13 09:55:02 user nova-compute[74611]:     <disk type="file" device="cdrom">
Nov 13 09:55:02 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 09:55:02 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/47f298b4-50b7-4dac-b9ee-a904be6445b9/disk.config"/>
Nov 13 09:55:02 user nova-compute[74611]:       <target dev="hda" bus="ide"/>
Nov 13 09:55:02 user nova-compute[74611]:     </disk>
Nov 13 09:55:02 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 09:55:02 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:55:02 user nova-compute[74611]:       <source dev="/dev/sdc"/>
Nov 13 09:55:02 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:55:02 user nova-compute[74611]:       <serial>5b94a6b2-ce65-40bc-99b9-1263774b589e</serial>
Nov 13 09:55:02 user nova-compute[74611]:     </disk>
Nov 13 09:55:02 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 09:55:02 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:55:02 user nova-compute[74611]:       <source dev="/dev/sdd"/>
Nov 13 09:55:02 user nova-compute[74611]:       <target dev="vdb" bus="virtio"/>
Nov 13 09:55:02 user nova-compute[74611]:       <serial>b7762389-e6c5-4998-9147-658237a6be3e</serial>
Nov 13 09:55:02 user nova-compute[74611]:     </disk>
Nov 13 09:55:02 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 09:55:02 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:55:02 user nova-compute[74611]:       <source dev="/dev/sde"/>
Nov 13 09:55:02 user nova-compute[74611]:       <target dev="vdc" bus="virtio"/>
Nov 13 09:55:02 user nova-compute[74611]:       <serial>0c1186c1-b67c-4ca8-9c85-4e95a74840f4</serial>
Nov 13 09:55:02 user nova-compute[74611]:     </disk>
Nov 13 09:55:02 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:55:02 user nova-compute[74611]:       <mac address="fa:16:3e:43:a0:e7"/>
Nov 13 09:55:02 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:55:02 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:55:02 user nova-compute[74611]:       <target dev="tap0bcd0f90-f8"/>
Nov 13 09:55:02 user nova-compute[74611]:     </interface>
Nov 13 09:55:02 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:55:02 user nova-compute[74611]:       <mac address="fa:16:3e:0a:d3:f1"/>
Nov 13 09:55:02 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:55:02 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:55:02 user nova-compute[74611]:       <target dev="tap44a7351c-73"/>
Nov 13 09:55:02 user nova-compute[74611]:     </interface>
Nov 13 09:55:02 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:55:02 user nova-compute[74611]:       <mac address="fa:16:3e:33:b1:80"/>
Nov 13 09:55:02 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:55:02 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:55:02 user nova-compute[74611]:       <target dev="tap073dacdd-40"/>
Nov 13 09:55:02 user nova-compute[74611]:     </interface>
Nov 13 09:55:02 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:55:02 user nova-compute[74611]:       <mac address="fa:16:3e:95:46:59"/>
Nov 13 09:55:02 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:55:02 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:55:02 user nova-compute[74611]:       <target dev="tap58c272d9-ef"/>
Nov 13 09:55:02 user nova-compute[74611]:     </interface>
Nov 13 09:55:02 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:55:02 user nova-compute[74611]:       <mac address="fa:16:3e:42:01:05"/>
Nov 13 09:55:02 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:55:02 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:55:02 user nova-compute[74611]:       <target dev="tap38783fd3-e9"/>
Nov 13 09:55:02 user nova-compute[74611]:     </interface>
Nov 13 09:55:02 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:55:02 user nova-compute[74611]:       <mac address="fa:16:3e:f1:aa:7c"/>
Nov 13 09:55:02 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:55:02 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:55:02 user nova-compute[74611]:       <target dev="tap08ae2585-56"/>
Nov 13 09:55:02 user nova-compute[74611]:     </interface>
Nov 13 09:55:02 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:55:02 user nova-compute[74611]:       <mac address="fa:16:3e:49:7a:2f"/>
Nov 13 09:55:02 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:55:02 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:55:02 user nova-compute[74611]:       <target dev="tap24fd98ca-fe"/>
Nov 13 09:55:02 user nova-compute[74611]:     </interface>
Nov 13 09:55:02 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:55:02 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/47f298b4-50b7-4dac-b9ee-a904be6445b9/console.log" append="off"/>
Nov 13 09:55:02 user nova-compute[74611]:     </serial>
Nov 13 09:55:02 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:55:02 user nova-compute[74611]:     <video>
Nov 13 09:55:02 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:55:02 user nova-compute[74611]:     </video>
Nov 13 09:55:02 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:55:02 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:55:02 user nova-compute[74611]:     </rng>
Nov 13 09:55:02 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:55:02 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:55:02 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:55:02 user nova-compute[74611]:     </memballoon>
Nov 13 09:55:02 user nova-compute[74611]:   </devices>
Nov 13 09:55:02 user nova-compute[74611]: </domain>
Nov 13 09:55:02 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "address": "fa:16:3e:43:a0:e7", "network": {"id": "2d22ba1e-7f3f-4914-a55d-505269e73606", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1880946265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bcd0f90-f8", "ovs_interfaceid": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "address": "fa:16:3e:43:a0:e7", "network": {"id": "2d22ba1e-7f3f-4914-a55d-505269e73606", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1880946265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bcd0f90-f8", "ovs_interfaceid": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:a0:e7,bridge_name='br-int',has_traffic_filtering=True,id=0bcd0f90-f88f-45b7-a157-d8a879bbf7dc,network=Network(2d22ba1e-7f3f-4914-a55d-505269e73606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bcd0f90-f8') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG os_vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:a0:e7,bridge_name='br-int',has_traffic_filtering=True,id=0bcd0f90-f88f-45b7-a157-d8a879bbf7dc,network=Network(2d22ba1e-7f3f-4914-a55d-505269e73606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bcd0f90-f8') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9130ff7-3637-5c9d-8b2d-2cff566feee7', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bcd0f90-f8, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bcd0f90-f8, col_values=(('qos', UUID('a3627931-aeee-4183-9ecd-22a61f6e87ed')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bcd0f90-f8, col_values=(('external_ids', {'iface-id': '0bcd0f90-f88f-45b7-a157-d8a879bbf7dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:a0:e7', 'vm-uuid': '47f298b4-50b7-4dac-b9ee-a904be6445b9'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:02 user nova-compute[74611]: INFO os_vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:a0:e7,bridge_name='br-int',has_traffic_filtering=True,id=0bcd0f90-f88f-45b7-a157-d8a879bbf7dc,network=Network(2d22ba1e-7f3f-4914-a55d-505269e73606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bcd0f90-f8')
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "address": "fa:16:3e:0a:d3:f1", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44a7351c-73", "ovs_interfaceid": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "address": "fa:16:3e:0a:d3:f1", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44a7351c-73", "ovs_interfaceid": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d3:f1,bridge_name='br-int',has_traffic_filtering=True,id=44a7351c-7369-4cd4-b7b6-5ec7d8691901,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44a7351c-73') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG os_vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d3:f1,bridge_name='br-int',has_traffic_filtering=True,id=44a7351c-7369-4cd4-b7b6-5ec7d8691901,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44a7351c-73') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '790f06c9-eeff-5227-b687-f5ff8beb5db2', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44a7351c-73, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44a7351c-73, col_values=(('qos', UUID('ef1a0f80-1072-4379-a1eb-e6698cdeccb4')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44a7351c-73, col_values=(('external_ids', {'iface-id': '44a7351c-7369-4cd4-b7b6-5ec7d8691901', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:d3:f1', 'vm-uuid': '47f298b4-50b7-4dac-b9ee-a904be6445b9'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: INFO os_vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d3:f1,bridge_name='br-int',has_traffic_filtering=True,id=44a7351c-7369-4cd4-b7b6-5ec7d8691901,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44a7351c-73')
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "073dacdd-40ea-46ff-8d11-e64a22034430", "address": "fa:16:3e:33:b1:80", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073dacdd-40", "ovs_interfaceid": "073dacdd-40ea-46ff-8d11-e64a22034430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "073dacdd-40ea-46ff-8d11-e64a22034430", "address": "fa:16:3e:33:b1:80", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073dacdd-40", "ovs_interfaceid": "073dacdd-40ea-46ff-8d11-e64a22034430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:b1:80,bridge_name='br-int',has_traffic_filtering=True,id=073dacdd-40ea-46ff-8d11-e64a22034430,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap073dacdd-40') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG os_vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:b1:80,bridge_name='br-int',has_traffic_filtering=True,id=073dacdd-40ea-46ff-8d11-e64a22034430,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap073dacdd-40') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd17a8922-8356-5227-8ec8-26e1c19d41bd', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap073dacdd-40, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap073dacdd-40, col_values=(('qos', UUID('44bfab72-b1bc-40d9-829e-4771b24cadec')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap073dacdd-40, col_values=(('external_ids', {'iface-id': '073dacdd-40ea-46ff-8d11-e64a22034430', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:b1:80', 'vm-uuid': '47f298b4-50b7-4dac-b9ee-a904be6445b9'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: INFO os_vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:b1:80,bridge_name='br-int',has_traffic_filtering=True,id=073dacdd-40ea-46ff-8d11-e64a22034430,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap073dacdd-40')
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58c272d9-ef57-4958-95e8-baa49c651ab1", "address": "fa:16:3e:95:46:59", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c272d9-ef", "ovs_interfaceid": "58c272d9-ef57-4958-95e8-baa49c651ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "58c272d9-ef57-4958-95e8-baa49c651ab1", "address": "fa:16:3e:95:46:59", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c272d9-ef", "ovs_interfaceid": "58c272d9-ef57-4958-95e8-baa49c651ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:46:59,bridge_name='br-int',has_traffic_filtering=True,id=58c272d9-ef57-4958-95e8-baa49c651ab1,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c272d9-ef') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG os_vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:46:59,bridge_name='br-int',has_traffic_filtering=True,id=58c272d9-ef57-4958-95e8-baa49c651ab1,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c272d9-ef') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2945d59f-a00e-525c-ac8d-f2bf072622f7', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58c272d9-ef, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58c272d9-ef, col_values=(('qos', UUID('c2a36f76-4480-4c77-b8cd-3bfa6ba44681')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58c272d9-ef, col_values=(('external_ids', {'iface-id': '58c272d9-ef57-4958-95e8-baa49c651ab1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:46:59', 'vm-uuid': '47f298b4-50b7-4dac-b9ee-a904be6445b9'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: INFO os_vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:46:59,bridge_name='br-int',has_traffic_filtering=True,id=58c272d9-ef57-4958-95e8-baa49c651ab1,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c272d9-ef')
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "address": "fa:16:3e:42:01:05", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38783fd3-e9", "ovs_interfaceid": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "address": "fa:16:3e:42:01:05", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38783fd3-e9", "ovs_interfaceid": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:01:05,bridge_name='br-int',has_traffic_filtering=True,id=38783fd3-e90d-48ba-a670-41f195ccdfc8,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38783fd3-e9') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG os_vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:01:05,bridge_name='br-int',has_traffic_filtering=True,id=38783fd3-e90d-48ba-a670-41f195ccdfc8,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38783fd3-e9') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50b4a610-027f-5bac-a2a0-dc9dd2798fc4', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38783fd3-e9, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38783fd3-e9, col_values=(('qos', UUID('52caae5b-5672-4584-93bd-cb06391664fb')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38783fd3-e9, col_values=(('external_ids', {'iface-id': '38783fd3-e90d-48ba-a670-41f195ccdfc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:01:05', 'vm-uuid': '47f298b4-50b7-4dac-b9ee-a904be6445b9'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: INFO os_vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:01:05,bridge_name='br-int',has_traffic_filtering=True,id=38783fd3-e90d-48ba-a670-41f195ccdfc8,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38783fd3-e9')
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "address": "fa:16:3e:f1:aa:7c", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae2585-56", "ovs_interfaceid": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "address": "fa:16:3e:f1:aa:7c", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae2585-56", "ovs_interfaceid": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:aa:7c,bridge_name='br-int',has_traffic_filtering=True,id=08ae2585-56bf-44f5-bf94-d06952b8a60d,network=Network(21f8ed5b-00f0-404f-b533-220e84f88c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ae2585-56') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG os_vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:aa:7c,bridge_name='br-int',has_traffic_filtering=True,id=08ae2585-56bf-44f5-bf94-d06952b8a60d,network=Network(21f8ed5b-00f0-404f-b533-220e84f88c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ae2585-56') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a554556-188f-5726-bf5e-14950bbe2c0d', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08ae2585-56, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08ae2585-56, col_values=(('qos', UUID('397e490d-4e4f-40f5-90d7-3953b206dfc5')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08ae2585-56, col_values=(('external_ids', {'iface-id': '08ae2585-56bf-44f5-bf94-d06952b8a60d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:aa:7c', 'vm-uuid': '47f298b4-50b7-4dac-b9ee-a904be6445b9'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: INFO os_vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:aa:7c,bridge_name='br-int',has_traffic_filtering=True,id=08ae2585-56bf-44f5-bf94-d06952b8a60d,network=Network(21f8ed5b-00f0-404f-b533-220e84f88c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ae2585-56')
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "address": "fa:16:3e:49:7a:2f", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24fd98ca-fe", "ovs_interfaceid": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "address": "fa:16:3e:49:7a:2f", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24fd98ca-fe", "ovs_interfaceid": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:7a:2f,bridge_name='br-int',has_traffic_filtering=True,id=24fd98ca-fe56-4410-8409-68f9010bf1ae,network=Network(21f8ed5b-00f0-404f-b533-220e84f88c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24fd98ca-fe') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG os_vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:7a:2f,bridge_name='br-int',has_traffic_filtering=True,id=24fd98ca-fe56-4410-8409-68f9010bf1ae,network=Network(21f8ed5b-00f0-404f-b533-220e84f88c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24fd98ca-fe') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92602887-057e-5b19-af14-8ccb7f1afee9', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24fd98ca-fe, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24fd98ca-fe, col_values=(('qos', UUID('ea5cc7fa-c6e9-43e8-ac6c-61885d3e2307')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24fd98ca-fe, col_values=(('external_ids', {'iface-id': '24fd98ca-fe56-4410-8409-68f9010bf1ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:7a:2f', 'vm-uuid': '47f298b4-50b7-4dac-b9ee-a904be6445b9'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:03 user nova-compute[74611]: INFO os_vif [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:7a:2f,bridge_name='br-int',has_traffic_filtering=True,id=24fd98ca-fe56-4410-8409-68f9010bf1ae,network=Network(21f8ed5b-00f0-404f-b533-220e84f88c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24fd98ca-fe')
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] No BDM found with device name hda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] No VIF found with MAC fa:16:3e:43:a0:e7, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] No VIF found with MAC fa:16:3e:42:01:05, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:55:03 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Using config drive
Nov 13 09:55:03 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Creating config drive at /opt/stack/data/nova/instances/47f298b4-50b7-4dac-b9ee-a904be6445b9/disk.config
Nov 13 09:55:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/47f298b4-50b7-4dac-b9ee-a904be6445b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjjylbibo {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/47f298b4-50b7-4dac-b9ee-a904be6445b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjjylbibo" returned: 0 in 0.095s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-1eae5c21-a730-477e-89d8-00b6438f292c req-20bd7c9f-2264-4324-aa7a-500b267f495b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1eae5c21-a730-477e-89d8-00b6438f292c req-20bd7c9f-2264-4324-aa7a-500b267f495b service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1eae5c21-a730-477e-89d8-00b6438f292c req-20bd7c9f-2264-4324-aa7a-500b267f495b service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1eae5c21-a730-477e-89d8-00b6438f292c req-20bd7c9f-2264-4324-aa7a-500b267f495b service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-1eae5c21-a730-477e-89d8-00b6438f292c req-20bd7c9f-2264-4324-aa7a-500b267f495b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:05 user nova-compute[74611]: WARNING nova.compute.manager [req-1eae5c21-a730-477e-89d8-00b6438f292c req-20bd7c9f-2264-4324-aa7a-500b267f495b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc for instance with vm_state building and task_state spawning.
Nov 13 09:55:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:06 user nova-compute[74611]: DEBUG nova.compute.manager [req-07fd1406-1c00-4e44-b081-dc763f2ff727 req-83b3a8b2-0b74-410d-9cd5-82a86a7e1081 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-073dacdd-40ea-46ff-8d11-e64a22034430 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-07fd1406-1c00-4e44-b081-dc763f2ff727 req-83b3a8b2-0b74-410d-9cd5-82a86a7e1081 service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-07fd1406-1c00-4e44-b081-dc763f2ff727 req-83b3a8b2-0b74-410d-9cd5-82a86a7e1081 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-07fd1406-1c00-4e44-b081-dc763f2ff727 req-83b3a8b2-0b74-410d-9cd5-82a86a7e1081 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:06 user nova-compute[74611]: DEBUG nova.compute.manager [req-07fd1406-1c00-4e44-b081-dc763f2ff727 req-83b3a8b2-0b74-410d-9cd5-82a86a7e1081 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-073dacdd-40ea-46ff-8d11-e64a22034430 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:06 user nova-compute[74611]: WARNING nova.compute.manager [req-07fd1406-1c00-4e44-b081-dc763f2ff727 req-83b3a8b2-0b74-410d-9cd5-82a86a7e1081 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-073dacdd-40ea-46ff-8d11-e64a22034430 for instance with vm_state building and task_state spawning.
Nov 13 09:55:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-fb2567c3-7c8b-4a94-ac3e-4d92361693fd req-39a04ecc-ef70-4c92-8210-d6a5e1348e0d service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-08ae2585-56bf-44f5-bf94-d06952b8a60d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fb2567c3-7c8b-4a94-ac3e-4d92361693fd req-39a04ecc-ef70-4c92-8210-d6a5e1348e0d service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fb2567c3-7c8b-4a94-ac3e-4d92361693fd req-39a04ecc-ef70-4c92-8210-d6a5e1348e0d service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fb2567c3-7c8b-4a94-ac3e-4d92361693fd req-39a04ecc-ef70-4c92-8210-d6a5e1348e0d service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-fb2567c3-7c8b-4a94-ac3e-4d92361693fd req-39a04ecc-ef70-4c92-8210-d6a5e1348e0d service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-08ae2585-56bf-44f5-bf94-d06952b8a60d {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:07 user nova-compute[74611]: WARNING nova.compute.manager [req-fb2567c3-7c8b-4a94-ac3e-4d92361693fd req-39a04ecc-ef70-4c92-8210-d6a5e1348e0d service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-08ae2585-56bf-44f5-bf94-d06952b8a60d for instance with vm_state building and task_state spawning.
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:08 user nova-compute[74611]: WARNING nova.compute.manager [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc for instance with vm_state building and task_state spawning.
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-44a7351c-7369-4cd4-b7b6-5ec7d8691901 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-44a7351c-7369-4cd4-b7b6-5ec7d8691901 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:08 user nova-compute[74611]: WARNING nova.compute.manager [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-44a7351c-7369-4cd4-b7b6-5ec7d8691901 for instance with vm_state building and task_state spawning.
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-44a7351c-7369-4cd4-b7b6-5ec7d8691901 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-44a7351c-7369-4cd4-b7b6-5ec7d8691901 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:08 user nova-compute[74611]: WARNING nova.compute.manager [req-c9e664ed-43ef-421c-9f40-e9b7386d0e2e req-fa448c8a-7962-40b4-acc9-5a3065cf2643 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-44a7351c-7369-4cd4-b7b6-5ec7d8691901 for instance with vm_state building and task_state spawning.
Nov 13 09:55:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-073dacdd-40ea-46ff-8d11-e64a22034430 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-073dacdd-40ea-46ff-8d11-e64a22034430 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:08 user nova-compute[74611]: WARNING nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-073dacdd-40ea-46ff-8d11-e64a22034430 for instance with vm_state building and task_state spawning.
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-58c272d9-ef57-4958-95e8-baa49c651ab1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-58c272d9-ef57-4958-95e8-baa49c651ab1 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:08 user nova-compute[74611]: WARNING nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-58c272d9-ef57-4958-95e8-baa49c651ab1 for instance with vm_state building and task_state spawning.
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-58c272d9-ef57-4958-95e8-baa49c651ab1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-58c272d9-ef57-4958-95e8-baa49c651ab1 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:08 user nova-compute[74611]: WARNING nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-58c272d9-ef57-4958-95e8-baa49c651ab1 for instance with vm_state building and task_state spawning.
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-38783fd3-e90d-48ba-a670-41f195ccdfc8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-38783fd3-e90d-48ba-a670-41f195ccdfc8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:08 user nova-compute[74611]: WARNING nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-38783fd3-e90d-48ba-a670-41f195ccdfc8 for instance with vm_state building and task_state spawning.
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-38783fd3-e90d-48ba-a670-41f195ccdfc8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-38783fd3-e90d-48ba-a670-41f195ccdfc8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:08 user nova-compute[74611]: WARNING nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-38783fd3-e90d-48ba-a670-41f195ccdfc8 for instance with vm_state building and task_state spawning.
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-24fd98ca-fe56-4410-8409-68f9010bf1ae {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-24fd98ca-fe56-4410-8409-68f9010bf1ae {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:08 user nova-compute[74611]: WARNING nova.compute.manager [req-c971d64f-73b8-4bc3-b18c-f5ca63a4b5e1 req-1ee8743f-ff9c-4132-817a-2e7e855a6d1e service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-24fd98ca-fe56-4410-8409-68f9010bf1ae for instance with vm_state building and task_state spawning.
Nov 13 09:55:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:09 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:55:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:55:09 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Instance spawned successfully.
Nov 13 09:55:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:55:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:09 user nova-compute[74611]: DEBUG nova.compute.manager [req-336ddd7b-a0ed-4eac-aa8e-cdadba2d1ba4 req-a264038b-fac0-47fc-ab86-a3c43e89847c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-08ae2585-56bf-44f5-bf94-d06952b8a60d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-336ddd7b-a0ed-4eac-aa8e-cdadba2d1ba4 req-a264038b-fac0-47fc-ab86-a3c43e89847c service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-336ddd7b-a0ed-4eac-aa8e-cdadba2d1ba4 req-a264038b-fac0-47fc-ab86-a3c43e89847c service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-336ddd7b-a0ed-4eac-aa8e-cdadba2d1ba4 req-a264038b-fac0-47fc-ab86-a3c43e89847c service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:09 user nova-compute[74611]: DEBUG nova.compute.manager [req-336ddd7b-a0ed-4eac-aa8e-cdadba2d1ba4 req-a264038b-fac0-47fc-ab86-a3c43e89847c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-08ae2585-56bf-44f5-bf94-d06952b8a60d {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:09 user nova-compute[74611]: WARNING nova.compute.manager [req-336ddd7b-a0ed-4eac-aa8e-cdadba2d1ba4 req-a264038b-fac0-47fc-ab86-a3c43e89847c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-08ae2585-56bf-44f5-bf94-d06952b8a60d for instance with vm_state building and task_state spawning.
Nov 13 09:55:10 user nova-compute[74611]: INFO nova.compute.manager [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Took 11.37 seconds to spawn the instance on the hypervisor.
Nov 13 09:55:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:55:10 user nova-compute[74611]: INFO nova.compute.manager [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Took 29.82 seconds to build instance.
Nov 13 09:55:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6340c68c-ae57-4b08-9d03-dd31ff6ef0b1 tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.925s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:10 user nova-compute[74611]: DEBUG nova.compute.manager [req-89024466-1505-4fe9-8a6b-683999c3dde4 req-bae31680-09e4-4528-a6ba-7affbfa4f355 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-24fd98ca-fe56-4410-8409-68f9010bf1ae {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-89024466-1505-4fe9-8a6b-683999c3dde4 req-bae31680-09e4-4528-a6ba-7affbfa4f355 service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-89024466-1505-4fe9-8a6b-683999c3dde4 req-bae31680-09e4-4528-a6ba-7affbfa4f355 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-89024466-1505-4fe9-8a6b-683999c3dde4 req-bae31680-09e4-4528-a6ba-7affbfa4f355 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:10 user nova-compute[74611]: DEBUG nova.compute.manager [req-89024466-1505-4fe9-8a6b-683999c3dde4 req-bae31680-09e4-4528-a6ba-7affbfa4f355 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-24fd98ca-fe56-4410-8409-68f9010bf1ae {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:10 user nova-compute[74611]: WARNING nova.compute.manager [req-89024466-1505-4fe9-8a6b-683999c3dde4 req-bae31680-09e4-4528-a6ba-7affbfa4f355 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-24fd98ca-fe56-4410-8409-68f9010bf1ae for instance with vm_state active and task_state None.
Nov 13 09:55:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "89038547-5416-4942-8070-dd5dd8e4b6c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:18 user nova-compute[74611]: DEBUG nova.compute.manager [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:55:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:18 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:55:18 user nova-compute[74611]: INFO nova.compute.claims [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Claim successful on node user
Nov 13 09:55:18 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG nova.compute.manager [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG nova.compute.manager [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG nova.network.neutron [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:55:19 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:55:19 user nova-compute[74611]: DEBUG nova.compute.manager [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG nova.policy [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43cba8f20865492e8f1c169e2b2b706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff71e8694b6414d9df6bc665eb0a9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG nova.compute.manager [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:55:19 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Creating image(s)
Nov 13 09:55:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "/opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "/opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "/opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.345s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.192s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG nova.network.neutron [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Successfully created port: b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk 1073741824" returned: 0 in 0.054s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Cannot resize image /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Ensure instance console log exists: /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.network.neutron [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Successfully updated port: b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "refresh_cache-89038547-5416-4942-8070-dd5dd8e4b6c2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquired lock "refresh_cache-89038547-5416-4942-8070-dd5dd8e4b6c2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.network.neutron [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-079d7ef1-e598-4dd2-8d97-64a3075c78cd req-30bae655-e3d5-425d-9925-ae20eb83b9c6 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Received event network-changed-b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-079d7ef1-e598-4dd2-8d97-64a3075c78cd req-30bae655-e3d5-425d-9925-ae20eb83b9c6 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Refreshing instance network info cache due to event network-changed-b7d65c35-0bb4-49fc-886d-4f9606372e9a. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-079d7ef1-e598-4dd2-8d97-64a3075c78cd req-30bae655-e3d5-425d-9925-ae20eb83b9c6 service nova] Acquiring lock "refresh_cache-89038547-5416-4942-8070-dd5dd8e4b6c2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.network.neutron [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.network.neutron [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Updating instance_info_cache with network_info: [{"id": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "address": "fa:16:3e:78:67:ad", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d65c35-0b", "ovs_interfaceid": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Releasing lock "refresh_cache-89038547-5416-4942-8070-dd5dd8e4b6c2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.compute.manager [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Instance network_info: |[{"id": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "address": "fa:16:3e:78:67:ad", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d65c35-0b", "ovs_interfaceid": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-079d7ef1-e598-4dd2-8d97-64a3075c78cd req-30bae655-e3d5-425d-9925-ae20eb83b9c6 service nova] Acquired lock "refresh_cache-89038547-5416-4942-8070-dd5dd8e4b6c2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.network.neutron [req-079d7ef1-e598-4dd2-8d97-64a3075c78cd req-30bae655-e3d5-425d-9925-ae20eb83b9c6 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Refreshing network info cache for port b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Start _get_guest_xml network_info=[{"id": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "address": "fa:16:3e:78:67:ad", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d65c35-0b", "ovs_interfaceid": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:55:20 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:55:20 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1632814246',display_name='tempest-TestStampPattern-server-1632814246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1632814246',id=13,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7yEcTGCYgYQQ15n06GslTPAn66P3BsID6l5qVrR50yqGTIakIpEEZW+YrSNkhKYZHWTi4IFmCBW3J1HXYI+Mzp3JImjkhJzXOkCMzv7+aS8nhc5OnaYd9h98IBbTgI6g==',key_name='tempest-TestStampPattern-296911042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ff71e8694b6414d9df6bc665eb0a9b9',ramdisk_id='',reservation_id='r-k79l0y3m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-833358871',owner_user_name='tempest-TestStampPattern-833358871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:55:19Z,user_data=None,user_id='43cba8f20865492e8f1c169e2b2b706c',uuid=89038547-5416-4942-8070-dd5dd8e4b6c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "address": "fa:16:3e:78:67:ad", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d65c35-0b", "ovs_interfaceid": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Converting VIF {"id": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "address": "fa:16:3e:78:67:ad", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d65c35-0b", "ovs_interfaceid": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:67:ad,bridge_name='br-int',has_traffic_filtering=True,id=b7d65c35-0bb4-49fc-886d-4f9606372e9a,network=Network(b8196669-7bef-4c06-b6bb-a32fabaec23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d65c35-0b') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.objects.instance [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lazy-loading 'pci_devices' on Instance uuid 89038547-5416-4942-8070-dd5dd8e4b6c2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:55:20 user nova-compute[74611]:   <uuid>89038547-5416-4942-8070-dd5dd8e4b6c2</uuid>
Nov 13 09:55:20 user nova-compute[74611]:   <name>instance-0000000d</name>
Nov 13 09:55:20 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:55:20 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:55:20 user nova-compute[74611]:   <metadata>
Nov 13 09:55:20 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:55:20 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:55:20 user nova-compute[74611]:       <nova:name>tempest-TestStampPattern-server-1632814246</nova:name>
Nov 13 09:55:20 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:55:20</nova:creationTime>
Nov 13 09:55:20 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:55:20 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:55:20 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:55:20 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:55:20 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:55:20 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:55:20 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:55:20 user nova-compute[74611]:       <nova:owner>
Nov 13 09:55:20 user nova-compute[74611]:         <nova:user uuid="43cba8f20865492e8f1c169e2b2b706c">tempest-TestStampPattern-833358871-project-member</nova:user>
Nov 13 09:55:20 user nova-compute[74611]:         <nova:project uuid="3ff71e8694b6414d9df6bc665eb0a9b9">tempest-TestStampPattern-833358871</nova:project>
Nov 13 09:55:20 user nova-compute[74611]:       </nova:owner>
Nov 13 09:55:20 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:55:20 user nova-compute[74611]:       <nova:ports>
Nov 13 09:55:20 user nova-compute[74611]:         <nova:port uuid="b7d65c35-0bb4-49fc-886d-4f9606372e9a">
Nov 13 09:55:20 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 09:55:20 user nova-compute[74611]:         </nova:port>
Nov 13 09:55:20 user nova-compute[74611]:       </nova:ports>
Nov 13 09:55:20 user nova-compute[74611]:     </nova:instance>
Nov 13 09:55:20 user nova-compute[74611]:   </metadata>
Nov 13 09:55:20 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:55:20 user nova-compute[74611]:     <system>
Nov 13 09:55:20 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:55:20 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:55:20 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:55:20 user nova-compute[74611]:       <entry name="serial">89038547-5416-4942-8070-dd5dd8e4b6c2</entry>
Nov 13 09:55:20 user nova-compute[74611]:       <entry name="uuid">89038547-5416-4942-8070-dd5dd8e4b6c2</entry>
Nov 13 09:55:20 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:55:20 user nova-compute[74611]:     </system>
Nov 13 09:55:20 user nova-compute[74611]:   </sysinfo>
Nov 13 09:55:20 user nova-compute[74611]:   <os>
Nov 13 09:55:20 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:55:20 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:55:20 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:55:20 user nova-compute[74611]:   </os>
Nov 13 09:55:20 user nova-compute[74611]:   <features>
Nov 13 09:55:20 user nova-compute[74611]:     <acpi/>
Nov 13 09:55:20 user nova-compute[74611]:     <apic/>
Nov 13 09:55:20 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:55:20 user nova-compute[74611]:   </features>
Nov 13 09:55:20 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:55:20 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:55:20 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:55:20 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:55:20 user nova-compute[74611]:   </clock>
Nov 13 09:55:20 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:55:20 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:55:20 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:55:20 user nova-compute[74611]:   </cpu>
Nov 13 09:55:20 user nova-compute[74611]:   <devices>
Nov 13 09:55:20 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:55:20 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:55:20 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk"/>
Nov 13 09:55:20 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:55:20 user nova-compute[74611]:     </disk>
Nov 13 09:55:20 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:55:20 user nova-compute[74611]:       <mac address="fa:16:3e:78:67:ad"/>
Nov 13 09:55:20 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:55:20 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:55:20 user nova-compute[74611]:       <target dev="tapb7d65c35-0b"/>
Nov 13 09:55:20 user nova-compute[74611]:     </interface>
Nov 13 09:55:20 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:55:20 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/console.log" append="off"/>
Nov 13 09:55:20 user nova-compute[74611]:     </serial>
Nov 13 09:55:20 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:55:20 user nova-compute[74611]:     <video>
Nov 13 09:55:20 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:55:20 user nova-compute[74611]:     </video>
Nov 13 09:55:20 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:55:20 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:55:20 user nova-compute[74611]:     </rng>
Nov 13 09:55:20 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:55:20 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:55:20 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:55:20 user nova-compute[74611]:     </memballoon>
Nov 13 09:55:20 user nova-compute[74611]:   </devices>
Nov 13 09:55:20 user nova-compute[74611]: </domain>
Nov 13 09:55:20 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1632814246',display_name='tempest-TestStampPattern-server-1632814246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1632814246',id=13,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7yEcTGCYgYQQ15n06GslTPAn66P3BsID6l5qVrR50yqGTIakIpEEZW+YrSNkhKYZHWTi4IFmCBW3J1HXYI+Mzp3JImjkhJzXOkCMzv7+aS8nhc5OnaYd9h98IBbTgI6g==',key_name='tempest-TestStampPattern-296911042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ff71e8694b6414d9df6bc665eb0a9b9',ramdisk_id='',reservation_id='r-k79l0y3m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-833358871',owner_user_name='tempest-TestStampPattern-833358871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:55:19Z,user_data=None,user_id='43cba8f20865492e8f1c169e2b2b706c',uuid=89038547-5416-4942-8070-dd5dd8e4b6c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "address": "fa:16:3e:78:67:ad", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d65c35-0b", "ovs_interfaceid": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Converting VIF {"id": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "address": "fa:16:3e:78:67:ad", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d65c35-0b", "ovs_interfaceid": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:67:ad,bridge_name='br-int',has_traffic_filtering=True,id=b7d65c35-0bb4-49fc-886d-4f9606372e9a,network=Network(b8196669-7bef-4c06-b6bb-a32fabaec23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d65c35-0b') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG os_vif [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:67:ad,bridge_name='br-int',has_traffic_filtering=True,id=b7d65c35-0bb4-49fc-886d-4f9606372e9a,network=Network(b8196669-7bef-4c06-b6bb-a32fabaec23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d65c35-0b') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9c9ca0a-ef3d-55ef-b6a1-7584a7c6d598', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7d65c35-0b, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7d65c35-0b, col_values=(('qos', UUID('0f8d1985-44d1-47e1-aba4-b67a2a5f423f')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7d65c35-0b, col_values=(('external_ids', {'iface-id': 'b7d65c35-0bb4-49fc-886d-4f9606372e9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:67:ad', 'vm-uuid': '89038547-5416-4942-8070-dd5dd8e4b6c2'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:20 user nova-compute[74611]: INFO os_vif [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:67:ad,bridge_name='br-int',has_traffic_filtering=True,id=b7d65c35-0bb4-49fc-886d-4f9606372e9a,network=Network(b8196669-7bef-4c06-b6bb-a32fabaec23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d65c35-0b')
Nov 13 09:55:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:55:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] No VIF found with MAC fa:16:3e:78:67:ad, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:55:21 user nova-compute[74611]: DEBUG nova.network.neutron [req-079d7ef1-e598-4dd2-8d97-64a3075c78cd req-30bae655-e3d5-425d-9925-ae20eb83b9c6 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Updated VIF entry in instance network info cache for port b7d65c35-0bb4-49fc-886d-4f9606372e9a. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:55:21 user nova-compute[74611]: DEBUG nova.network.neutron [req-079d7ef1-e598-4dd2-8d97-64a3075c78cd req-30bae655-e3d5-425d-9925-ae20eb83b9c6 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Updating instance_info_cache with network_info: [{"id": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "address": "fa:16:3e:78:67:ad", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d65c35-0b", "ovs_interfaceid": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:55:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-079d7ef1-e598-4dd2-8d97-64a3075c78cd req-30bae655-e3d5-425d-9925-ae20eb83b9c6 service nova] Releasing lock "refresh_cache-89038547-5416-4942-8070-dd5dd8e4b6c2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:55:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:22 user nova-compute[74611]: DEBUG nova.compute.manager [req-6c2da5ff-bc17-4003-94c2-c3b503f31ea1 req-dd28c5cf-d63d-4509-8579-a0c3c05f61b9 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Received event network-vif-plugged-b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6c2da5ff-bc17-4003-94c2-c3b503f31ea1 req-dd28c5cf-d63d-4509-8579-a0c3c05f61b9 service nova] Acquiring lock "89038547-5416-4942-8070-dd5dd8e4b6c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6c2da5ff-bc17-4003-94c2-c3b503f31ea1 req-dd28c5cf-d63d-4509-8579-a0c3c05f61b9 service nova] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6c2da5ff-bc17-4003-94c2-c3b503f31ea1 req-dd28c5cf-d63d-4509-8579-a0c3c05f61b9 service nova] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:22 user nova-compute[74611]: DEBUG nova.compute.manager [req-6c2da5ff-bc17-4003-94c2-c3b503f31ea1 req-dd28c5cf-d63d-4509-8579-a0c3c05f61b9 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] No waiting events found dispatching network-vif-plugged-b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:22 user nova-compute[74611]: WARNING nova.compute.manager [req-6c2da5ff-bc17-4003-94c2-c3b503f31ea1 req-dd28c5cf-d63d-4509-8579-a0c3c05f61b9 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Received unexpected event network-vif-plugged-b7d65c35-0bb4-49fc-886d-4f9606372e9a for instance with vm_state building and task_state spawning.
Nov 13 09:55:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:24 user nova-compute[74611]: DEBUG nova.compute.manager [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:55:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:55:24 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Instance spawned successfully.
Nov 13 09:55:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:55:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:24 user nova-compute[74611]: INFO nova.compute.manager [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 13 09:55:24 user nova-compute[74611]: DEBUG nova.compute.manager [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:55:24 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa3af413-506b-47d9-95b1-0daa161dca84 req-7f755af9-9468-4ddb-8a9c-0f1593d115ad service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Received event network-vif-plugged-b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa3af413-506b-47d9-95b1-0daa161dca84 req-7f755af9-9468-4ddb-8a9c-0f1593d115ad service nova] Acquiring lock "89038547-5416-4942-8070-dd5dd8e4b6c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa3af413-506b-47d9-95b1-0daa161dca84 req-7f755af9-9468-4ddb-8a9c-0f1593d115ad service nova] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa3af413-506b-47d9-95b1-0daa161dca84 req-7f755af9-9468-4ddb-8a9c-0f1593d115ad service nova] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:24 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa3af413-506b-47d9-95b1-0daa161dca84 req-7f755af9-9468-4ddb-8a9c-0f1593d115ad service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] No waiting events found dispatching network-vif-plugged-b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:24 user nova-compute[74611]: WARNING nova.compute.manager [req-aa3af413-506b-47d9-95b1-0daa161dca84 req-7f755af9-9468-4ddb-8a9c-0f1593d115ad service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Received unexpected event network-vif-plugged-b7d65c35-0bb4-49fc-886d-4f9606372e9a for instance with vm_state building and task_state spawning.
Nov 13 09:55:24 user nova-compute[74611]: INFO nova.compute.manager [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Took 6.32 seconds to build instance.
Nov 13 09:55:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eba2ed8e-3136-4ff1-b300-f4659be23711 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.426s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:31 user nova-compute[74611]: INFO nova.compute.manager [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Rescuing
Nov 13 09:55:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "refresh_cache-85cb3adb-b2b3-49ec-92ab-c2b7a028241a" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:55:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquired lock "refresh_cache-85cb3adb-b2b3-49ec-92ab-c2b7a028241a" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:55:31 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:55:31 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:55:31 user nova-compute[74611]: INFO nova.compute.manager [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] instance snapshotting
Nov 13 09:55:31 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Beginning live snapshot process
Nov 13 09:55:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json -f qcow2 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:31 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Updating instance_info_cache with network_info: [{"id": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "address": "fa:16:3e:ea:e8:de", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e875b56-fd", "ovs_interfaceid": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:55:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Releasing lock "refresh_cache-85cb3adb-b2b3-49ec-92ab-c2b7a028241a" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:55:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json -f qcow2 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.189s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp97l0987a/025ee708cd634790ac66867d6b96df3d.delta 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-71b187fc-3c48-4a29-a2d0-e01d99c03269 req-9b4d4a0f-5d61-4cb0-8aa0-7fc5dc22e025 service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received event network-vif-unplugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-71b187fc-3c48-4a29-a2d0-e01d99c03269 req-9b4d4a0f-5d61-4cb0-8aa0-7fc5dc22e025 service nova] Acquiring lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-71b187fc-3c48-4a29-a2d0-e01d99c03269 req-9b4d4a0f-5d61-4cb0-8aa0-7fc5dc22e025 service nova] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-71b187fc-3c48-4a29-a2d0-e01d99c03269 req-9b4d4a0f-5d61-4cb0-8aa0-7fc5dc22e025 service nova] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-71b187fc-3c48-4a29-a2d0-e01d99c03269 req-9b4d4a0f-5d61-4cb0-8aa0-7fc5dc22e025 service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] No waiting events found dispatching network-vif-unplugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:32 user nova-compute[74611]: WARNING nova.compute.manager [req-71b187fc-3c48-4a29-a2d0-e01d99c03269 req-9b4d4a0f-5d61-4cb0-8aa0-7fc5dc22e025 service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received unexpected event network-vif-unplugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae for instance with vm_state active and task_state rescuing.
Nov 13 09:55:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp97l0987a/025ee708cd634790ac66867d6b96df3d.delta 1073741824" returned: 0 in 0.058s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:32 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 09:55:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74611) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 13 09:55:32 user nova-compute[74611]: INFO nova.virt.libvirt.host [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] UEFI support detected
Nov 13 09:55:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:33 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Instance destroyed successfully.
Nov 13 09:55:33 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Attempting rescue
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74611) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Instance directory exists: not creating {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 09:55:33 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Creating image(s)
Nov 13 09:55:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "/opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "/opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "/opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.objects.instance [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'trusted_certs' on Instance uuid 85cb3adb-b2b3-49ec-92ab-c2b7a028241a {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] COPY block job progress, current cursor: 3014656 final cursor: 75497472 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue" returned: 0 in 0.076s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.objects.instance [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'migration_context' on Instance uuid 85cb3adb-b2b3-49ec-92ab-c2b7a028241a {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.objects.base [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Object Instance<85cb3adb-b2b3-49ec-92ab-c2b7a028241a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Start _get_guest_xml network_info=[{"id": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "address": "fa:16:3e:ea:e8:de", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "vif_mac": "fa:16:3e:ea:e8:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e875b56-fd", "ovs_interfaceid": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.objects.instance [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'resources' on Instance uuid 85cb3adb-b2b3-49ec-92ab-c2b7a028241a {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.objects.base [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Object Instance<85cb3adb-b2b3-49ec-92ab-c2b7a028241a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.objects.instance [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'numa_topology' on Instance uuid 85cb3adb-b2b3-49ec-92ab-c2b7a028241a {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.objects.base [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Object Instance<85cb3adb-b2b3-49ec-92ab-c2b7a028241a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:55:33 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 09:55:33 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:55:33 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.objects.instance [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'vcpu_model' on Instance uuid 85cb3adb-b2b3-49ec-92ab-c2b7a028241a {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:55:33 user nova-compute[74611]: DEBUG nova.objects.base [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Object Instance<85cb3adb-b2b3-49ec-92ab-c2b7a028241a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-500108257',display_name='tempest-ServerRescueNegativeTestJSON-server-500108257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-500108257',id=3,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae9ab18bb67e4db19e6c3366771ad218',ramdisk_id='',reservation_id='r-vpxab583',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-961432289',owner_user_name='tempest-ServerRescueNegativeTestJSON-961432289-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:53:58Z,user_data=None,user_id='863471360be04ab5acb07ef3e99007c4',uuid=85cb3adb-b2b3-49ec-92ab-c2b7a028241a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "address": "fa:16:3e:ea:e8:de", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "vif_mac": "fa:16:3e:ea:e8:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e875b56-fd", "ovs_interfaceid": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converting VIF {"id": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "address": "fa:16:3e:ea:e8:de", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "vif_mac": "fa:16:3e:ea:e8:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e875b56-fd", "ovs_interfaceid": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:e8:de,bridge_name='br-int',has_traffic_filtering=True,id=7e875b56-fd2e-4ec6-9303-ef3965a6c7ae,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e875b56-fd') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG nova.objects.instance [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'pci_devices' on Instance uuid 85cb3adb-b2b3-49ec-92ab-c2b7a028241a {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG nova.objects.base [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Object Instance<85cb3adb-b2b3-49ec-92ab-c2b7a028241a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:55:34 user nova-compute[74611]:   <uuid>85cb3adb-b2b3-49ec-92ab-c2b7a028241a</uuid>
Nov 13 09:55:34 user nova-compute[74611]:   <name>instance-00000003</name>
Nov 13 09:55:34 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:55:34 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:55:34 user nova-compute[74611]:   <metadata>
Nov 13 09:55:34 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:55:34 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:55:34 user nova-compute[74611]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-500108257</nova:name>
Nov 13 09:55:34 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:55:33</nova:creationTime>
Nov 13 09:55:34 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:55:34 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:55:34 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:55:34 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:55:34 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:55:34 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:55:34 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:55:34 user nova-compute[74611]:       <nova:owner>
Nov 13 09:55:34 user nova-compute[74611]:         <nova:user uuid="863471360be04ab5acb07ef3e99007c4">tempest-ServerRescueNegativeTestJSON-961432289-project-member</nova:user>
Nov 13 09:55:34 user nova-compute[74611]:         <nova:project uuid="ae9ab18bb67e4db19e6c3366771ad218">tempest-ServerRescueNegativeTestJSON-961432289</nova:project>
Nov 13 09:55:34 user nova-compute[74611]:       </nova:owner>
Nov 13 09:55:34 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:55:34 user nova-compute[74611]:       <nova:ports>
Nov 13 09:55:34 user nova-compute[74611]:         <nova:port uuid="7e875b56-fd2e-4ec6-9303-ef3965a6c7ae">
Nov 13 09:55:34 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 09:55:34 user nova-compute[74611]:         </nova:port>
Nov 13 09:55:34 user nova-compute[74611]:       </nova:ports>
Nov 13 09:55:34 user nova-compute[74611]:     </nova:instance>
Nov 13 09:55:34 user nova-compute[74611]:   </metadata>
Nov 13 09:55:34 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:55:34 user nova-compute[74611]:     <system>
Nov 13 09:55:34 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:55:34 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:55:34 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:55:34 user nova-compute[74611]:       <entry name="serial">85cb3adb-b2b3-49ec-92ab-c2b7a028241a</entry>
Nov 13 09:55:34 user nova-compute[74611]:       <entry name="uuid">85cb3adb-b2b3-49ec-92ab-c2b7a028241a</entry>
Nov 13 09:55:34 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:55:34 user nova-compute[74611]:     </system>
Nov 13 09:55:34 user nova-compute[74611]:   </sysinfo>
Nov 13 09:55:34 user nova-compute[74611]:   <os>
Nov 13 09:55:34 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:55:34 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:55:34 user nova-compute[74611]:   </os>
Nov 13 09:55:34 user nova-compute[74611]:   <features>
Nov 13 09:55:34 user nova-compute[74611]:     <acpi/>
Nov 13 09:55:34 user nova-compute[74611]:     <apic/>
Nov 13 09:55:34 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:55:34 user nova-compute[74611]:   </features>
Nov 13 09:55:34 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:55:34 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:55:34 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:55:34 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:55:34 user nova-compute[74611]:   </clock>
Nov 13 09:55:34 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:55:34 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:55:34 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:55:34 user nova-compute[74611]:   </cpu>
Nov 13 09:55:34 user nova-compute[74611]:   <devices>
Nov 13 09:55:34 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:55:34 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:55:34 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue"/>
Nov 13 09:55:34 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:55:34 user nova-compute[74611]:     </disk>
Nov 13 09:55:34 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:55:34 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:55:34 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk"/>
Nov 13 09:55:34 user nova-compute[74611]:       <target dev="vdb" bus="virtio"/>
Nov 13 09:55:34 user nova-compute[74611]:     </disk>
Nov 13 09:55:34 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:55:34 user nova-compute[74611]:       <mac address="fa:16:3e:ea:e8:de"/>
Nov 13 09:55:34 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:55:34 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:55:34 user nova-compute[74611]:       <target dev="tap7e875b56-fd"/>
Nov 13 09:55:34 user nova-compute[74611]:     </interface>
Nov 13 09:55:34 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:55:34 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/console.log" append="off"/>
Nov 13 09:55:34 user nova-compute[74611]:     </serial>
Nov 13 09:55:34 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:55:34 user nova-compute[74611]:     <video>
Nov 13 09:55:34 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:55:34 user nova-compute[74611]:     </video>
Nov 13 09:55:34 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:55:34 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:55:34 user nova-compute[74611]:     </rng>
Nov 13 09:55:34 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:55:34 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:55:34 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:55:34 user nova-compute[74611]:     </memballoon>
Nov 13 09:55:34 user nova-compute[74611]:   </devices>
Nov 13 09:55:34 user nova-compute[74611]: </domain>
Nov 13 09:55:34 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp97l0987a/025ee708cd634790ac66867d6b96df3d.delta /opt/stack/data/nova/instances/snapshots/tmp97l0987a/025ee708cd634790ac66867d6b96df3d {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Instance destroyed successfully.
Nov 13 09:55:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-cc00b9cd-d2f5-49d0-bf60-b65ded838672 req-d7943fe2-c157-4a01-958d-1784437ea6de service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received event network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cc00b9cd-d2f5-49d0-bf60-b65ded838672 req-d7943fe2-c157-4a01-958d-1784437ea6de service nova] Acquiring lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cc00b9cd-d2f5-49d0-bf60-b65ded838672 req-d7943fe2-c157-4a01-958d-1784437ea6de service nova] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cc00b9cd-d2f5-49d0-bf60-b65ded838672 req-d7943fe2-c157-4a01-958d-1784437ea6de service nova] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-cc00b9cd-d2f5-49d0-bf60-b65ded838672 req-d7943fe2-c157-4a01-958d-1784437ea6de service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] No waiting events found dispatching network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:34 user nova-compute[74611]: WARNING nova.compute.manager [req-cc00b9cd-d2f5-49d0-bf60-b65ded838672 req-d7943fe2-c157-4a01-958d-1784437ea6de service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received unexpected event network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae for instance with vm_state active and task_state rescuing.
Nov 13 09:55:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No VIF found with MAC fa:16:3e:ea:e8:de, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp97l0987a/025ee708cd634790ac66867d6b96df3d.delta /opt/stack/data/nova/instances/snapshots/tmp97l0987a/025ee708cd634790ac66867d6b96df3d" returned: 0 in 0.425s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Snapshot extracted, beginning image upload
Nov 13 09:55:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:34 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:55:34 user nova-compute[74611]: INFO nova.compute.claims [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Claim successful on node user
Nov 13 09:55:35 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:55:35 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:55:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG nova.policy [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21adb30d68754dba856e5d0a3ae6727e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd392465e2d4ff0b511c9e543972244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:55:35 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Creating image(s)
Nov 13 09:55:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "/opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "/opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Updating instance_info_cache with network_info: [{"id": "e5967c05-de89-4853-b421-516eb483271e", "address": "fa:16:3e:c6:32:07", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5967c05-de", "ovs_interfaceid": "e5967c05-de89-4853-b421-516eb483271e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.189s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk 1073741824" returned: 0 in 0.068s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-fdba224e-90e4-4365-8d99-a2d5bb4466cd req-1a4a04c8-ba46-48ab-97ec-e846fa0eacfe service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received event network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fdba224e-90e4-4365-8d99-a2d5bb4466cd req-1a4a04c8-ba46-48ab-97ec-e846fa0eacfe service nova] Acquiring lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fdba224e-90e4-4365-8d99-a2d5bb4466cd req-1a4a04c8-ba46-48ab-97ec-e846fa0eacfe service nova] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fdba224e-90e4-4365-8d99-a2d5bb4466cd req-1a4a04c8-ba46-48ab-97ec-e846fa0eacfe service nova] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-fdba224e-90e4-4365-8d99-a2d5bb4466cd req-1a4a04c8-ba46-48ab-97ec-e846fa0eacfe service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] No waiting events found dispatching network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:36 user nova-compute[74611]: WARNING nova.compute.manager [req-fdba224e-90e4-4365-8d99-a2d5bb4466cd req-1a4a04c8-ba46-48ab-97ec-e846fa0eacfe service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received unexpected event network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae for instance with vm_state active and task_state rescuing.
Nov 13 09:55:36 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Successfully created port: 51208b91-d499-4866-86e6-e81e6115952a {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.219s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Cannot resize image /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Ensure instance console log exists: /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-516e2289-a22f-4ad6-9e77-906fa89a1b11 req-9a1756eb-4abf-4947-80c7-a21bda8281b8 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received event network-changed-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-516e2289-a22f-4ad6-9e77-906fa89a1b11 req-9a1756eb-4abf-4947-80c7-a21bda8281b8 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Refreshing instance network info cache due to event network-changed-e730080f-c599-449b-b366-a642be4f9ac7. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-516e2289-a22f-4ad6-9e77-906fa89a1b11 req-9a1756eb-4abf-4947-80c7-a21bda8281b8 service nova] Acquiring lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-516e2289-a22f-4ad6-9e77-906fa89a1b11 req-9a1756eb-4abf-4947-80c7-a21bda8281b8 service nova] Acquired lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.network.neutron [req-516e2289-a22f-4ad6-9e77-906fa89a1b11 req-9a1756eb-4abf-4947-80c7-a21bda8281b8 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Refreshing network info cache for port e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Successfully updated port: 51208b91-d499-4866-86e6-e81e6115952a {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "refresh_cache-b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquired lock "refresh_cache-b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:55:37 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Snapshot image upload complete
Nov 13 09:55:37 user nova-compute[74611]: INFO nova.compute.manager [None req-4fb31f2a-6208-47c0-9857-33720dbf6452 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Took 6.06 seconds to snapshot the instance on the hypervisor.
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Updating instance_info_cache with network_info: [{"id": "51208b91-d499-4866-86e6-e81e6115952a", "address": "fa:16:3e:bf:dc:b2", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51208b91-d4", "ovs_interfaceid": "51208b91-d499-4866-86e6-e81e6115952a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Releasing lock "refresh_cache-b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Instance network_info: |[{"id": "51208b91-d499-4866-86e6-e81e6115952a", "address": "fa:16:3e:bf:dc:b2", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51208b91-d4", "ovs_interfaceid": "51208b91-d499-4866-86e6-e81e6115952a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Start _get_guest_xml network_info=[{"id": "51208b91-d499-4866-86e6-e81e6115952a", "address": "fa:16:3e:bf:dc:b2", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51208b91-d4", "ovs_interfaceid": "51208b91-d499-4866-86e6-e81e6115952a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:55:37 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:55:37 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2060951892',display_name='tempest-ServersNegativeTestJSON-server-2060951892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2060951892',id=14,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afd392465e2d4ff0b511c9e543972244',ramdisk_id='',reservation_id='r-l8fln8wu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1786337240',owner_user_name='tempest-ServersNegativeTestJSON-1786337240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:55:36Z,user_data=None,user_id='21adb30d68754dba856e5d0a3ae6727e',uuid=b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51208b91-d499-4866-86e6-e81e6115952a", "address": "fa:16:3e:bf:dc:b2", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51208b91-d4", "ovs_interfaceid": "51208b91-d499-4866-86e6-e81e6115952a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Converting VIF {"id": "51208b91-d499-4866-86e6-e81e6115952a", "address": "fa:16:3e:bf:dc:b2", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51208b91-d4", "ovs_interfaceid": "51208b91-d499-4866-86e6-e81e6115952a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:dc:b2,bridge_name='br-int',has_traffic_filtering=True,id=51208b91-d499-4866-86e6-e81e6115952a,network=Network(4d389398-6662-48ae-83f4-1db7fafb4ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51208b91-d4') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.objects.instance [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lazy-loading 'pci_devices' on Instance uuid b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:55:37 user nova-compute[74611]:   <uuid>b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3</uuid>
Nov 13 09:55:37 user nova-compute[74611]:   <name>instance-0000000e</name>
Nov 13 09:55:37 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:55:37 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:55:37 user nova-compute[74611]:   <metadata>
Nov 13 09:55:37 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:55:37 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:55:37 user nova-compute[74611]:       <nova:name>tempest-ServersNegativeTestJSON-server-2060951892</nova:name>
Nov 13 09:55:37 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:55:37</nova:creationTime>
Nov 13 09:55:37 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:55:37 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:55:37 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:55:37 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:55:37 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:55:37 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:55:37 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:55:37 user nova-compute[74611]:       <nova:owner>
Nov 13 09:55:37 user nova-compute[74611]:         <nova:user uuid="21adb30d68754dba856e5d0a3ae6727e">tempest-ServersNegativeTestJSON-1786337240-project-member</nova:user>
Nov 13 09:55:37 user nova-compute[74611]:         <nova:project uuid="afd392465e2d4ff0b511c9e543972244">tempest-ServersNegativeTestJSON-1786337240</nova:project>
Nov 13 09:55:37 user nova-compute[74611]:       </nova:owner>
Nov 13 09:55:37 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:55:37 user nova-compute[74611]:       <nova:ports>
Nov 13 09:55:37 user nova-compute[74611]:         <nova:port uuid="51208b91-d499-4866-86e6-e81e6115952a">
Nov 13 09:55:37 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 09:55:37 user nova-compute[74611]:         </nova:port>
Nov 13 09:55:37 user nova-compute[74611]:       </nova:ports>
Nov 13 09:55:37 user nova-compute[74611]:     </nova:instance>
Nov 13 09:55:37 user nova-compute[74611]:   </metadata>
Nov 13 09:55:37 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:55:37 user nova-compute[74611]:     <system>
Nov 13 09:55:37 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:55:37 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:55:37 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:55:37 user nova-compute[74611]:       <entry name="serial">b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3</entry>
Nov 13 09:55:37 user nova-compute[74611]:       <entry name="uuid">b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3</entry>
Nov 13 09:55:37 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:55:37 user nova-compute[74611]:     </system>
Nov 13 09:55:37 user nova-compute[74611]:   </sysinfo>
Nov 13 09:55:37 user nova-compute[74611]:   <os>
Nov 13 09:55:37 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:55:37 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:55:37 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:55:37 user nova-compute[74611]:   </os>
Nov 13 09:55:37 user nova-compute[74611]:   <features>
Nov 13 09:55:37 user nova-compute[74611]:     <acpi/>
Nov 13 09:55:37 user nova-compute[74611]:     <apic/>
Nov 13 09:55:37 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:55:37 user nova-compute[74611]:   </features>
Nov 13 09:55:37 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:55:37 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:55:37 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:55:37 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:55:37 user nova-compute[74611]:   </clock>
Nov 13 09:55:37 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:55:37 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:55:37 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:55:37 user nova-compute[74611]:   </cpu>
Nov 13 09:55:37 user nova-compute[74611]:   <devices>
Nov 13 09:55:37 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:55:37 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:55:37 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk"/>
Nov 13 09:55:37 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:55:37 user nova-compute[74611]:     </disk>
Nov 13 09:55:37 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:55:37 user nova-compute[74611]:       <mac address="fa:16:3e:bf:dc:b2"/>
Nov 13 09:55:37 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:55:37 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:55:37 user nova-compute[74611]:       <target dev="tap51208b91-d4"/>
Nov 13 09:55:37 user nova-compute[74611]:     </interface>
Nov 13 09:55:37 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:55:37 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/console.log" append="off"/>
Nov 13 09:55:37 user nova-compute[74611]:     </serial>
Nov 13 09:55:37 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:55:37 user nova-compute[74611]:     <video>
Nov 13 09:55:37 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:55:37 user nova-compute[74611]:     </video>
Nov 13 09:55:37 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:55:37 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:55:37 user nova-compute[74611]:     </rng>
Nov 13 09:55:37 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:55:37 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:55:37 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:55:37 user nova-compute[74611]:     </memballoon>
Nov 13 09:55:37 user nova-compute[74611]:   </devices>
Nov 13 09:55:37 user nova-compute[74611]: </domain>
Nov 13 09:55:37 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2060951892',display_name='tempest-ServersNegativeTestJSON-server-2060951892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2060951892',id=14,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afd392465e2d4ff0b511c9e543972244',ramdisk_id='',reservation_id='r-l8fln8wu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1786337240',owner_user_name='tempest-ServersNegativeTestJSON-1786337240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:55:36Z,user_data=None,user_id='21adb30d68754dba856e5d0a3ae6727e',uuid=b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51208b91-d499-4866-86e6-e81e6115952a", "address": "fa:16:3e:bf:dc:b2", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51208b91-d4", "ovs_interfaceid": "51208b91-d499-4866-86e6-e81e6115952a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Converting VIF {"id": "51208b91-d499-4866-86e6-e81e6115952a", "address": "fa:16:3e:bf:dc:b2", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51208b91-d4", "ovs_interfaceid": "51208b91-d499-4866-86e6-e81e6115952a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:dc:b2,bridge_name='br-int',has_traffic_filtering=True,id=51208b91-d499-4866-86e6-e81e6115952a,network=Network(4d389398-6662-48ae-83f4-1db7fafb4ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51208b91-d4') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG os_vif [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:dc:b2,bridge_name='br-int',has_traffic_filtering=True,id=51208b91-d499-4866-86e6-e81e6115952a,network=Network(4d389398-6662-48ae-83f4-1db7fafb4ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51208b91-d4') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4aa90f95-b9d7-5e6f-b486-33537009a25d', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51208b91-d4, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51208b91-d4, col_values=(('qos', UUID('60dcb386-f5b6-4234-884b-c553a9d21e87')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51208b91-d4, col_values=(('external_ids', {'iface-id': '51208b91-d499-4866-86e6-e81e6115952a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:dc:b2', 'vm-uuid': 'b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:37 user nova-compute[74611]: INFO os_vif [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:dc:b2,bridge_name='br-int',has_traffic_filtering=True,id=51208b91-d499-4866-86e6-e81e6115952a,network=Network(4d389398-6662-48ae-83f4-1db7fafb4ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51208b91-d4')
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] No VIF found with MAC fa:16:3e:bf:dc:b2, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.network.neutron [req-516e2289-a22f-4ad6-9e77-906fa89a1b11 req-9a1756eb-4abf-4947-80c7-a21bda8281b8 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updated VIF entry in instance network info cache for port e730080f-c599-449b-b366-a642be4f9ac7. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG nova.network.neutron [req-516e2289-a22f-4ad6-9e77-906fa89a1b11 req-9a1756eb-4abf-4947-80c7-a21bda8281b8 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updating instance_info_cache with network_info: [{"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-516e2289-a22f-4ad6-9e77-906fa89a1b11 req-9a1756eb-4abf-4947-80c7-a21bda8281b8 service nova] Releasing lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:55:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f3ea68c7-0b62-4bfb-9e53-399b65d9d560 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-f1869929-b824-404a-b18f-33bb268918ab req-aad60947-f367-419b-92fd-ec260e05245c service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received event network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f1869929-b824-404a-b18f-33bb268918ab req-aad60947-f367-419b-92fd-ec260e05245c service nova] Acquiring lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f1869929-b824-404a-b18f-33bb268918ab req-aad60947-f367-419b-92fd-ec260e05245c service nova] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f1869929-b824-404a-b18f-33bb268918ab req-aad60947-f367-419b-92fd-ec260e05245c service nova] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-f1869929-b824-404a-b18f-33bb268918ab req-aad60947-f367-419b-92fd-ec260e05245c service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] No waiting events found dispatching network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:38 user nova-compute[74611]: WARNING nova.compute.manager [req-f1869929-b824-404a-b18f-33bb268918ab req-aad60947-f367-419b-92fd-ec260e05245c service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received unexpected event network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae for instance with vm_state rescued and task_state None.
Nov 13 09:55:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-f1869929-b824-404a-b18f-33bb268918ab req-aad60947-f367-419b-92fd-ec260e05245c service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Received event network-changed-51208b91-d499-4866-86e6-e81e6115952a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-f1869929-b824-404a-b18f-33bb268918ab req-aad60947-f367-419b-92fd-ec260e05245c service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Refreshing instance network info cache due to event network-changed-51208b91-d499-4866-86e6-e81e6115952a. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f1869929-b824-404a-b18f-33bb268918ab req-aad60947-f367-419b-92fd-ec260e05245c service nova] Acquiring lock "refresh_cache-b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f1869929-b824-404a-b18f-33bb268918ab req-aad60947-f367-419b-92fd-ec260e05245c service nova] Acquired lock "refresh_cache-b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG nova.network.neutron [req-f1869929-b824-404a-b18f-33bb268918ab req-aad60947-f367-419b-92fd-ec260e05245c service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Refreshing network info cache for port 51208b91-d499-4866-86e6-e81e6115952a {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG nova.network.neutron [req-f1869929-b824-404a-b18f-33bb268918ab req-aad60947-f367-419b-92fd-ec260e05245c service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Updated VIF entry in instance network info cache for port 51208b91-d499-4866-86e6-e81e6115952a. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG nova.network.neutron [req-f1869929-b824-404a-b18f-33bb268918ab req-aad60947-f367-419b-92fd-ec260e05245c service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Updating instance_info_cache with network_info: [{"id": "51208b91-d499-4866-86e6-e81e6115952a", "address": "fa:16:3e:bf:dc:b2", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51208b91-d4", "ovs_interfaceid": "51208b91-d499-4866-86e6-e81e6115952a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:55:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f1869929-b824-404a-b18f-33bb268918ab req-aad60947-f367-419b-92fd-ec260e05245c service nova] Releasing lock "refresh_cache-b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:55:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-1e3c1baf-0835-47eb-99d9-7dd92e3a2a38 req-688e3caa-92d9-43d5-96e3-5c28ec21887f service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Received event network-changed-443f1230-01cb-4e7e-8ce7-bc254e125fff {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-1e3c1baf-0835-47eb-99d9-7dd92e3a2a38 req-688e3caa-92d9-43d5-96e3-5c28ec21887f service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Refreshing instance network info cache due to event network-changed-443f1230-01cb-4e7e-8ce7-bc254e125fff. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:55:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1e3c1baf-0835-47eb-99d9-7dd92e3a2a38 req-688e3caa-92d9-43d5-96e3-5c28ec21887f service nova] Acquiring lock "refresh_cache-fe53a1a8-de5b-4679-bddb-1da5204dbab8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:55:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1e3c1baf-0835-47eb-99d9-7dd92e3a2a38 req-688e3caa-92d9-43d5-96e3-5c28ec21887f service nova] Acquired lock "refresh_cache-fe53a1a8-de5b-4679-bddb-1da5204dbab8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:55:39 user nova-compute[74611]: DEBUG nova.network.neutron [req-1e3c1baf-0835-47eb-99d9-7dd92e3a2a38 req-688e3caa-92d9-43d5-96e3-5c28ec21887f service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Refreshing network info cache for port 443f1230-01cb-4e7e-8ce7-bc254e125fff {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG nova.network.neutron [req-1e3c1baf-0835-47eb-99d9-7dd92e3a2a38 req-688e3caa-92d9-43d5-96e3-5c28ec21887f service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Updated VIF entry in instance network info cache for port 443f1230-01cb-4e7e-8ce7-bc254e125fff. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG nova.network.neutron [req-1e3c1baf-0835-47eb-99d9-7dd92e3a2a38 req-688e3caa-92d9-43d5-96e3-5c28ec21887f service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Updating instance_info_cache with network_info: [{"id": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "address": "fa:16:3e:47:f4:bd", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443f1230-01", "ovs_interfaceid": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1e3c1baf-0835-47eb-99d9-7dd92e3a2a38 req-688e3caa-92d9-43d5-96e3-5c28ec21887f service nova] Releasing lock "refresh_cache-fe53a1a8-de5b-4679-bddb-1da5204dbab8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:40 user nova-compute[74611]: INFO nova.compute.manager [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Shelving
Nov 13 09:55:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-20b8abf4-4484-4e99-926d-247f1ba9653c req-dbb214fc-de86-4287-9114-0410884e097a service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Received event network-vif-plugged-51208b91-d499-4866-86e6-e81e6115952a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-20b8abf4-4484-4e99-926d-247f1ba9653c req-dbb214fc-de86-4287-9114-0410884e097a service nova] Acquiring lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-20b8abf4-4484-4e99-926d-247f1ba9653c req-dbb214fc-de86-4287-9114-0410884e097a service nova] Lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-20b8abf4-4484-4e99-926d-247f1ba9653c req-dbb214fc-de86-4287-9114-0410884e097a service nova] Lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-20b8abf4-4484-4e99-926d-247f1ba9653c req-dbb214fc-de86-4287-9114-0410884e097a service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] No waiting events found dispatching network-vif-plugged-51208b91-d499-4866-86e6-e81e6115952a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:40 user nova-compute[74611]: WARNING nova.compute.manager [req-20b8abf4-4484-4e99-926d-247f1ba9653c req-dbb214fc-de86-4287-9114-0410884e097a service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Received unexpected event network-vif-plugged-51208b91-d499-4866-86e6-e81e6115952a for instance with vm_state building and task_state spawning.
Nov 13 09:55:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-20b8abf4-4484-4e99-926d-247f1ba9653c req-dbb214fc-de86-4287-9114-0410884e097a service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Received event network-vif-plugged-51208b91-d499-4866-86e6-e81e6115952a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-20b8abf4-4484-4e99-926d-247f1ba9653c req-dbb214fc-de86-4287-9114-0410884e097a service nova] Acquiring lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-20b8abf4-4484-4e99-926d-247f1ba9653c req-dbb214fc-de86-4287-9114-0410884e097a service nova] Lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-20b8abf4-4484-4e99-926d-247f1ba9653c req-dbb214fc-de86-4287-9114-0410884e097a service nova] Lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-20b8abf4-4484-4e99-926d-247f1ba9653c req-dbb214fc-de86-4287-9114-0410884e097a service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] No waiting events found dispatching network-vif-plugged-51208b91-d499-4866-86e6-e81e6115952a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:40 user nova-compute[74611]: WARNING nova.compute.manager [req-20b8abf4-4484-4e99-926d-247f1ba9653c req-dbb214fc-de86-4287-9114-0410884e097a service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Received unexpected event network-vif-plugged-51208b91-d499-4866-86e6-e81e6115952a for instance with vm_state building and task_state spawning.
Nov 13 09:55:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-1c3447bb-7765-4461-a8db-f44efa67238e req-81fdc972-54f3-4f01-9b6e-c32364200d57 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received event network-vif-unplugged-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1c3447bb-7765-4461-a8db-f44efa67238e req-81fdc972-54f3-4f01-9b6e-c32364200d57 service nova] Acquiring lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1c3447bb-7765-4461-a8db-f44efa67238e req-81fdc972-54f3-4f01-9b6e-c32364200d57 service nova] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1c3447bb-7765-4461-a8db-f44efa67238e req-81fdc972-54f3-4f01-9b6e-c32364200d57 service nova] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-1c3447bb-7765-4461-a8db-f44efa67238e req-81fdc972-54f3-4f01-9b6e-c32364200d57 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] No waiting events found dispatching network-vif-unplugged-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:40 user nova-compute[74611]: WARNING nova.compute.manager [req-1c3447bb-7765-4461-a8db-f44efa67238e req-81fdc972-54f3-4f01-9b6e-c32364200d57 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received unexpected event network-vif-unplugged-e730080f-c599-449b-b366-a642be4f9ac7 for instance with vm_state active and task_state shelving.
Nov 13 09:55:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:41 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Instance destroyed successfully.
Nov 13 09:55:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:41 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Beginning cold snapshot process
Nov 13 09:55:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:41 user nova-compute[74611]: DEBUG nova.objects.instance [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'flavor' on Instance uuid fe53a1a8-de5b-4679-bddb-1da5204dbab8 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:55:41 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 09:55:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk /opt/stack/data/nova/instances/snapshots/tmpvpox5q84/abd1b63fe1c440e4a22215084a7ebb3c {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.197s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:41 user nova-compute[74611]: INFO nova.compute.manager [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Attaching volume 173d8837-2595-459a-bc22-8465cfabdb5d to /dev/vdb
Nov 13 09:55:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:55:42 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Instance spawned successfully.
Nov 13 09:55:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG os_brick.utils [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e02f5bf-e6ba-4fc1-9d30-d7530dbe7033]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:42 user nova-compute[74611]: INFO nova.compute.manager [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Took 6.46 seconds to spawn the instance on the hypervisor.
Nov 13 09:55:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4c7524-ebe4-4b31-8c1d-8e322d793fc7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0337645-1bea-4596-a3e0-6f0501071380]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1804fb1-97f5-4b81-883f-8c0149f54323]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk /opt/stack/data/nova/instances/snapshots/tmpvpox5q84/abd1b63fe1c440e4a22215084a7ebb3c" returned: 0 in 0.741s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:42 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Snapshot extracted, beginning image upload
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:55:42 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[710ce4db-0f5f-46c6-b7b4-6179ebdcd8a6]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:42 user nova-compute[74611]: INFO nova.compute.manager [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Took 7.62 seconds to build instance.
Nov 13 09:55:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG os_brick.utils [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Updating existing volume attachment record: 9867928c-6519-41db-a912-695ee73366e8 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5bbfe1dc-a261-4604-a0de-2d0f060afeb5 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.772s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG nova.compute.manager [req-01739eec-59a9-487a-a800-d8f706821eb5 req-b81f44c3-e05c-459e-ac34-d9bbd8e038cd service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received event network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-01739eec-59a9-487a-a800-d8f706821eb5 req-b81f44c3-e05c-459e-ac34-d9bbd8e038cd service nova] Acquiring lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-01739eec-59a9-487a-a800-d8f706821eb5 req-b81f44c3-e05c-459e-ac34-d9bbd8e038cd service nova] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-01739eec-59a9-487a-a800-d8f706821eb5 req-b81f44c3-e05c-459e-ac34-d9bbd8e038cd service nova] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG nova.compute.manager [req-01739eec-59a9-487a-a800-d8f706821eb5 req-b81f44c3-e05c-459e-ac34-d9bbd8e038cd service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] No waiting events found dispatching network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:42 user nova-compute[74611]: WARNING nova.compute.manager [req-01739eec-59a9-487a-a800-d8f706821eb5 req-b81f44c3-e05c-459e-ac34-d9bbd8e038cd service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received unexpected event network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 for instance with vm_state active and task_state shelving_image_uploading.
Nov 13 09:55:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:43 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 09:55:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:45 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Snapshot image upload complete
Nov 13 09:55:45 user nova-compute[74611]: DEBUG nova.compute.manager [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:55:45 user nova-compute[74611]: INFO nova.compute.manager [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Shelve offloading
Nov 13 09:55:45 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Instance destroyed successfully.
Nov 13 09:55:45 user nova-compute[74611]: DEBUG nova.compute.manager [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:55:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:55:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquired lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:55:45 user nova-compute[74611]: DEBUG nova.network.neutron [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:55:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:46 user nova-compute[74611]: DEBUG nova.network.neutron [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updating instance_info_cache with network_info: [{"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:55:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Releasing lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:55:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 09:55:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 09:55:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.manager [req-5f05abd2-cca8-4415-b01e-102a71e14ac8 req-303d5a0b-8920-422a-8d08-7975b442ba0a service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received event network-changed-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.manager [req-5f05abd2-cca8-4415-b01e-102a71e14ac8 req-303d5a0b-8920-422a-8d08-7975b442ba0a service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Refreshing instance network info cache due to event network-changed-e730080f-c599-449b-b366-a642be4f9ac7. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5f05abd2-cca8-4415-b01e-102a71e14ac8 req-303d5a0b-8920-422a-8d08-7975b442ba0a service nova] Acquiring lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5f05abd2-cca8-4415-b01e-102a71e14ac8 req-303d5a0b-8920-422a-8d08-7975b442ba0a service nova] Acquired lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.network.neutron [req-5f05abd2-cca8-4415-b01e-102a71e14ac8 req-303d5a0b-8920-422a-8d08-7975b442ba0a service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Refreshing network info cache for port e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vZdiCgSt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:55:47 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:55:47 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:55:47 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:47 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:55:47 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=6449MB free_disk=25.563377380371094GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e117fc1-8d45-45d2-a3c2-ff071656df98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:55:47 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:47 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Instance destroyed successfully.
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.objects.instance [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'resources' on Instance uuid 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b453a0-0931-4a81-850b-d1a64f8cec29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d] added
Nov 13 09:55:47 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-610781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-610781',id=5,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsTret5b3iXWCuFDtJbfayGvRYlI07teJzdTCJFhqHq6mblu7HCq3e+QCXP3zDlNZ1sgvWyIl5dD63UFzJqtDj1HFz9fXZTyR+iHl22i4km+t7rGy8XkpvMx9Gjduo9mw==',key_name='tempest-keypair-1489015223',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d5a6f570a7e7404680bd5809be8b0378',ramdisk_id='',reservation_id='r-yu0u8g36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-55203260',owner_user_name='tempest-AttachVolumeShelveTestJSON-55203260-project-member',shelved_at='2023-11-13T09:55:45.430928',shelved_host='user',shelved_image_id='688f36ff-2206-4352-bb90-d874d5e39c9d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:55:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008616dff48b4bdeb2ea0f2be72a2934',uuid=8cdb9561-3b40-44cc-abf7-2cbff7e60a17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converting VIF {"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:96:5e,bridge_name='br-int',has_traffic_filtering=True,id=e730080f-c599-449b-b366-a642be4f9ac7,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape730080f-c5') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_vif [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:96:5e,bridge_name='br-int',has_traffic_filtering=True,id=e730080f-c599-449b-b366-a642be4f9ac7,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape730080f-c5') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape730080f-c5, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4700214-b916-4926-9033-314e2e4c16b1]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2acd252f-8c5e-43cb-bdd4-326315b45313) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:47 user nova-compute[74611]: INFO os_vif [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:96:5e,bridge_name='br-int',has_traffic_filtering=True,id=e730080f-c599-449b-b366-a642be4f9ac7,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape730080f-c5')
Nov 13 09:55:47 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Deleting instance files /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17_del
Nov 13 09:55:47 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Deletion of /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17_del complete
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d82bf43-197b-4e97-987e-ea7379e91901]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vZdiCgSt {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vZdiCgSt" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42f1820-fe87-4c33-a9a5-ac8c6085dc9c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vZdiCgSt'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed9388e-866f-4296-8f4f-8eb798f52b4d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91eaf85-ef64-4027-8316-eb26df4df99e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:55:47 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:55:47 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:55:47 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:55:47 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:55:47 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:55:47 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:55:47 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:55:47 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 85cb3adb-b2b3-49ec-92ab-c2b7a028241a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 1c66c8a8-abb5-4f60-8464-074627c213d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance fe53a1a8-de5b-4679-bddb-1da5204dbab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 5b70fc11-140f-4c9a-9e75-2b33705d8c6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance eea01f90-3c79-4304-913e-8cf7e9749480 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 54fdbd33-6f7c-440b-968b-cd743e2562c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 794c6567-350a-409c-b1e1-2864b75d73c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 47f298b4-50b7-4dac-b9ee-a904be6445b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 89038547-5416-4942-8070-dd5dd8e4b6c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 09:55:47 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Deleted allocations for instance 8cdb9561-3b40-44cc-abf7-2cbff7e60a17
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f6ff61-7f5b-4597-ac0e-79672bd9afac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d, portal: 172.16.0.220,3260]
Nov 13 09:55:47 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d, portal: 172.16.0.220,3260] successful.
Nov 13 09:55:47 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1a79f4-2648-42c1-b186-e26ec86dcfd8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[682c0b45-5557-4ee6-9d62-aaa7d6a599bd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:55:47 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:55:47 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:55:47 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:55:47 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:55:47 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:55:47 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:55:47 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:55:47 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:55:47 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:55:47 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf44c30f-cf5e-4096-908a-ac17f702000e]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vZdiCgSt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.network.neutron [req-5f05abd2-cca8-4415-b01e-102a71e14ac8 req-303d5a0b-8920-422a-8d08-7975b442ba0a service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updated VIF entry in instance network info cache for port e730080f-c599-449b-b366-a642be4f9ac7. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.network.neutron [req-5f05abd2-cca8-4415-b01e-102a71e14ac8 req-303d5a0b-8920-422a-8d08-7975b442ba0a service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updating instance_info_cache with network_info: [{"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape730080f-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5f05abd2-cca8-4415-b01e-102a71e14ac8 req-303d5a0b-8920-422a-8d08-7975b442ba0a service nova] Releasing lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.681s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.394s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.objects.instance [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'numa_topology' on Instance uuid 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:55:47 user nova-compute[74611]: DEBUG nova.objects.base [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Object Instance<8cdb9561-3b40-44cc-abf7-2cbff7e60a17> lazy-loaded attributes: resources,numa_topology {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:55:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:48 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:55:48 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:55:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-12b567b0-b8a2-43ba-987f-99ac84a51649 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.972s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:55:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23263326333636462', 'path': '/dev/sdf'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:55:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263326333636462', 'path': '/dev/sdf'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:55:48 user nova-compute[74611]: DEBUG nova.objects.instance [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'flavor' on Instance uuid fe53a1a8-de5b-4679-bddb-1da5204dbab8 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:55:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 09:55:48 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:55:48 user nova-compute[74611]:   <source dev="/dev/sdf"/>
Nov 13 09:55:48 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:55:48 user nova-compute[74611]:   <serial>173d8837-2595-459a-bc22-8465cfabdb5d</serial>
Nov 13 09:55:48 user nova-compute[74611]: </disk>
Nov 13 09:55:48 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 09:55:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:55:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:55:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No VIF found with MAC fa:16:3e:47:f4:bd, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:55:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f2b8bd2d-ba35-466e-b4f8-8adc0ffc21ee tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.138s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:49 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:55:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "1958dc22-14f4-42ca-966d-f489e402e001" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "1958dc22-14f4-42ca-966d-f489e402e001" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:55:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:51 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:55:51 user nova-compute[74611]: INFO nova.compute.claims [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Claim successful on node user
Nov 13 09:55:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:52 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:55:52 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:55:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:55:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:55:52 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:55:52 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:55:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:55:52 user nova-compute[74611]: DEBUG nova.policy [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd93cfc3fb54b41ceb9f9657de0059043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1384599c1e484e54ae29b024377dbd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:55:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:55:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:55:52 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Creating image(s)
Nov 13 09:55:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "/opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "/opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "/opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.189s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.190s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Successfully created port: 28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk 1073741824" returned: 0 in 0.054s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Cannot resize image /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Ensure instance console log exists: /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Successfully updated port: 28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "refresh_cache-1958dc22-14f4-42ca-966d-f489e402e001" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquired lock "refresh_cache-1958dc22-14f4-42ca-966d-f489e402e001" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG nova.compute.manager [req-ef8db89e-ceae-40d6-a886-4ef9f90894d7 req-14e2e1f3-fafb-439e-bbd6-d866eeaf0b71 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received event network-changed-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG nova.compute.manager [req-ef8db89e-ceae-40d6-a886-4ef9f90894d7 req-14e2e1f3-fafb-439e-bbd6-d866eeaf0b71 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Refreshing instance network info cache due to event network-changed-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ef8db89e-ceae-40d6-a886-4ef9f90894d7 req-14e2e1f3-fafb-439e-bbd6-d866eeaf0b71 service nova] Acquiring lock "refresh_cache-1958dc22-14f4-42ca-966d-f489e402e001" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:55:53 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Updating instance_info_cache with network_info: [{"id": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "address": "fa:16:3e:79:69:46", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28279eb1-ec", "ovs_interfaceid": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Releasing lock "refresh_cache-1958dc22-14f4-42ca-966d-f489e402e001" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Instance network_info: |[{"id": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "address": "fa:16:3e:79:69:46", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28279eb1-ec", "ovs_interfaceid": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ef8db89e-ceae-40d6-a886-4ef9f90894d7 req-14e2e1f3-fafb-439e-bbd6-d866eeaf0b71 service nova] Acquired lock "refresh_cache-1958dc22-14f4-42ca-966d-f489e402e001" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.network.neutron [req-ef8db89e-ceae-40d6-a886-4ef9f90894d7 req-14e2e1f3-fafb-439e-bbd6-d866eeaf0b71 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Refreshing network info cache for port 28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Start _get_guest_xml network_info=[{"id": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "address": "fa:16:3e:79:69:46", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28279eb1-ec", "ovs_interfaceid": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:55:54 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:55:54 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1381269941',display_name='tempest-AttachVolumeNegativeTest-server-1381269941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1381269941',id=15,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrURP6TXHDGNB+iZoZZZ66Q0u7n8pTVWjq+b9f48lGwpkduz6Ojy0hs+prwvK6XaOhk/mhKBYx3MvE4fe04c+/1JMDgOh72Pg3utusKs9ApV2X1XDNnwrzgMOgE+CdG+A==',key_name='tempest-keypair-1486712828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1384599c1e484e54ae29b024377dbd04',ramdisk_id='',reservation_id='r-a0euq472',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1307038303',owner_user_name='tempest-AttachVolumeNegativeTest-1307038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:55:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d93cfc3fb54b41ceb9f9657de0059043',uuid=1958dc22-14f4-42ca-966d-f489e402e001,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "address": "fa:16:3e:79:69:46", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28279eb1-ec", "ovs_interfaceid": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converting VIF {"id": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "address": "fa:16:3e:79:69:46", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28279eb1-ec", "ovs_interfaceid": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:69:46,bridge_name='br-int',has_traffic_filtering=True,id=28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28279eb1-ec') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.objects.instance [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'pci_devices' on Instance uuid 1958dc22-14f4-42ca-966d-f489e402e001 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:55:54 user nova-compute[74611]:   <uuid>1958dc22-14f4-42ca-966d-f489e402e001</uuid>
Nov 13 09:55:54 user nova-compute[74611]:   <name>instance-0000000f</name>
Nov 13 09:55:54 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:55:54 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:55:54 user nova-compute[74611]:   <metadata>
Nov 13 09:55:54 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:55:54 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:55:54 user nova-compute[74611]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1381269941</nova:name>
Nov 13 09:55:54 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:55:54</nova:creationTime>
Nov 13 09:55:54 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:55:54 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:55:54 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:55:54 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:55:54 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:55:54 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:55:54 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:55:54 user nova-compute[74611]:       <nova:owner>
Nov 13 09:55:54 user nova-compute[74611]:         <nova:user uuid="d93cfc3fb54b41ceb9f9657de0059043">tempest-AttachVolumeNegativeTest-1307038303-project-member</nova:user>
Nov 13 09:55:54 user nova-compute[74611]:         <nova:project uuid="1384599c1e484e54ae29b024377dbd04">tempest-AttachVolumeNegativeTest-1307038303</nova:project>
Nov 13 09:55:54 user nova-compute[74611]:       </nova:owner>
Nov 13 09:55:54 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:55:54 user nova-compute[74611]:       <nova:ports>
Nov 13 09:55:54 user nova-compute[74611]:         <nova:port uuid="28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a">
Nov 13 09:55:54 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 09:55:54 user nova-compute[74611]:         </nova:port>
Nov 13 09:55:54 user nova-compute[74611]:       </nova:ports>
Nov 13 09:55:54 user nova-compute[74611]:     </nova:instance>
Nov 13 09:55:54 user nova-compute[74611]:   </metadata>
Nov 13 09:55:54 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:55:54 user nova-compute[74611]:     <system>
Nov 13 09:55:54 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:55:54 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:55:54 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:55:54 user nova-compute[74611]:       <entry name="serial">1958dc22-14f4-42ca-966d-f489e402e001</entry>
Nov 13 09:55:54 user nova-compute[74611]:       <entry name="uuid">1958dc22-14f4-42ca-966d-f489e402e001</entry>
Nov 13 09:55:54 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:55:54 user nova-compute[74611]:     </system>
Nov 13 09:55:54 user nova-compute[74611]:   </sysinfo>
Nov 13 09:55:54 user nova-compute[74611]:   <os>
Nov 13 09:55:54 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:55:54 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:55:54 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:55:54 user nova-compute[74611]:   </os>
Nov 13 09:55:54 user nova-compute[74611]:   <features>
Nov 13 09:55:54 user nova-compute[74611]:     <acpi/>
Nov 13 09:55:54 user nova-compute[74611]:     <apic/>
Nov 13 09:55:54 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:55:54 user nova-compute[74611]:   </features>
Nov 13 09:55:54 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:55:54 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:55:54 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:55:54 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:55:54 user nova-compute[74611]:   </clock>
Nov 13 09:55:54 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:55:54 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:55:54 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:55:54 user nova-compute[74611]:   </cpu>
Nov 13 09:55:54 user nova-compute[74611]:   <devices>
Nov 13 09:55:54 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:55:54 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:55:54 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk"/>
Nov 13 09:55:54 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:55:54 user nova-compute[74611]:     </disk>
Nov 13 09:55:54 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:55:54 user nova-compute[74611]:       <mac address="fa:16:3e:79:69:46"/>
Nov 13 09:55:54 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:55:54 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:55:54 user nova-compute[74611]:       <target dev="tap28279eb1-ec"/>
Nov 13 09:55:54 user nova-compute[74611]:     </interface>
Nov 13 09:55:54 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:55:54 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/console.log" append="off"/>
Nov 13 09:55:54 user nova-compute[74611]:     </serial>
Nov 13 09:55:54 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:55:54 user nova-compute[74611]:     <video>
Nov 13 09:55:54 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:55:54 user nova-compute[74611]:     </video>
Nov 13 09:55:54 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:55:54 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:55:54 user nova-compute[74611]:     </rng>
Nov 13 09:55:54 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:55:54 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:55:54 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:55:54 user nova-compute[74611]:     </memballoon>
Nov 13 09:55:54 user nova-compute[74611]:   </devices>
Nov 13 09:55:54 user nova-compute[74611]: </domain>
Nov 13 09:55:54 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1381269941',display_name='tempest-AttachVolumeNegativeTest-server-1381269941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1381269941',id=15,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrURP6TXHDGNB+iZoZZZ66Q0u7n8pTVWjq+b9f48lGwpkduz6Ojy0hs+prwvK6XaOhk/mhKBYx3MvE4fe04c+/1JMDgOh72Pg3utusKs9ApV2X1XDNnwrzgMOgE+CdG+A==',key_name='tempest-keypair-1486712828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1384599c1e484e54ae29b024377dbd04',ramdisk_id='',reservation_id='r-a0euq472',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1307038303',owner_user_name='tempest-AttachVolumeNegativeTest-1307038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:55:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d93cfc3fb54b41ceb9f9657de0059043',uuid=1958dc22-14f4-42ca-966d-f489e402e001,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "address": "fa:16:3e:79:69:46", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28279eb1-ec", "ovs_interfaceid": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converting VIF {"id": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "address": "fa:16:3e:79:69:46", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28279eb1-ec", "ovs_interfaceid": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:69:46,bridge_name='br-int',has_traffic_filtering=True,id=28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28279eb1-ec') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG os_vif [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:69:46,bridge_name='br-int',has_traffic_filtering=True,id=28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28279eb1-ec') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9709914f-2e18-5fc7-98c3-70d012f25d34', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28279eb1-ec, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28279eb1-ec, col_values=(('qos', UUID('1108faee-7bc7-4ee6-a607-bbca1f91a988')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28279eb1-ec, col_values=(('external_ids', {'iface-id': '28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:69:46', 'vm-uuid': '1958dc22-14f4-42ca-966d-f489e402e001'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:54 user nova-compute[74611]: INFO os_vif [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:69:46,bridge_name='br-int',has_traffic_filtering=True,id=28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28279eb1-ec')
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No VIF found with MAC fa:16:3e:79:69:46, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.network.neutron [req-ef8db89e-ceae-40d6-a886-4ef9f90894d7 req-14e2e1f3-fafb-439e-bbd6-d866eeaf0b71 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Updated VIF entry in instance network info cache for port 28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG nova.network.neutron [req-ef8db89e-ceae-40d6-a886-4ef9f90894d7 req-14e2e1f3-fafb-439e-bbd6-d866eeaf0b71 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Updating instance_info_cache with network_info: [{"id": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "address": "fa:16:3e:79:69:46", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28279eb1-ec", "ovs_interfaceid": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:55:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ef8db89e-ceae-40d6-a886-4ef9f90894d7 req-14e2e1f3-fafb-439e-bbd6-d866eeaf0b71 service nova] Releasing lock "refresh_cache-1958dc22-14f4-42ca-966d-f489e402e001" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:55:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:55 user nova-compute[74611]: DEBUG nova.compute.manager [req-8146fa36-b216-4f7e-b538-9e597cc03929 req-ddd747b4-8fdb-4678-85d7-49f35d21e2a6 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received event network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8146fa36-b216-4f7e-b538-9e597cc03929 req-ddd747b4-8fdb-4678-85d7-49f35d21e2a6 service nova] Acquiring lock "1958dc22-14f4-42ca-966d-f489e402e001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8146fa36-b216-4f7e-b538-9e597cc03929 req-ddd747b4-8fdb-4678-85d7-49f35d21e2a6 service nova] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8146fa36-b216-4f7e-b538-9e597cc03929 req-ddd747b4-8fdb-4678-85d7-49f35d21e2a6 service nova] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:55 user nova-compute[74611]: DEBUG nova.compute.manager [req-8146fa36-b216-4f7e-b538-9e597cc03929 req-ddd747b4-8fdb-4678-85d7-49f35d21e2a6 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] No waiting events found dispatching network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:55 user nova-compute[74611]: WARNING nova.compute.manager [req-8146fa36-b216-4f7e-b538-9e597cc03929 req-ddd747b4-8fdb-4678-85d7-49f35d21e2a6 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received unexpected event network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a for instance with vm_state building and task_state spawning.
Nov 13 09:55:57 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:55:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:55:57 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Instance spawned successfully.
Nov 13 09:55:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:55:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:55:57 user nova-compute[74611]: INFO nova.compute.manager [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 13 09:55:57 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:55:57 user nova-compute[74611]: INFO nova.compute.manager [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Took 6.10 seconds to build instance.
Nov 13 09:55:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7465a66-b1f4-49d3-a068-725284fcaa52 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "1958dc22-14f4-42ca-966d-f489e402e001" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.185s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:57 user nova-compute[74611]: DEBUG nova.compute.manager [req-fb301840-7197-4d76-b03d-a5901e882c7f req-83ccd32e-9e58-4b64-b339-3ebbb69845a3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received event network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:55:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fb301840-7197-4d76-b03d-a5901e882c7f req-83ccd32e-9e58-4b64-b339-3ebbb69845a3 service nova] Acquiring lock "1958dc22-14f4-42ca-966d-f489e402e001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:55:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fb301840-7197-4d76-b03d-a5901e882c7f req-83ccd32e-9e58-4b64-b339-3ebbb69845a3 service nova] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:55:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fb301840-7197-4d76-b03d-a5901e882c7f req-83ccd32e-9e58-4b64-b339-3ebbb69845a3 service nova] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:55:57 user nova-compute[74611]: DEBUG nova.compute.manager [req-fb301840-7197-4d76-b03d-a5901e882c7f req-83ccd32e-9e58-4b64-b339-3ebbb69845a3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] No waiting events found dispatching network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:55:57 user nova-compute[74611]: WARNING nova.compute.manager [req-fb301840-7197-4d76-b03d-a5901e882c7f req-83ccd32e-9e58-4b64-b339-3ebbb69845a3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received unexpected event network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a for instance with vm_state active and task_state None.
Nov 13 09:55:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:55:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-ad2eb643-9db1-4472-8d20-c7763abd1ca6 req-0c10b08a-a5dd-42a5-abee-7189e8224b8e service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Received event network-changed-c17146c8-a3ec-4289-b41d-751fff2e490f {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-ad2eb643-9db1-4472-8d20-c7763abd1ca6 req-0c10b08a-a5dd-42a5-abee-7189e8224b8e service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Refreshing instance network info cache due to event network-changed-c17146c8-a3ec-4289-b41d-751fff2e490f. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ad2eb643-9db1-4472-8d20-c7763abd1ca6 req-0c10b08a-a5dd-42a5-abee-7189e8224b8e service nova] Acquiring lock "refresh_cache-5b70fc11-140f-4c9a-9e75-2b33705d8c6d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ad2eb643-9db1-4472-8d20-c7763abd1ca6 req-0c10b08a-a5dd-42a5-abee-7189e8224b8e service nova] Acquired lock "refresh_cache-5b70fc11-140f-4c9a-9e75-2b33705d8c6d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG nova.network.neutron [req-ad2eb643-9db1-4472-8d20-c7763abd1ca6 req-0c10b08a-a5dd-42a5-abee-7189e8224b8e service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Refreshing network info cache for port c17146c8-a3ec-4289-b41d-751fff2e490f {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Acquiring lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG nova.objects.instance [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lazy-loading 'flavor' on Instance uuid 5b70fc11-140f-4c9a-9e75-2b33705d8c6d {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG nova.network.neutron [req-ad2eb643-9db1-4472-8d20-c7763abd1ca6 req-0c10b08a-a5dd-42a5-abee-7189e8224b8e service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Updated VIF entry in instance network info cache for port c17146c8-a3ec-4289-b41d-751fff2e490f. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG nova.network.neutron [req-ad2eb643-9db1-4472-8d20-c7763abd1ca6 req-0c10b08a-a5dd-42a5-abee-7189e8224b8e service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Updating instance_info_cache with network_info: [{"id": "c17146c8-a3ec-4289-b41d-751fff2e490f", "address": "fa:16:3e:88:fb:1e", "network": {"id": "3594b817-94b7-461b-9cc7-b7f99c0605c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-143737876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b6ac63cf4a4e7b8a3c5db0242d4612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17146c8-a3", "ovs_interfaceid": "c17146c8-a3ec-4289-b41d-751fff2e490f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ad2eb643-9db1-4472-8d20-c7763abd1ca6 req-0c10b08a-a5dd-42a5-abee-7189e8224b8e service nova] Releasing lock "refresh_cache-5b70fc11-140f-4c9a-9e75-2b33705d8c6d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Acquiring lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:01 user nova-compute[74611]: INFO nova.compute.manager [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Attaching volume f3079aaf-9e56-4219-a7ef-32f459f61957 to /dev/vdb
Nov 13 09:56:01 user nova-compute[74611]: DEBUG os_brick.utils [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37364ce-9aab-463d-99ed-6a7809166370]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98e6421-f223-43eb-b267-0d7e74c5b4af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e10ab13-f42a-4bfb-94c2-37a305ecabdd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ed5266-5f86-4c52-bfd5-8f8e588a1de2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:56:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:56:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:56:02 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:56:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96494e9-8242-48d9-a526-48072af91aad]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:56:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:56:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:56:02 user nova-compute[74611]: DEBUG os_brick.utils [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:02 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Updating existing volume attachment record: d1347711-feed-43eb-9774-5c4028e54a70 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:56:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-ac28ce09-fad5-46b4-bca2-b762766ad742 req-cb2edcd3-8b2e-4f50-bb08-2ecb145d94c7 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received event network-changed-805b4d7d-b250-40e4-af31-e9f281182115 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-ac28ce09-fad5-46b4-bca2-b762766ad742 req-cb2edcd3-8b2e-4f50-bb08-2ecb145d94c7 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Refreshing instance network info cache due to event network-changed-805b4d7d-b250-40e4-af31-e9f281182115. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:56:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ac28ce09-fad5-46b4-bca2-b762766ad742 req-cb2edcd3-8b2e-4f50-bb08-2ecb145d94c7 service nova] Acquiring lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:56:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ac28ce09-fad5-46b4-bca2-b762766ad742 req-cb2edcd3-8b2e-4f50-bb08-2ecb145d94c7 service nova] Acquired lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:56:02 user nova-compute[74611]: DEBUG nova.network.neutron [req-ac28ce09-fad5-46b4-bca2-b762766ad742 req-cb2edcd3-8b2e-4f50-bb08-2ecb145d94c7 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Refreshing network info cache for port 805b4d7d-b250-40e4-af31-e9f281182115 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:56:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:03 user nova-compute[74611]: DEBUG nova.network.neutron [req-ac28ce09-fad5-46b4-bca2-b762766ad742 req-cb2edcd3-8b2e-4f50-bb08-2ecb145d94c7 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Updated VIF entry in instance network info cache for port 805b4d7d-b250-40e4-af31-e9f281182115. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:56:03 user nova-compute[74611]: DEBUG nova.network.neutron [req-ac28ce09-fad5-46b4-bca2-b762766ad742 req-cb2edcd3-8b2e-4f50-bb08-2ecb145d94c7 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Updating instance_info_cache with network_info: [{"id": "805b4d7d-b250-40e4-af31-e9f281182115", "address": "fa:16:3e:05:dc:a6", "network": {"id": "76b58f11-8450-4eea-b1c5-996e7112fd8b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1065019570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap805b4d7d-b2", "ovs_interfaceid": "805b4d7d-b250-40e4-af31-e9f281182115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ac28ce09-fad5-46b4-bca2-b762766ad742 req-cb2edcd3-8b2e-4f50-bb08-2ecb145d94c7 service nova] Releasing lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:56:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "interface-eea01f90-3c79-4304-913e-8cf7e9749480-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "interface-eea01f90-3c79-4304-913e-8cf7e9749480-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:03 user nova-compute[74611]: DEBUG nova.objects.instance [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lazy-loading 'flavor' on Instance uuid eea01f90-3c79-4304-913e-8cf7e9749480 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:03 user nova-compute[74611]: DEBUG nova.objects.instance [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lazy-loading 'pci_requests' on Instance uuid eea01f90-3c79-4304-913e-8cf7e9749480 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:03 user nova-compute[74611]: DEBUG nova.objects.base [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Object Instance<eea01f90-3c79-4304-913e-8cf7e9749480> lazy-loaded attributes: flavor,pci_requests {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:56:03 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:56:03 user nova-compute[74611]: DEBUG nova.policy [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4627e309322495f90a6e412f7e36c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6f36a09d514934ab7e11e7e945658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-ca957273-c223-4e11-87a0-2b0e84d90048 req-380454cf-8b5a-4ffa-a58a-0444048478de service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Received event network-changed-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-ca957273-c223-4e11-87a0-2b0e84d90048 req-380454cf-8b5a-4ffa-a58a-0444048478de service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Refreshing instance network info cache due to event network-changed-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ca957273-c223-4e11-87a0-2b0e84d90048 req-380454cf-8b5a-4ffa-a58a-0444048478de service nova] Acquiring lock "refresh_cache-54fdbd33-6f7c-440b-968b-cd743e2562c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ca957273-c223-4e11-87a0-2b0e84d90048 req-380454cf-8b5a-4ffa-a58a-0444048478de service nova] Acquired lock "refresh_cache-54fdbd33-6f7c-440b-968b-cd743e2562c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG nova.network.neutron [req-ca957273-c223-4e11-87a0-2b0e84d90048 req-380454cf-8b5a-4ffa-a58a-0444048478de service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Refreshing network info cache for port b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Successfully created port: 266e9729-66ec-47c1-b5a4-a23e4cb79de6 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG nova.network.neutron [req-ca957273-c223-4e11-87a0-2b0e84d90048 req-380454cf-8b5a-4ffa-a58a-0444048478de service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Updated VIF entry in instance network info cache for port b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG nova.network.neutron [req-ca957273-c223-4e11-87a0-2b0e84d90048 req-380454cf-8b5a-4ffa-a58a-0444048478de service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Updating instance_info_cache with network_info: [{"id": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "address": "fa:16:3e:7d:87:b9", "network": {"id": "02ef9d76-af74-4ee0-85f4-f7655b4d4d9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1671331735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d4b071d0124c118e77acf5595e7c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bcb0be-cc", "ovs_interfaceid": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ca957273-c223-4e11-87a0-2b0e84d90048 req-380454cf-8b5a-4ffa-a58a-0444048478de service nova] Releasing lock "refresh_cache-54fdbd33-6f7c-440b-968b-cd743e2562c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Successfully updated port: 266e9729-66ec-47c1-b5a4-a23e4cb79de6 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquired lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-dd0f6abc-e4a5-4ee8-b062-36d6d0914246 req-ebc2da68-019e-4393-ae31-43e1e932ece2 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received event network-changed-266e9729-66ec-47c1-b5a4-a23e4cb79de6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-dd0f6abc-e4a5-4ee8-b062-36d6d0914246 req-ebc2da68-019e-4393-ae31-43e1e932ece2 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Refreshing instance network info cache due to event network-changed-266e9729-66ec-47c1-b5a4-a23e4cb79de6. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:56:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dd0f6abc-e4a5-4ee8-b062-36d6d0914246 req-ebc2da68-019e-4393-ae31-43e1e932ece2 service nova] Acquiring lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Updating instance_info_cache with network_info: [{"id": "805b4d7d-b250-40e4-af31-e9f281182115", "address": "fa:16:3e:05:dc:a6", "network": {"id": "76b58f11-8450-4eea-b1c5-996e7112fd8b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1065019570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap805b4d7d-b2", "ovs_interfaceid": "805b4d7d-b250-40e4-af31-e9f281182115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "address": "fa:16:3e:0e:84:69", "network": {"id": "55f5861f-a3bd-4036-b97e-e41fbe61acb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1033512839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap266e9729-66", "ovs_interfaceid": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Releasing lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dd0f6abc-e4a5-4ee8-b062-36d6d0914246 req-ebc2da68-019e-4393-ae31-43e1e932ece2 service nova] Acquired lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.network.neutron [req-dd0f6abc-e4a5-4ee8-b062-36d6d0914246 req-ebc2da68-019e-4393-ae31-43e1e932ece2 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Refreshing network info cache for port 266e9729-66ec-47c1-b5a4-a23e4cb79de6 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-560513437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-560513437',id=8,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeQwNIdKbZkcJ1bL6vxLyRaw/tiXK1lBMCzqrmneLrH3GH4oV5/eRe+ZKc6KvSL9xj8s0omUXtq4rOBJVCBpsYTYfMFZFh2iLGaIRkl6/UO9iRuPbpk3z3yXYcyxqHiGw==',key_name='tempest-keypair-788651981',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:54:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f6f36a09d514934ab7e11e7e945658f',ramdisk_id='',reservation_id='r-o8x6c9da',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-987448261',owner_user_name='tempest-TaggedAttachmentsTest-987448261-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:54:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4627e309322495f90a6e412f7e36c75',uuid=eea01f90-3c79-4304-913e-8cf7e9749480,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "address": "fa:16:3e:0e:84:69", "network": {"id": "55f5861f-a3bd-4036-b97e-e41fbe61acb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1033512839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap266e9729-66", "ovs_interfaceid": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Converting VIF {"id": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "address": "fa:16:3e:0e:84:69", "network": {"id": "55f5861f-a3bd-4036-b97e-e41fbe61acb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1033512839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap266e9729-66", "ovs_interfaceid": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:84:69,bridge_name='br-int',has_traffic_filtering=True,id=266e9729-66ec-47c1-b5a4-a23e4cb79de6,network=Network(55f5861f-a3bd-4036-b97e-e41fbe61acb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap266e9729-66') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG os_vif [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:84:69,bridge_name='br-int',has_traffic_filtering=True,id=266e9729-66ec-47c1-b5a4-a23e4cb79de6,network=Network(55f5861f-a3bd-4036-b97e-e41fbe61acb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap266e9729-66') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73b2d935-0b42-54a0-b294-b99d86755859', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap266e9729-66, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap266e9729-66, col_values=(('qos', UUID('4ab6e7ab-a3db-47bc-a7b1-1f5f73099a69')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap266e9729-66, col_values=(('external_ids', {'iface-id': '266e9729-66ec-47c1-b5a4-a23e4cb79de6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:84:69', 'vm-uuid': 'eea01f90-3c79-4304-913e-8cf7e9749480'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:05 user nova-compute[74611]: INFO os_vif [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:84:69,bridge_name='br-int',has_traffic_filtering=True,id=266e9729-66ec-47c1-b5a4-a23e4cb79de6,network=Network(55f5861f-a3bd-4036-b97e-e41fbe61acb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap266e9729-66')
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-560513437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-560513437',id=8,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeQwNIdKbZkcJ1bL6vxLyRaw/tiXK1lBMCzqrmneLrH3GH4oV5/eRe+ZKc6KvSL9xj8s0omUXtq4rOBJVCBpsYTYfMFZFh2iLGaIRkl6/UO9iRuPbpk3z3yXYcyxqHiGw==',key_name='tempest-keypair-788651981',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:54:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f6f36a09d514934ab7e11e7e945658f',ramdisk_id='',reservation_id='r-o8x6c9da',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-987448261',owner_user_name='tempest-TaggedAttachmentsTest-987448261-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:54:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4627e309322495f90a6e412f7e36c75',uuid=eea01f90-3c79-4304-913e-8cf7e9749480,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "address": "fa:16:3e:0e:84:69", "network": {"id": "55f5861f-a3bd-4036-b97e-e41fbe61acb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1033512839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap266e9729-66", "ovs_interfaceid": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Converting VIF {"id": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "address": "fa:16:3e:0e:84:69", "network": {"id": "55f5861f-a3bd-4036-b97e-e41fbe61acb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1033512839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap266e9729-66", "ovs_interfaceid": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:84:69,bridge_name='br-int',has_traffic_filtering=True,id=266e9729-66ec-47c1-b5a4-a23e4cb79de6,network=Network(55f5861f-a3bd-4036-b97e-e41fbe61acb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap266e9729-66') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] attach device xml: <interface type="ethernet">
Nov 13 09:56:05 user nova-compute[74611]:   <mac address="fa:16:3e:0e:84:69"/>
Nov 13 09:56:05 user nova-compute[74611]:   <model type="virtio"/>
Nov 13 09:56:05 user nova-compute[74611]:   <mtu size="1442"/>
Nov 13 09:56:05 user nova-compute[74611]:   <target dev="tap266e9729-66"/>
Nov 13 09:56:05 user nova-compute[74611]: </interface>
Nov 13 09:56:05 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquiring lock "54fdbd33-6f7c-440b-968b-cd743e2562c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.objects.instance [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lazy-loading 'flavor' on Instance uuid 54fdbd33-6f7c-440b-968b-cd743e2562c4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-efa1eade-6443-4104-b2e8-9bcd9ab8cb49 req-187b70a5-a205-41e3-a5e5-a3f50395a29c service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received event network-vif-plugged-266e9729-66ec-47c1-b5a4-a23e4cb79de6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-efa1eade-6443-4104-b2e8-9bcd9ab8cb49 req-187b70a5-a205-41e3-a5e5-a3f50395a29c service nova] Acquiring lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-efa1eade-6443-4104-b2e8-9bcd9ab8cb49 req-187b70a5-a205-41e3-a5e5-a3f50395a29c service nova] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-efa1eade-6443-4104-b2e8-9bcd9ab8cb49 req-187b70a5-a205-41e3-a5e5-a3f50395a29c service nova] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-efa1eade-6443-4104-b2e8-9bcd9ab8cb49 req-187b70a5-a205-41e3-a5e5-a3f50395a29c service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] No waiting events found dispatching network-vif-plugged-266e9729-66ec-47c1-b5a4-a23e4cb79de6 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:05 user nova-compute[74611]: WARNING nova.compute.manager [req-efa1eade-6443-4104-b2e8-9bcd9ab8cb49 req-187b70a5-a205-41e3-a5e5-a3f50395a29c service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received unexpected event network-vif-plugged-266e9729-66ec-47c1-b5a4-a23e4cb79de6 for instance with vm_state active and task_state None.
Nov 13 09:56:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.network.neutron [req-dd0f6abc-e4a5-4ee8-b062-36d6d0914246 req-ebc2da68-019e-4393-ae31-43e1e932ece2 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Updated VIF entry in instance network info cache for port 266e9729-66ec-47c1-b5a4-a23e4cb79de6. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.network.neutron [req-dd0f6abc-e4a5-4ee8-b062-36d6d0914246 req-ebc2da68-019e-4393-ae31-43e1e932ece2 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Updating instance_info_cache with network_info: [{"id": "805b4d7d-b250-40e4-af31-e9f281182115", "address": "fa:16:3e:05:dc:a6", "network": {"id": "76b58f11-8450-4eea-b1c5-996e7112fd8b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1065019570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap805b4d7d-b2", "ovs_interfaceid": "805b4d7d-b250-40e4-af31-e9f281182115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "address": "fa:16:3e:0e:84:69", "network": {"id": "55f5861f-a3bd-4036-b97e-e41fbe61acb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1033512839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap266e9729-66", "ovs_interfaceid": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dd0f6abc-e4a5-4ee8-b062-36d6d0914246 req-ebc2da68-019e-4393-ae31-43e1e932ece2 service nova] Releasing lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] No BDM found with device name hda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] No VIF found with MAC fa:16:3e:05:dc:a6, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:56:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:56:05 user nova-compute[74611]:   <nova:package version="0.0.0"/>
Nov 13 09:56:05 user nova-compute[74611]:   <nova:name>tempest-device-tagging-server-560513437</nova:name>
Nov 13 09:56:05 user nova-compute[74611]:   <nova:creationTime>2023-11-13 09:56:05</nova:creationTime>
Nov 13 09:56:05 user nova-compute[74611]:   <nova:flavor name="m1.tiny">
Nov 13 09:56:05 user nova-compute[74611]:     <nova:memory>512</nova:memory>
Nov 13 09:56:05 user nova-compute[74611]:     <nova:disk>1</nova:disk>
Nov 13 09:56:05 user nova-compute[74611]:     <nova:swap>0</nova:swap>
Nov 13 09:56:05 user nova-compute[74611]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:56:05 user nova-compute[74611]:     <nova:vcpus>1</nova:vcpus>
Nov 13 09:56:05 user nova-compute[74611]:   </nova:flavor>
Nov 13 09:56:05 user nova-compute[74611]:   <nova:owner>
Nov 13 09:56:05 user nova-compute[74611]:     <nova:user uuid="a4627e309322495f90a6e412f7e36c75">tempest-TaggedAttachmentsTest-987448261-project-member</nova:user>
Nov 13 09:56:05 user nova-compute[74611]:     <nova:project uuid="9f6f36a09d514934ab7e11e7e945658f">tempest-TaggedAttachmentsTest-987448261</nova:project>
Nov 13 09:56:05 user nova-compute[74611]:   </nova:owner>
Nov 13 09:56:05 user nova-compute[74611]:   <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:56:05 user nova-compute[74611]:   <nova:ports>
Nov 13 09:56:05 user nova-compute[74611]:     <nova:port uuid="805b4d7d-b250-40e4-af31-e9f281182115">
Nov 13 09:56:05 user nova-compute[74611]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 09:56:05 user nova-compute[74611]:     </nova:port>
Nov 13 09:56:05 user nova-compute[74611]:     <nova:port uuid="266e9729-66ec-47c1-b5a4-a23e4cb79de6">
Nov 13 09:56:05 user nova-compute[74611]:       <nova:ip type="fixed" address="10.10.10.152" ipVersion="4"/>
Nov 13 09:56:05 user nova-compute[74611]:     </nova:port>
Nov 13 09:56:05 user nova-compute[74611]:   </nova:ports>
Nov 13 09:56:05 user nova-compute[74611]: </nova:instance>
Nov 13 09:56:05 user nova-compute[74611]:  {{(pid=74611) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b698e65f-209c-4d60-b41b-e72488af6e9c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "interface-eea01f90-3c79-4304-913e-8cf7e9749480-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.617s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquiring lock "54fdbd33-6f7c-440b-968b-cd743e2562c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:06 user nova-compute[74611]: INFO nova.compute.manager [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Attaching volume 3863dafc-22d1-452e-b874-fd318327f8c0 to /dev/sdc
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.utils [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea035971-6c39-40b3-bf8e-27362e677304]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de6d824-6fcb-42a3-b77f-218701538d98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf977e8-11cb-4dde-8682-7d72a903c53a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b36eaa-56a7-4548-bc2d-38fd52b12ee4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:56:06 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d92f811-3a9c-47f3-a264-c0ec5256e91d]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.utils [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Updating existing volume attachment record: 86615585-9e97-44b3-b003-5b61c35b8ec3 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "eea01f90-3c79-4304-913e-8cf7e9749480" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "eea01f90-3c79-4304-913e-8cf7e9749480" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG nova.objects.instance [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lazy-loading 'flavor' on Instance uuid eea01f90-3c79-4304-913e-8cf7e9749480 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "eea01f90-3c79-4304-913e-8cf7e9749480" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "eea01f90-3c79-4304-913e-8cf7e9749480" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "eea01f90-3c79-4304-913e-8cf7e9749480" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:06 user nova-compute[74611]: INFO nova.compute.manager [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Attaching volume ea5dc3e0-c232-41cf-b67f-668802896b40 to /dev/vdb
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.utils [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[84040aa6-045a-4777-8716-793e8616f4f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66f49d6-38a8-4d2b-a367-1efff9f6c7d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb5e78e-9612-4fb6-95a6-889ab33fdd83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce303c60-fd75-435f-844f-a5905048b1e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:56:06 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14386c3-e49a-4e9b-a6c9-18c3ade95e2e]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.utils [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Updating existing volume attachment record: b45e51f9-6c24-43d2-84d9-47276728ad52 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtlAmsfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:06 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:06 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:06 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1e9857-5002-4c6b-a30b-aa1bb6e104f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:56:06 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a5072d-0e37-4534-976e-ff70d9eda7af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957] added
Nov 13 09:56:06 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[090ff4b7-ce9a-43c7-b15a-815e66937ba4]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcb20ea-2b77-4f64-a683-6b2b669ff97c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JtlAmsfG {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JtlAmsfG" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[772398f5-8ae5-45d8-8cf8-3b4696d74c46]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JtlAmsfG'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b845596-767a-4bdb-a4e0-446b2fd2d641]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4a8569-3cf4-4a8e-8bc4-d2b65e56bd5c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:07 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:07 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a7bd4e-0a04-43a5-a199-15e8c7d823ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957, portal: 172.16.0.220,3260]
Nov 13 09:56:07 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:07 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ff02ef-98f1-4f33-bf71-8527c423b476]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2f0927-747d-4afd-a2eb-69dc1a49b59f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:07 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:07 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:07 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef226e6-e2e7-4cfe-af70-9445eeee0bb4]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtlAmsfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-81df3aa3-040c-4d7b-ae11-ff2ea8eece77 req-b876b95e-0a6e-43b5-b84f-e2cd90c39fc1 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received event network-vif-plugged-266e9729-66ec-47c1-b5a4-a23e4cb79de6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-81df3aa3-040c-4d7b-ae11-ff2ea8eece77 req-b876b95e-0a6e-43b5-b84f-e2cd90c39fc1 service nova] Acquiring lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-81df3aa3-040c-4d7b-ae11-ff2ea8eece77 req-b876b95e-0a6e-43b5-b84f-e2cd90c39fc1 service nova] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-81df3aa3-040c-4d7b-ae11-ff2ea8eece77 req-b876b95e-0a6e-43b5-b84f-e2cd90c39fc1 service nova] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-81df3aa3-040c-4d7b-ae11-ff2ea8eece77 req-b876b95e-0a6e-43b5-b84f-e2cd90c39fc1 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] No waiting events found dispatching network-vif-plugged-266e9729-66ec-47c1-b5a4-a23e4cb79de6 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:07 user nova-compute[74611]: WARNING nova.compute.manager [req-81df3aa3-040c-4d7b-ae11-ff2ea8eece77 req-b876b95e-0a6e-43b5-b84f-e2cd90c39fc1 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received unexpected event network-vif-plugged-266e9729-66ec-47c1-b5a4-a23e4cb79de6 for instance with vm_state active and task_state None.
Nov 13 09:56:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23634666235316432', 'path': '/dev/sdg'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634666235316432', 'path': '/dev/sdg'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:56:08 user nova-compute[74611]: DEBUG nova.objects.instance [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lazy-loading 'flavor' on Instance uuid 5b70fc11-140f-4c9a-9e75-2b33705d8c6d {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 09:56:08 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:56:08 user nova-compute[74611]:   <source dev="/dev/sdg"/>
Nov 13 09:56:08 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:56:08 user nova-compute[74611]:   <serial>f3079aaf-9e56-4219-a7ef-32f459f61957</serial>
Nov 13 09:56:08 user nova-compute[74611]: </disk>
Nov 13 09:56:08 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 09:56:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:56:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:56:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] No VIF found with MAC fa:16:3e:88:fb:1e, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:56:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5f874f69-51f8-4b37-8489-dd65a5c58c95 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.956s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Acquiring lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:09 user nova-compute[74611]: DEBUG os_brick.utils [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:09 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2d2993-ed9b-4dab-83d5-9cbddcf6823b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:09 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5ee6aa-3db7-4e7f-8671-809277f85d76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:09 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3a212e-4e9b-45a9-9b15-0cfdc053f524]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:09 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3023d573-2531-4f2d-961b-44c5c09d2e91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:56:10 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3eb15cc-40ff-47ff-8fd6-80ca3ea4023a]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.utils [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:10 user nova-compute[74611]: INFO nova.compute.manager [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Swapping volume f3079aaf-9e56-4219-a7ef-32f459f61957 for a8d685e6-eef6-4b7f-aa34-2f21201212da
Nov 13 09:56:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctUzPoEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:10 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:10 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:10 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f94f79a-25a0-47c2-bab3-679127a2e907]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:56:10 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b18ec0-944e-4a1e-b83c-86dd20cb5082]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0] added
Nov 13 09:56:10 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a54f2f4-f3f3-4009-b6d5-c8c9bbbb08d1]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39e051a-1423-4ee4-a429-4a2f1e6106b6]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ctUzPoEx {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ctUzPoEx" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1637842-4b1c-4a94-bbd3-794bcd915630]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ctUzPoEx'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[75024b2c-0681-4b33-bd03-ddb3bc8d9111]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5637260a-1b08-47d2-9304-4d020fe46a0a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:10 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:10 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa797327-85e5-4e5f-98ad-600c67f0a0df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0, portal: 172.16.0.220,3260]
Nov 13 09:56:10 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:10 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e251c4-a43f-478e-b9f1-8da402630201]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[87db78db-42f7-4224-9818-281ee5649176]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:10 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:10 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:10 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[648a93f5-dea2-42a2-8e2c-fcadca7449d8]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctUzPoEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dAeGJlbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:10 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23533356530396333', 'path': '/dev/sdh'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533356530396333', 'path': '/dev/sdh'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.777s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:11 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:11 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG nova.objects.instance [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lazy-loading 'flavor' on Instance uuid 54fdbd33-6f7c-440b-968b-cd743e2562c4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[66187c62-99f5-4430-b898-1759e0da8ee6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:56:11 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 09:56:11 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:56:11 user nova-compute[74611]:   <source dev="/dev/sdh"/>
Nov 13 09:56:11 user nova-compute[74611]:   <target dev="sdc" bus="scsi"/>
Nov 13 09:56:11 user nova-compute[74611]:   <serial>3863dafc-22d1-452e-b874-fd318327f8c0</serial>
Nov 13 09:56:11 user nova-compute[74611]:   <address type="drive" controller="0" unit="2"/>
Nov 13 09:56:11 user nova-compute[74611]: </disk>
Nov 13 09:56:11 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[417b1a43-e2f4-450e-8f2f-cd4040b61ad6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40] added
Nov 13 09:56:11 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5366f2aa-b3b5-4820-b8d7-8d813b87e396]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9877a0-042b-4dda-b560-13eaf3a70d54]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dAeGJlbP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dAeGJlbP" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21a8dd7-c022-41b9-b2cf-2ef4cc4fb756]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dAeGJlbP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1a5657-53b9-47f8-8c46-fdd10d630516]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f42a23-9fd7-42bf-8e3c-82bc2a734d75]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:11 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:11 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:11 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:11 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:11 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:11 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:11 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:11 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:11 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:11 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:11 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:11 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:11 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:11 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f821a255-4f59-43dd-ba72-42fb507277f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40, portal: 172.16.0.220,3260]
Nov 13 09:56:12 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:12 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15eff1a-2e5c-4a3f-ba30-dede4c4094e7]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ea17d3-5819-4417-8c3d-81a633acdc00]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:12 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:12 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:12 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:12 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:12 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:12 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:12 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:12 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:12 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:12 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:12 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:12 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:12 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:12 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:12 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:12 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4902e2-1e8e-4e09-ab75-7feda678a14a]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dAeGJlbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] No BDM found with device name sda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] No VIF found with MAC fa:16:3e:7d:87:b9, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:56:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-56177ef8-1e2c-4b57-8c61-448764889da3 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.283s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquiring lock "54fdbd33-6f7c-440b-968b-cd743e2562c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:13 user nova-compute[74611]: INFO nova.compute.manager [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Detaching volume 3863dafc-22d1-452e-b874-fd318327f8c0
Nov 13 09:56:13 user nova-compute[74611]: INFO nova.virt.block_device [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Attempting to driver detach volume 3863dafc-22d1-452e-b874-fd318327f8c0 from mountpoint /dev/sdc
Nov 13 09:56:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] <== connect_volume: return (2166ms) {'type': 'block', 'scsi_wwn': '23932656336313864', 'path': '/dev/sdi'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932656336313864', 'path': '/dev/sdi'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:56:13 user nova-compute[74611]: DEBUG nova.objects.instance [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lazy-loading 'flavor' on Instance uuid eea01f90-3c79-4304-913e-8cf7e9749480 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Attempting to detach device sdc from instance 54fdbd33-6f7c-440b-968b-cd743e2562c4 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 09:56:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 09:56:13 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:56:13 user nova-compute[74611]:   <source dev="/dev/sdh"/>
Nov 13 09:56:13 user nova-compute[74611]:   <target dev="sdc" bus="scsi"/>
Nov 13 09:56:13 user nova-compute[74611]:   <serial>3863dafc-22d1-452e-b874-fd318327f8c0</serial>
Nov 13 09:56:13 user nova-compute[74611]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 13 09:56:13 user nova-compute[74611]: </disk>
Nov 13 09:56:13 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:56:13 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Successfully detached device sdc from instance 54fdbd33-6f7c-440b-968b-cd743e2562c4 from the persistent domain config.
Nov 13 09:56:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 54fdbd33-6f7c-440b-968b-cd743e2562c4 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 09:56:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 09:56:13 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:56:13 user nova-compute[74611]:   <source dev="/dev/sdh"/>
Nov 13 09:56:13 user nova-compute[74611]:   <target dev="sdc" bus="scsi"/>
Nov 13 09:56:13 user nova-compute[74611]:   <serial>3863dafc-22d1-452e-b874-fd318327f8c0</serial>
Nov 13 09:56:13 user nova-compute[74611]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 13 09:56:13 user nova-compute[74611]: </disk>
Nov 13 09:56:13 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:56:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 09:56:13 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:56:13 user nova-compute[74611]:   <source dev="/dev/sdi"/>
Nov 13 09:56:13 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:56:13 user nova-compute[74611]:   <serial>ea5dc3e0-c232-41cf-b67f-668802896b40</serial>
Nov 13 09:56:13 user nova-compute[74611]: </disk>
Nov 13 09:56:13 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 09:56:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:56:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] No BDM found with device name hda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:56:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] No VIF found with MAC fa:16:3e:05:dc:a6, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:56:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ac30f6f9-1de7-4d6f-a697-9ae6a68e378c tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "eea01f90-3c79-4304-913e-8cf7e9749480" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.074s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 54fdbd33-6f7c-440b-968b-cd743e2562c4 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQpslTNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b70fc11-140f-4c9a-9e75-2b33705d8c6d', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8d685e6-eef6-4b7f-aa34-2f21201212da', 'serial': 'a8d685e6-eef6-4b7f-aa34-2f21201212da'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtlAmsfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '5b70fc11-140f-4c9a-9e75-2b33705d8c6d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3079aaf-9e56-4219-a7ef-32f459f61957', 'serial'} {{(pid=74611) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQpslTNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:14 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:14 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:14 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba6daf1-5c81-4508-99be-d86f641d641c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:56:14 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48ee683-b753-4b0a-93d0-e074a7995d7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da] added
Nov 13 09:56:14 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.121s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9160c624-9cdf-4ccb-8d3f-d83b51bb001f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f5578a-e692-44ae-8186-442749d9cf24]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UQpslTNL {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UQpslTNL" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4888e52d-e72f-4ba9-9d31-036a2181dfa2]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UQpslTNL'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-3c8b8514-4ad5-4e56-902c-cc33fbaa2387 req-f4521719-77d5-4fc4-b4b8-21ccf7e0c022 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Received event network-changed-488eb964-98e4-4e75-ba87-fc1840497377 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-3c8b8514-4ad5-4e56-902c-cc33fbaa2387 req-f4521719-77d5-4fc4-b4b8-21ccf7e0c022 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Refreshing instance network info cache due to event network-changed-488eb964-98e4-4e75-ba87-fc1840497377. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3c8b8514-4ad5-4e56-902c-cc33fbaa2387 req-f4521719-77d5-4fc4-b4b8-21ccf7e0c022 service nova] Acquiring lock "refresh_cache-8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3c8b8514-4ad5-4e56-902c-cc33fbaa2387 req-f4521719-77d5-4fc4-b4b8-21ccf7e0c022 service nova] Acquired lock "refresh_cache-8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG nova.network.neutron [req-3c8b8514-4ad5-4e56-902c-cc33fbaa2387 req-f4521719-77d5-4fc4-b4b8-21ccf7e0c022 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Refreshing network info cache for port 488eb964-98e4-4e75-ba87-fc1840497377 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[16813561-0feb-4dbb-bb56-41c87208014d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f8cd0b-06e0-4159-bc64-bc77240f3079]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:14 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:14 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a73aae-f730-40c9-a2f9-bb43d5fa83ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da, portal: 172.16.0.220,3260]
Nov 13 09:56:14 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:14 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e0dcde-a8b1-4ffa-a74f-ab0ab15f8280]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[acda96f3-d9f4-473d-83ef-c6bd391169f7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:14 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:14 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:14 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.434s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1a3f30-8300-468e-8f75-64abbdda1654]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQpslTNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Acquiring lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:14 user nova-compute[74611]: DEBUG nova.objects.instance [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Lazy-loading 'flavor' on Instance uuid 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "eea01f90-3c79-4304-913e-8cf7e9749480" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "eea01f90-3c79-4304-913e-8cf7e9749480" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:15 user nova-compute[74611]: INFO nova.compute.manager [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Detaching volume ea5dc3e0-c232-41cf-b67f-668802896b40
Nov 13 09:56:15 user nova-compute[74611]: INFO nova.virt.block_device [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Attempting to driver detach volume ea5dc3e0-c232-41cf-b67f-668802896b40 from mountpoint /dev/vdb
Nov 13 09:56:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Attempting to detach device vdb from instance eea01f90-3c79-4304-913e-8cf7e9749480 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 09:56:15 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:56:15 user nova-compute[74611]:   <source dev="/dev/sdi"/>
Nov 13 09:56:15 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:56:15 user nova-compute[74611]:   <serial>ea5dc3e0-c232-41cf-b67f-668802896b40</serial>
Nov 13 09:56:15 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 09:56:15 user nova-compute[74611]: </disk>
Nov 13 09:56:15 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Acquiring lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:15 user nova-compute[74611]: INFO nova.compute.manager [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Attaching volume 0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed to /dev/vdb
Nov 13 09:56:15 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Successfully detached device vdb from instance eea01f90-3c79-4304-913e-8cf7e9749480 from the persistent domain config.
Nov 13 09:56:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eea01f90-3c79-4304-913e-8cf7e9749480 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 09:56:15 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:56:15 user nova-compute[74611]:   <source dev="/dev/sdi"/>
Nov 13 09:56:15 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:56:15 user nova-compute[74611]:   <serial>ea5dc3e0-c232-41cf-b67f-668802896b40</serial>
Nov 13 09:56:15 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 09:56:15 user nova-compute[74611]: </disk>
Nov 13 09:56:15 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG os_brick.utils [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be907cd-f4cb-4a15-92d4-21017496c7cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7e1a4b-d9c5-4311-a67a-3f975067ceab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.070s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a03e93f-eb06-4342-95eb-037fc484177e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4ae2a8-e48c-4f24-87fa-02dd7997139b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG nova.network.neutron [req-3c8b8514-4ad5-4e56-902c-cc33fbaa2387 req-f4521719-77d5-4fc4-b4b8-21ccf7e0c022 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Updated VIF entry in instance network info cache for port 488eb964-98e4-4e75-ba87-fc1840497377. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG nova.network.neutron [req-3c8b8514-4ad5-4e56-902c-cc33fbaa2387 req-f4521719-77d5-4fc4-b4b8-21ccf7e0c022 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Updating instance_info_cache with network_info: [{"id": "488eb964-98e4-4e75-ba87-fc1840497377", "address": "fa:16:3e:e4:cf:27", "network": {"id": "7f214546-77f6-41eb-862b-32bc271a8a52", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028523718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd8a9b04d5a4f65817ea43a6d5b1d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488eb964-98", "ovs_interfaceid": "488eb964-98e4-4e75-ba87-fc1840497377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3c8b8514-4ad5-4e56-902c-cc33fbaa2387 req-f4521719-77d5-4fc4-b4b8-21ccf7e0c022 service nova] Releasing lock "refresh_cache-8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:56:15 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:56:15 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b553d9e4-d31b-4193-acb5-dd524d8d3f42]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG os_brick.utils [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Updating existing volume attachment record: b034e402-8571-418a-950f-557dc99a16ed {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eea01f90-3c79-4304-913e-8cf7e9749480 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.473s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] <== connect_volume: return (1474ms) {'type': 'block', 'scsi_wwn': '23032396638666133', 'path': '/dev/sdj'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032396638666133', 'path': '/dev/sdj'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:56:15 user nova-compute[74611]: DEBUG nova.objects.instance [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lazy-loading 'flavor' on Instance uuid 5b70fc11-140f-4c9a-9e75-2b33705d8c6d {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 122683392 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 227540992 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 403701760 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 548405248 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 686817280 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 817889280 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 903872512 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 1000341504 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TNolwqLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:20 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:20 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:20 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b576029-5883-497f-948a-80d09439a108]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:56:20 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5de214-1005-4b89-bdfa-8c170e2462da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed] added
Nov 13 09:56:20 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22e906d-0392-46f5-82fe-5e0e6188b583]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71136cd-06eb-47ab-9640-fd66702edd38]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TNolwqLg {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TNolwqLg" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4555b9f1-b694-4ec1-946f-f6fe79c129c0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TNolwqLg'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdf3b29-2353-4c75-911f-dbd8cc452443]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f20a12c-f41b-46e3-8f76-70d59d5912d5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:20 user nova-compute[74611]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:20 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:20 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:20 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:20 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:20 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:20 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:20 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:20 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:20 user nova-compute[74611]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:20 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:20 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:20 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:20 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:20 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:20 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:20 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:20 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c856e4-bea5-4b87-a1ff-ea6ddf327864]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed, portal: 172.16.0.220,3260]
Nov 13 09:56:21 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:21 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.043s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[739a2446-a9e0-4474-9eb4-97f9b375ec9d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtlAmsfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:21 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:21 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d13ab25-d036-4613-89cf-43a1a66223da]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:21 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:21 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:21 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[78093516-1761-4831-82c6-f893c265e0ad]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:56:21 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TNolwqLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23461633032313264', 'path': '/dev/sdk'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461633032313264', 'path': '/dev/sdk'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.080s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG nova.objects.instance [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Lazy-loading 'flavor' on Instance uuid 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1e7bb0-4181-4754-a0b7-87ee2cd94bcd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 09:56:22 user nova-compute[74611]: No targets found.
Nov 13 09:56:22 user nova-compute[74611]: iSNS:
Nov 13 09:56:22 user nova-compute[74611]: No targets found.
Nov 13 09:56:22 user nova-compute[74611]: STATIC:
Nov 13 09:56:22 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e
Nov 13 09:56:22 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:22 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:22 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f
Nov 13 09:56:22 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:22 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:22 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e
Nov 13 09:56:22 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:22 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:22 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4
Nov 13 09:56:22 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:22 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:22 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da
Nov 13 09:56:22 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:22 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:22 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957
Nov 13 09:56:22 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:22 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:22 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d
Nov 13 09:56:22 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:22 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:22 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40
Nov 13 09:56:22 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:22 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:22 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0
Nov 13 09:56:22 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:22 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:22 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed
Nov 13 09:56:22 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:22 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:22 user nova-compute[74611]: FIRMWARE:
Nov 13 09:56:22 user nova-compute[74611]: No targets found.
Nov 13 09:56:22 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 09:56:22 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 09:56:22 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9be2e44-fc06-4263-8e44-4670b87dea65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] attach device xml: <disk type="block" device="disk">
Nov 13 09:56:22 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:56:22 user nova-compute[74611]:   <source dev="/dev/sdk"/>
Nov 13 09:56:22 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:56:22 user nova-compute[74611]:   <serial>0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed</serial>
Nov 13 09:56:22 user nova-compute[74611]: </disk>
Nov 13 09:56:22 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8037da-81d6-4aea-bc38-220d0ffd4dba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:22 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:22 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:22 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7c2b6cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957'): ({'sdg'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Removing single pathed devices sdg {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9c1e7e-8d42-4f03-a5c4-b336a322726b]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e472070-f98e-4573-aab2-9ad7e5aa8bc2]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Flushing IO for device /dev/sdg {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4efd392-726f-4488-99eb-65125d84b664]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[663157c4-b642-47fb-b511-b95e3cdfaba8]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] SCSI volumes sdg have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e823aecd-e34b-4625-96a9-b7623ed794b3]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2ef94a-de84-4738-80b3-aedcbbc20310]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957, portal: 172.16.0.220,3260]
Nov 13 09:56:22 user nova-compute[74611]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:22 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce3d683-dd82-4bb9-94e0-b55ed9cd6999]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] <== disconnect_volume: return (1442ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG nova.compute.manager [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQpslTNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '5b70fc11-140f-4c9a-9e75-2b33705d8c6d', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8d685e6-eef6-4b7f-aa34-2f21201212da', 'serial'} {{(pid=74611) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG nova.compute.manager [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] swap_volume: removing Cinder connection for volume f3079aaf-9e56-4219-a7ef-32f459f61957 {{(pid=74611) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] No VIF found with MAC fa:16:3e:e4:cf:27, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:56:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2549fa3-3b95-4cca-ac42-7367ea378af7 tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.597s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-725b3fe9-d3d7-419f-a303-ffcdc45eb4f3 tempest-VolumesAssistedSnapshotsTest-2048205233 tempest-VolumesAssistedSnapshotsTest-2048205233-project] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] volume_snapshot_create: create_info: {'snapshot_id': '8febe8d3-30ca-4128-9321-25effe0ebbb2', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74611) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 13 09:56:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-725b3fe9-d3d7-419f-a303-ffcdc45eb4f3 tempest-VolumesAssistedSnapshotsTest-2048205233 tempest-VolumesAssistedSnapshotsTest-2048205233-project] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] snap xml: <domainsnapshot>
Nov 13 09:56:23 user nova-compute[74611]:   <disks>
Nov 13 09:56:23 user nova-compute[74611]:     <disk name="/dev/sdk" snapshot="external" type="file">
Nov 13 09:56:23 user nova-compute[74611]:       <source file="/dev/new_file"/>
Nov 13 09:56:23 user nova-compute[74611]:     </disk>
Nov 13 09:56:23 user nova-compute[74611]:     <disk name="vda" snapshot="no"/>
Nov 13 09:56:23 user nova-compute[74611]:   </disks>
Nov 13 09:56:23 user nova-compute[74611]: </domainsnapshot>
Nov 13 09:56:23 user nova-compute[74611]:  {{(pid=74611) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 13 09:56:23 user nova-compute[74611]: DEBUG nova.objects.instance [None req-725b3fe9-d3d7-419f-a303-ffcdc45eb4f3 tempest-VolumesAssistedSnapshotsTest-2048205233 tempest-VolumesAssistedSnapshotsTest-2048205233-project] Lazy-loading 'system_metadata' on Instance uuid 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:23 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-725b3fe9-d3d7-419f-a303-ffcdc45eb4f3 tempest-VolumesAssistedSnapshotsTest-2048205233 tempest-VolumesAssistedSnapshotsTest-2048205233-project] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [None req-725b3fe9-d3d7-419f-a303-ffcdc45eb4f3 tempest-VolumesAssistedSnapshotsTest-2048205233 tempest-VolumesAssistedSnapshotsTest-2048205233-project] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Traceback (most recent call last):
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     rv = execute(f, *args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     six.reraise(c, e, tb)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     raise value
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     rv = meth(*args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] 
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [None req-725b3fe9-d3d7-419f-a303-ffcdc45eb4f3 tempest-VolumesAssistedSnapshotsTest-2048205233 tempest-VolumesAssistedSnapshotsTest-2048205233-project] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Traceback (most recent call last):
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     self._volume_snapshot_create(context, instance, guest,
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     rv = execute(f, *args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     six.reraise(c, e, tb)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     raise value
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     rv = meth(*args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] 
Nov 13 09:56:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-883898ef-1d22-4bb9-94ba-aa780b0f2670 tempest-VolumesAssistedSnapshotsTest-2048205233 tempest-VolumesAssistedSnapshotsTest-2048205233-project] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] volume_snapshot_delete: delete_info: {'volume_id': '0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed'} {{(pid=74611) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [None req-883898ef-1d22-4bb9-94ba-aa780b0f2670 tempest-VolumesAssistedSnapshotsTest-2048205233 tempest-VolumesAssistedSnapshotsTest-2048205233-project] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Traceback (most recent call last):
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c]     if delete_info['type'] != 'qcow2':
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] KeyError: 'type'
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] 
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [None req-725b3fe9-d3d7-419f-a303-ffcdc45eb4f3 tempest-VolumesAssistedSnapshotsTest-2048205233 tempest-VolumesAssistedSnapshotsTest-2048205233-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 8febe8d3-30ca-4128-9321-25effe0ebbb2 could not be found.
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     raise value
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver 
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver 
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 8febe8d3-30ca-4128-9321-25effe0ebbb2 could not be found. (HTTP 404) (Request-ID: req-4405abdc-46dd-4de1-89f2-a1d0b1824deb)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver 
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver 
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 8febe8d3-30ca-4128-9321-25effe0ebbb2 could not be found.
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver 
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server [None req-725b3fe9-d3d7-419f-a303-ffcdc45eb4f3 tempest-VolumesAssistedSnapshotsTest-2048205233 tempest-VolumesAssistedSnapshotsTest-2048205233-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     raise value
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server 
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver [None req-883898ef-1d22-4bb9-94ba-aa780b0f2670 tempest-VolumesAssistedSnapshotsTest-2048205233 tempest-VolumesAssistedSnapshotsTest-2048205233-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver 
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver 
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-74f0ee07-4e7b-4c36-81c2-05438168b76c)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver 
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver 
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 13 09:56:23 user nova-compute[74611]: ERROR nova.virt.libvirt.driver 
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server [None req-883898ef-1d22-4bb9-94ba-aa780b0f2670 tempest-VolumesAssistedSnapshotsTest-2048205233 tempest-VolumesAssistedSnapshotsTest-2048205233-project] Exception during message handling: KeyError: 'type'
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 13 09:56:23 user nova-compute[74611]: ERROR oslo_messaging.rpc.server 
Nov 13 09:56:23 user nova-compute[74611]: DEBUG nova.compute.manager [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] swap_volume: Updating volume f3079aaf-9e56-4219-a7ef-32f459f61957 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "UQpslTNL", "auth_password": "Ms5uelKtw9FWRq", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "a8d685e6-eef6-4b7f-aa34-2f21201212da"}, "status": "reserved", "instance": "5b70fc11-140f-4c9a-9e75-2b33705d8c6d", "attached_at": "", "detached_at": "", "volume_id": "a8d685e6-eef6-4b7f-aa34-2f21201212da", "serial": "a8d685e6-eef6-4b7f-aa34-2f21201212da"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a8d685e6-eef6-4b7f-aa34-2f21201212da', 'no_device': None, 'attachment_id': '51bb4e25-77ad-4659-98a4-2f165ba60f2f'} {{(pid=74611) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 13 09:56:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-236722de-3b1b-42e7-b479-e05289a3e620 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.459s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Acquiring lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:23 user nova-compute[74611]: INFO nova.compute.manager [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Detaching volume 0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed
Nov 13 09:56:23 user nova-compute[74611]: INFO nova.virt.block_device [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Attempting to driver detach volume 0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed from mountpoint /dev/vdb
Nov 13 09:56:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Attempting to detach device vdb from instance 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 09:56:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] detach device xml: <disk type="block" device="disk">
Nov 13 09:56:23 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:56:23 user nova-compute[74611]:   <source dev="/dev/sdk"/>
Nov 13 09:56:23 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:56:23 user nova-compute[74611]:   <serial>0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed</serial>
Nov 13 09:56:23 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 09:56:23 user nova-compute[74611]: </disk>
Nov 13 09:56:23 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:56:23 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Successfully detached device vdb from instance 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c from the persistent domain config.
Nov 13 09:56:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 09:56:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] detach device xml: <disk type="block" device="disk">
Nov 13 09:56:23 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:56:23 user nova-compute[74611]:   <source dev="/dev/sdk"/>
Nov 13 09:56:23 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:56:23 user nova-compute[74611]:   <serial>0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed</serial>
Nov 13 09:56:23 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 09:56:23 user nova-compute[74611]: </disk>
Nov 13 09:56:23 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Acquiring lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG os_brick.utils [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6546f26b-99e1-4833-b1f4-9f604ef7fc8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9374819a-1305-4cc0-a700-0dbad8e68d49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dc92ba-8586-44e4-88a2-59f3aa381f35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[df354f98-f936-4fe2-9665-97f26908ea53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:56:24 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:56:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1593c9f9-4c51-48b8-acb5-b5ba014e6993]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:56:24 user nova-compute[74611]: DEBUG os_brick.utils [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:24 user nova-compute[74611]: INFO nova.compute.manager [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Swapping volume a8d685e6-eef6-4b7f-aa34-2f21201212da for f3079aaf-9e56-4219-a7ef-32f459f61957
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "794c6567-350a-409c-b1e1-2864b75d73c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "794c6567-350a-409c-b1e1-2864b75d73c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "794c6567-350a-409c-b1e1-2864b75d73c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "794c6567-350a-409c-b1e1-2864b75d73c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "794c6567-350a-409c-b1e1-2864b75d73c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:25 user nova-compute[74611]: INFO nova.compute.manager [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Terminating instance
Nov 13 09:56:25 user nova-compute[74611]: DEBUG nova.compute.manager [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG nova.compute.manager [req-e3a3f238-25cd-47ab-9bc0-535af93fec1e req-8e8425e5-9d7e-4133-95bd-75279d10c38f service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Received event network-vif-unplugged-df64ea8f-f199-43b7-9328-245932527080 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e3a3f238-25cd-47ab-9bc0-535af93fec1e req-8e8425e5-9d7e-4133-95bd-75279d10c38f service nova] Acquiring lock "794c6567-350a-409c-b1e1-2864b75d73c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e3a3f238-25cd-47ab-9bc0-535af93fec1e req-8e8425e5-9d7e-4133-95bd-75279d10c38f service nova] Lock "794c6567-350a-409c-b1e1-2864b75d73c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e3a3f238-25cd-47ab-9bc0-535af93fec1e req-8e8425e5-9d7e-4133-95bd-75279d10c38f service nova] Lock "794c6567-350a-409c-b1e1-2864b75d73c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG nova.compute.manager [req-e3a3f238-25cd-47ab-9bc0-535af93fec1e req-8e8425e5-9d7e-4133-95bd-75279d10c38f service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] No waiting events found dispatching network-vif-unplugged-df64ea8f-f199-43b7-9328-245932527080 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG nova.compute.manager [req-e3a3f238-25cd-47ab-9bc0-535af93fec1e req-8e8425e5-9d7e-4133-95bd-75279d10c38f service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Received event network-vif-unplugged-df64ea8f-f199-43b7-9328-245932527080 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:25 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Instance destroyed successfully.
Nov 13 09:56:25 user nova-compute[74611]: DEBUG nova.objects.instance [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lazy-loading 'resources' on Instance uuid 794c6567-350a-409c-b1e1-2864b75d73c4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:54:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-472750337',display_name='tempest-TestVolumeBootPattern-server-472750337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-472750337',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:54:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-9fyxhafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:54:54Z,user_data=None,user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=794c6567-350a-409c-b1e1-2864b75d73c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df64ea8f-f199-43b7-9328-245932527080", "address": "fa:16:3e:23:b0:8b", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf64ea8f-f1", "ovs_interfaceid": "df64ea8f-f199-43b7-9328-245932527080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "df64ea8f-f199-43b7-9328-245932527080", "address": "fa:16:3e:23:b0:8b", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf64ea8f-f1", "ovs_interfaceid": "df64ea8f-f199-43b7-9328-245932527080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=df64ea8f-f199-43b7-9328-245932527080,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf64ea8f-f1') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG os_vif [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=df64ea8f-f199-43b7-9328-245932527080,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf64ea8f-f1') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf64ea8f-f1, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68e0bb61-4bf1-4338-b5e5-43184534ce96) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:25 user nova-compute[74611]: INFO os_vif [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=df64ea8f-f199-43b7-9328-245932527080,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf64ea8f-f1')
Nov 13 09:56:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLuBlvrS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:25 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9762a472-88a0-4a0b-bf24-b89dc8429f65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 09:56:25 user nova-compute[74611]: No targets found.
Nov 13 09:56:25 user nova-compute[74611]: iSNS:
Nov 13 09:56:25 user nova-compute[74611]: No targets found.
Nov 13 09:56:25 user nova-compute[74611]: STATIC:
Nov 13 09:56:25 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e
Nov 13 09:56:25 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:25 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:25 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f
Nov 13 09:56:25 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:25 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:25 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e
Nov 13 09:56:25 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:25 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:25 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4
Nov 13 09:56:25 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:25 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:25 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da
Nov 13 09:56:25 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:25 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:25 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d
Nov 13 09:56:25 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:25 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:25 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40
Nov 13 09:56:25 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:25 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:25 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0
Nov 13 09:56:25 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:25 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:25 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed
Nov 13 09:56:25 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:25 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:25 user nova-compute[74611]: FIRMWARE:
Nov 13 09:56:25 user nova-compute[74611]: No targets found.
Nov 13 09:56:25 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 09:56:25 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 09:56:25 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f3f2cc-8514-4a45-8f87-d3500b3deebe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fafe75a-24c0-4da1-849b-fc8b620a9e4f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:25 user nova-compute[74611]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:25 user nova-compute[74611]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:25 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:25 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:25 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:25 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:25 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:25 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:25 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:25 user nova-compute[74611]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:25 user nova-compute[74611]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f (non-flash)
Nov 13 09:56:25 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:25 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:25 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:25 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:25 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:25 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:25 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb840e00d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2494fa95-b44e-4dbb-9ffa-eba27dd39acf]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6688f625-6f47-4fd1-b7de-5a35da4b396e]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c6eac1-f655-485f-ba4b-cf8c2f669fd7]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 09:56:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e93a63-fc47-40ca-a246-dd6635a7f79f]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26539303434636264', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_55568309', '/dev/disk/by-id/scsi-1SCST_BIO55568309-e9044cbd7bcb5225') {{(pid=85776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 09:56:26 user nova-compute[74611]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26539303434636264
Nov 13 09:56:26 user nova-compute[74611]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_55568309
Nov 13 09:56:26 user nova-compute[74611]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO55568309-e9044cbd7bcb5225
Nov 13 09:56:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d72d221-e328-4d69-96ff-4ffd45712915]: (4, None) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3276a9-4689-4882-b98a-5a1a8b21884b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[137fe656-ca89-4161-876e-b30fd5740ae0]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f, portal: 172.16.0.220,3260]
Nov 13 09:56:26 user nova-compute[74611]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:26 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4139015-dce3-42af-a5f2-c40c54aa314f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8858a872-40cd-4ae9-8fa1-096733bb5482]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== disconnect_volume: return (364ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 09:56:26 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Deleting instance files /opt/stack/data/nova/instances/794c6567-350a-409c-b1e1-2864b75d73c4_del
Nov 13 09:56:26 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Deletion of /opt/stack/data/nova/instances/794c6567-350a-409c-b1e1-2864b75d73c4_del complete
Nov 13 09:56:26 user nova-compute[74611]: INFO nova.compute.manager [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 13 09:56:26 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:26 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Took 0.45 seconds to deallocate network for instance.
Nov 13 09:56:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-c96660a6-e294-4f20-9f06-07f80255ba3f req-9d4ab049-1c9a-4545-8bbf-f23e18aa2ea8 service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Received event network-vif-deleted-df64ea8f-f199-43b7-9328-245932527080 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:26 user nova-compute[74611]: INFO nova.compute.manager [req-c96660a6-e294-4f20-9f06-07f80255ba3f req-9d4ab049-1c9a-4545-8bbf-f23e18aa2ea8 service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Neutron deleted interface df64ea8f-f199-43b7-9328-245932527080; detaching it from the instance and deleting it from the info cache
Nov 13 09:56:26 user nova-compute[74611]: DEBUG nova.network.neutron [req-c96660a6-e294-4f20-9f06-07f80255ba3f req-9d4ab049-1c9a-4545-8bbf-f23e18aa2ea8 service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-c96660a6-e294-4f20-9f06-07f80255ba3f req-9d4ab049-1c9a-4545-8bbf-f23e18aa2ea8 service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Detach interface failed, port_id=df64ea8f-f199-43b7-9328-245932527080, reason: Instance 794c6567-350a-409c-b1e1-2864b75d73c4 could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 09:56:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-2abcad7f-cfd2-4fef-bc7a-f0d22a1b782d req-d5943578-1f22-4bf8-8446-0351d6cedf80 service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Received event network-vif-plugged-df64ea8f-f199-43b7-9328-245932527080 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2abcad7f-cfd2-4fef-bc7a-f0d22a1b782d req-d5943578-1f22-4bf8-8446-0351d6cedf80 service nova] Acquiring lock "794c6567-350a-409c-b1e1-2864b75d73c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2abcad7f-cfd2-4fef-bc7a-f0d22a1b782d req-d5943578-1f22-4bf8-8446-0351d6cedf80 service nova] Lock "794c6567-350a-409c-b1e1-2864b75d73c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2abcad7f-cfd2-4fef-bc7a-f0d22a1b782d req-d5943578-1f22-4bf8-8446-0351d6cedf80 service nova] Lock "794c6567-350a-409c-b1e1-2864b75d73c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-2abcad7f-cfd2-4fef-bc7a-f0d22a1b782d req-d5943578-1f22-4bf8-8446-0351d6cedf80 service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] No waiting events found dispatching network-vif-plugged-df64ea8f-f199-43b7-9328-245932527080 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:27 user nova-compute[74611]: WARNING nova.compute.manager [req-2abcad7f-cfd2-4fef-bc7a-f0d22a1b782d req-d5943578-1f22-4bf8-8446-0351d6cedf80 service nova] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Received unexpected event network-vif-plugged-df64ea8f-f199-43b7-9328-245932527080 for instance with vm_state active and task_state deleting.
Nov 13 09:56:27 user nova-compute[74611]: INFO nova.compute.manager [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Took 0.71 seconds to detach 1 volumes for instance.
Nov 13 09:56:27 user nova-compute[74611]: DEBUG nova.compute.manager [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 794c6567-350a-409c-b1e1-2864b75d73c4] Deleting volume: a4139015-dce3-42af-a5f2-c40c54aa314f {{(pid=74611) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 09:56:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:28 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Deleted allocations for instance 794c6567-350a-409c-b1e1-2864b75d73c4
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8baeddae-340f-434b-aee9-1c185b3dd1e3 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "794c6567-350a-409c-b1e1-2864b75d73c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.273s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtlAmsfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b70fc11-140f-4c9a-9e75-2b33705d8c6d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3079aaf-9e56-4219-a7ef-32f459f61957', 'serial': 'f3079aaf-9e56-4219-a7ef-32f459f61957'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQpslTNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'a8d685e6-eef6-4b7f-aa34-2f21201212da'}, 'status': 'reserved', 'instance': '5b70fc11-140f-4c9a-9e75-2b33705d8c6d', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8d685e6-eef6-4b7f-aa34-2f21201212da', 'serial'} {{(pid=74611) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtlAmsfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:28 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:28 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:28 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfb174d-ba56-4da6-9e34-be56e531bfb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:56:28 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb95354-0dd9-49fc-8d8d-06d7dc9f09ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957] added
Nov 13 09:56:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa723e9d-7c7d-42dd-b609-1f15ffdeb5d4]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1f6e5e-f9da-4a34-be04-9a37aa712f8f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JtlAmsfG {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JtlAmsfG" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04d9a1c-b847-4664-9ac0-bb26fef58463]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JtlAmsfG'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9087cb0-08b4-4244-9337-8b3ded98d36c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[093fd752-59cd-4c6a-8292-3ee28f08bc81]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:28 user nova-compute[74611]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:28 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:28 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:28 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:28 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:28 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:28 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:28 user nova-compute[74611]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:28 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:28 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:28 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:28 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:28 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:28 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01e9b86-8402-4bf0-9acf-d971b6893272]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957, portal: 172.16.0.220,3260]
Nov 13 09:56:29 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[914b02af-a332-4775-887b-89ca8481291e]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ecb670-1752-44cc-b3ec-34733757250f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:29 user nova-compute[74611]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:29 user nova-compute[74611]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:29 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:29 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:29 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:29 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:29 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:29 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:29 user nova-compute[74611]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:29 user nova-compute[74611]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:29 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:29 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:29 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:29 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:29 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:29 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[963e1652-ea59-4d0a-bd9e-e4f4eec47560]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:56:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtlAmsfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:56:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23634666235316432', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634666235316432', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:56:30 user nova-compute[74611]: DEBUG nova.objects.instance [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lazy-loading 'flavor' on Instance uuid 5b70fc11-140f-4c9a-9e75-2b33705d8c6d {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 90177536 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:31 user nova-compute[74611]: DEBUG nova.compute.manager [req-cdadeef0-2610-4601-80a2-84f8a9a86c3b req-2f1a042b-fe05-47d3-a2b1-762d63a2e5f2 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-changed-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:31 user nova-compute[74611]: DEBUG nova.compute.manager [req-cdadeef0-2610-4601-80a2-84f8a9a86c3b req-2f1a042b-fe05-47d3-a2b1-762d63a2e5f2 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Refreshing instance network info cache due to event network-changed-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:56:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cdadeef0-2610-4601-80a2-84f8a9a86c3b req-2f1a042b-fe05-47d3-a2b1-762d63a2e5f2 service nova] Acquiring lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:56:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cdadeef0-2610-4601-80a2-84f8a9a86c3b req-2f1a042b-fe05-47d3-a2b1-762d63a2e5f2 service nova] Acquired lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:56:31 user nova-compute[74611]: DEBUG nova.network.neutron [req-cdadeef0-2610-4601-80a2-84f8a9a86c3b req-2f1a042b-fe05-47d3-a2b1-762d63a2e5f2 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Refreshing network info cache for port 0bcd0f90-f88f-45b7-a157-d8a879bbf7dc {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:56:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 241172480 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:32 user nova-compute[74611]: DEBUG nova.network.neutron [req-cdadeef0-2610-4601-80a2-84f8a9a86c3b req-2f1a042b-fe05-47d3-a2b1-762d63a2e5f2 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updated VIF entry in instance network info cache for port 0bcd0f90-f88f-45b7-a157-d8a879bbf7dc. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:56:32 user nova-compute[74611]: DEBUG nova.network.neutron [req-cdadeef0-2610-4601-80a2-84f8a9a86c3b req-2f1a042b-fe05-47d3-a2b1-762d63a2e5f2 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updating instance_info_cache with network_info: [{"id": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "address": "fa:16:3e:43:a0:e7", "network": {"id": "2d22ba1e-7f3f-4914-a55d-505269e73606", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1880946265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bcd0f90-f8", "ovs_interfaceid": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "address": "fa:16:3e:0a:d3:f1", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44a7351c-73", "ovs_interfaceid": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073dacdd-40ea-46ff-8d11-e64a22034430", "address": "fa:16:3e:33:b1:80", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073dacdd-40", "ovs_interfaceid": "073dacdd-40ea-46ff-8d11-e64a22034430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58c272d9-ef57-4958-95e8-baa49c651ab1", "address": "fa:16:3e:95:46:59", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c272d9-ef", "ovs_interfaceid": "58c272d9-ef57-4958-95e8-baa49c651ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "address": "fa:16:3e:42:01:05", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38783fd3-e9", "ovs_interfaceid": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "address": "fa:16:3e:f1:aa:7c", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae2585-56", "ovs_interfaceid": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "address": "fa:16:3e:49:7a:2f", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24fd98ca-fe", "ovs_interfaceid": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 425721856 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cdadeef0-2610-4601-80a2-84f8a9a86c3b req-2f1a042b-fe05-47d3-a2b1-762d63a2e5f2 service nova] Releasing lock "refresh_cache-47f298b4-50b7-4dac-b9ee-a904be6445b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:56:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 595591168 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 761266176 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 921698304 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:33 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 54fdbd33-6f7c-440b-968b-cd743e2562c4 is timed out.
Nov 13 09:56:33 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Successfully detached device sdc from instance 54fdbd33-6f7c-440b-968b-cd743e2562c4 from the live domain config.
Nov 13 09:56:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctUzPoEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:33 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f6b08a-e09a-4729-933e-1908cad31db4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 09:56:33 user nova-compute[74611]: No targets found.
Nov 13 09:56:33 user nova-compute[74611]: iSNS:
Nov 13 09:56:33 user nova-compute[74611]: No targets found.
Nov 13 09:56:33 user nova-compute[74611]: STATIC:
Nov 13 09:56:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e
Nov 13 09:56:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e
Nov 13 09:56:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4
Nov 13 09:56:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da
Nov 13 09:56:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957
Nov 13 09:56:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d
Nov 13 09:56:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40
Nov 13 09:56:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0
Nov 13 09:56:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed
Nov 13 09:56:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:33 user nova-compute[74611]: FIRMWARE:
Nov 13 09:56:33 user nova-compute[74611]: No targets found.
Nov 13 09:56:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 09:56:33 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 09:56:33 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b792a4-3f25-4a72-829d-5ae7149a549d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02a5c14-1a21-487d-81d6-64a37cb582c5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:33 user nova-compute[74611]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:33 user nova-compute[74611]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:33 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:33 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:33 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:33 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:33 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:33 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:33 user nova-compute[74611]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:33 user nova-compute[74611]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:33 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:33 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:33 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:33 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:33 user nova-compute[74611]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 (non-flash)
Nov 13 09:56:33 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb84193d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0'): ({'sdh'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Removing single pathed devices sdh {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cef3a6-72e8-4339-9909-a9f3a180ecf8]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0389f9ee-7336-4e53-80a6-ed1da3ab26dd]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Flushing IO for device /dev/sdh {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 09:56:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b8d419-68ec-49dc-aae3-e0bff7e09f36]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[899432b8-a766-441b-9df5-94746e2b5aa6]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] SCSI volumes sdh have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[513bbfa4-efa5-40fe-a58d-5885c4b4d370]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:34 user nova-compute[74611]: INFO nova.compute.manager [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Terminating instance
Nov 13 09:56:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1f9f6c-fe50-441f-b601-7eeb536f18ef]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0, portal: 172.16.0.220,3260]
Nov 13 09:56:34 user nova-compute[74611]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQpslTNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'a8d685e6-eef6-4b7f-aa34-2f21201212da'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:34 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3863dafc-22d1-452e-b874-fd318327f8c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b5bf21-ff0e-45c7-a44a-1db119230e6e]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] <== disconnect_volume: return (415ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.029s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df1959e-a48c-4a6a-b7a1-357f63e0a501]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 09:56:34 user nova-compute[74611]: No targets found.
Nov 13 09:56:34 user nova-compute[74611]: iSNS:
Nov 13 09:56:34 user nova-compute[74611]: No targets found.
Nov 13 09:56:34 user nova-compute[74611]: STATIC:
Nov 13 09:56:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e
Nov 13 09:56:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e
Nov 13 09:56:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4
Nov 13 09:56:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da
Nov 13 09:56:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957
Nov 13 09:56:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d
Nov 13 09:56:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40
Nov 13 09:56:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed
Nov 13 09:56:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:34 user nova-compute[74611]: FIRMWARE:
Nov 13 09:56:34 user nova-compute[74611]: No targets found.
Nov 13 09:56:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 09:56:34 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 09:56:34 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0c047a-96e4-4986-8e06-83ba088a6679]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a08bb7-9c13-43ae-997a-56d457cfd173]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:34 user nova-compute[74611]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:34 user nova-compute[74611]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:34 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:34 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:34 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:34 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:34 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da (non-flash)
Nov 13 09:56:34 user nova-compute[74611]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:34 user nova-compute[74611]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:34 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:34 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:34 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:34 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:34 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb844b2a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da'): ({'sdj'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Removing single pathed devices sdj {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[355aa5ce-6406-4318-969f-428a6fc4c41d]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f564578-4366-49cf-beb7-2a98902e075c]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Flushing IO for device /dev/sdj {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb01d91-64e9-43dc-ab7b-5319cb611aa9]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-1e44c6c6-ab47-4090-aea4-1487ca069ad0 req-c2f2c645-1c42-4dcf-bb7d-fcefb6ea502c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-unplugged-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1e44c6c6-ab47-4090-aea4-1487ca069ad0 req-c2f2c645-1c42-4dcf-bb7d-fcefb6ea502c service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1e44c6c6-ab47-4090-aea4-1487ca069ad0 req-c2f2c645-1c42-4dcf-bb7d-fcefb6ea502c service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1e44c6c6-ab47-4090-aea4-1487ca069ad0 req-c2f2c645-1c42-4dcf-bb7d-fcefb6ea502c service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-1e44c6c6-ab47-4090-aea4-1487ca069ad0 req-c2f2c645-1c42-4dcf-bb7d-fcefb6ea502c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-unplugged-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-1e44c6c6-ab47-4090-aea4-1487ca069ad0 req-c2f2c645-1c42-4dcf-bb7d-fcefb6ea502c service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-unplugged-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.047s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[452813b2-9638-4cd6-85fa-4e02a75114ef]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] SCSI volumes sdj have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2315a244-252b-4ccc-841d-b2b65af9e040]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10ad216-f854-4643-87fa-00f67f339f51]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da, portal: 172.16.0.220,3260]
Nov 13 09:56:34 user nova-compute[74611]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-90e9add5-46b4-4320-9996-bb232ee7ef2f req-3c3a440b-e1bc-4201-bf86-251a54bc30b1 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-unplugged-073dacdd-40ea-46ff-8d11-e64a22034430 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-90e9add5-46b4-4320-9996-bb232ee7ef2f req-3c3a440b-e1bc-4201-bf86-251a54bc30b1 service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-90e9add5-46b4-4320-9996-bb232ee7ef2f req-3c3a440b-e1bc-4201-bf86-251a54bc30b1 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-90e9add5-46b4-4320-9996-bb232ee7ef2f req-3c3a440b-e1bc-4201-bf86-251a54bc30b1 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-90e9add5-46b4-4320-9996-bb232ee7ef2f req-3c3a440b-e1bc-4201-bf86-251a54bc30b1 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-unplugged-073dacdd-40ea-46ff-8d11-e64a22034430 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-90e9add5-46b4-4320-9996-bb232ee7ef2f req-3c3a440b-e1bc-4201-bf86-251a54bc30b1 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-unplugged-073dacdd-40ea-46ff-8d11-e64a22034430 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d685e6-eef6-4b7f-aa34-2f21201212da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d3aed9-2ed3-4b6a-9b82-7507a7c67437]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] <== disconnect_volume: return (465ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtlAmsfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5b70fc11-140f-4c9a-9e75-2b33705d8c6d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3079aaf-9e56-4219-a7ef-32f459f61957', 'serial'} {{(pid=74611) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] swap_volume: removing Cinder connection for volume a8d685e6-eef6-4b7f-aa34-2f21201212da {{(pid=74611) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-d50c95bf-988c-4e89-a567-6543e4397bf7 req-64b4297f-7feb-475b-ab9b-665a63c73880 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-unplugged-08ae2585-56bf-44f5-bf94-d06952b8a60d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d50c95bf-988c-4e89-a567-6543e4397bf7 req-64b4297f-7feb-475b-ab9b-665a63c73880 service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d50c95bf-988c-4e89-a567-6543e4397bf7 req-64b4297f-7feb-475b-ab9b-665a63c73880 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d50c95bf-988c-4e89-a567-6543e4397bf7 req-64b4297f-7feb-475b-ab9b-665a63c73880 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-d50c95bf-988c-4e89-a567-6543e4397bf7 req-64b4297f-7feb-475b-ab9b-665a63c73880 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-unplugged-08ae2585-56bf-44f5-bf94-d06952b8a60d {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-d50c95bf-988c-4e89-a567-6543e4397bf7 req-64b4297f-7feb-475b-ab9b-665a63c73880 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-unplugged-08ae2585-56bf-44f5-bf94-d06952b8a60d for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lazy-loading 'flavor' on Instance uuid 54fdbd33-6f7c-440b-968b-cd743e2562c4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dab1f5f3-07e6-4358-a3d5-46dae949dec9 tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.206s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-85cb3adb-b2b3-49ec-92ab-c2b7a028241a" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-85cb3adb-b2b3-49ec-92ab-c2b7a028241a" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] swap_volume: Updating volume a8d685e6-eef6-4b7f-aa34-2f21201212da BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "JtlAmsfG", "auth_password": "4RWADYLqNztVI0", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "f3079aaf-9e56-4219-a7ef-32f459f61957"}, "status": "reserved", "instance": "5b70fc11-140f-4c9a-9e75-2b33705d8c6d", "attached_at": "", "detached_at": "", "volume_id": "f3079aaf-9e56-4219-a7ef-32f459f61957", "serial": "f3079aaf-9e56-4219-a7ef-32f459f61957"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f3079aaf-9e56-4219-a7ef-32f459f61957', 'no_device': None, 'attachment_id': '0666931f-94b8-4918-92b7-fab57ca6e5bc'} {{(pid=74611) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 13 09:56:35 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance eea01f90-3c79-4304-913e-8cf7e9749480 is timed out.
Nov 13 09:56:35 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Successfully detached device vdb from instance eea01f90-3c79-4304-913e-8cf7e9749480 from the live domain config.
Nov 13 09:56:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dAeGJlbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:35 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-11cd4e84-ff1c-4207-aa6e-02e3ba073623 tempest-TestVolumeSwap-2090573341 tempest-TestVolumeSwap-2090573341-project-admin] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.354s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.043s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[085dafc7-f798-43a1-b0b3-6f5a7fa20fec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 09:56:35 user nova-compute[74611]: No targets found.
Nov 13 09:56:35 user nova-compute[74611]: iSNS:
Nov 13 09:56:35 user nova-compute[74611]: No targets found.
Nov 13 09:56:35 user nova-compute[74611]: STATIC:
Nov 13 09:56:35 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e
Nov 13 09:56:35 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:35 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:35 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e
Nov 13 09:56:35 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:35 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:35 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4
Nov 13 09:56:35 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:35 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:35 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957
Nov 13 09:56:35 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:35 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:35 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d
Nov 13 09:56:35 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:35 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:35 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40
Nov 13 09:56:35 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:35 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:35 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed
Nov 13 09:56:35 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:35 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:35 user nova-compute[74611]: FIRMWARE:
Nov 13 09:56:35 user nova-compute[74611]: No targets found.
Nov 13 09:56:35 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 09:56:35 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 09:56:35 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d75031-bc1b-4d89-b91b-ff9cfced64e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae712a9a-4908-4422-8cb4-ca22e4063fb1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:35 user nova-compute[74611]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:35 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:35 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:35 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:35 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:35 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:35 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:35 user nova-compute[74611]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:35 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:35 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:35 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:35 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:35 user nova-compute[74611]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 (non-flash)
Nov 13 09:56:35 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb844d0040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40'): ({'sdi'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Removing single pathed devices sdi {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd036f96-eda7-4abb-9525-460c1f34e31e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.033s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[325518de-a4e2-4ac3-ac74-05c7c6a45863]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Flushing IO for device /dev/sdi {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b939d33-a9ce-45f6-acf4-9c0e12f1bf89]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:35 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Instance destroyed successfully.
Nov 13 09:56:35 user nova-compute[74611]: DEBUG nova.objects.instance [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lazy-loading 'resources' on Instance uuid 47f298b4-50b7-4dac-b9ee-a904be6445b9 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:55:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "address": "fa:16:3e:43:a0:e7", "network": {"id": "2d22ba1e-7f3f-4914-a55d-505269e73606", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1880946265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bcd0f90-f8", "ovs_interfaceid": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "address": "fa:16:3e:43:a0:e7", "network": {"id": "2d22ba1e-7f3f-4914-a55d-505269e73606", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1880946265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bcd0f90-f8", "ovs_interfaceid": "0bcd0f90-f88f-45b7-a157-d8a879bbf7dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:a0:e7,bridge_name='br-int',has_traffic_filtering=True,id=0bcd0f90-f88f-45b7-a157-d8a879bbf7dc,network=Network(2d22ba1e-7f3f-4914-a55d-505269e73606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bcd0f90-f8') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:a0:e7,bridge_name='br-int',has_traffic_filtering=True,id=0bcd0f90-f88f-45b7-a157-d8a879bbf7dc,network=Network(2d22ba1e-7f3f-4914-a55d-505269e73606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bcd0f90-f8') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bcd0f90-f8, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Updating instance_info_cache with network_info: [{"id": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "address": "fa:16:3e:ea:e8:de", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e875b56-fd", "ovs_interfaceid": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-85cb3adb-b2b3-49ec-92ab-c2b7a028241a" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.054s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4485350-fdc5-41fd-9f17-047f4df51d70]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] SCSI volumes sdi have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23932656336313864', '/dev/disk/by-id/scsi-1SCST_BIOa87d70f5-92ec618d65e90d2f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a87d70f5') {{(pid=85776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33158d8-d67b-45b5-aff3-14b38cbcfe40]: (4, None) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[131735d4-efe7-492f-be9c-992a2cbf9c71]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquiring lock "54fdbd33-6f7c-440b-968b-cd743e2562c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquiring lock "54fdbd33-6f7c-440b-968b-cd743e2562c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:36 user nova-compute[74611]: INFO nova.compute.manager [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Terminating instance
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3627931-aeee-4183-9ecd-22a61f6e87ed) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fbbf3b-b7ab-421d-850e-e942eec2cbec]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40, portal: 172.16.0.220,3260]
Nov 13 09:56:36 user nova-compute[74611]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:36 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: INFO os_vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:a0:e7,bridge_name='br-int',has_traffic_filtering=True,id=0bcd0f90-f88f-45b7-a157-d8a879bbf7dc,network=Network(2d22ba1e-7f3f-4914-a55d-505269e73606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bcd0f90-f8')
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:55:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "address": "fa:16:3e:0a:d3:f1", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44a7351c-73", "ovs_interfaceid": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "address": "fa:16:3e:0a:d3:f1", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44a7351c-73", "ovs_interfaceid": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d3:f1,bridge_name='br-int',has_traffic_filtering=True,id=44a7351c-7369-4cd4-b7b6-5ec7d8691901,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44a7351c-73') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d3:f1,bridge_name='br-int',has_traffic_filtering=True,id=44a7351c-7369-4cd4-b7b6-5ec7d8691901,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44a7351c-73') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44a7351c-73, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea5dc3e0-c232-41cf-b67f-668802896b40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7170499-51e2-42e1-9a6b-c5b698b72021]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] <== disconnect_volume: return (447ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef1a0f80-1072-4379-a1eb-e6698cdeccb4) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: INFO os_vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d3:f1,bridge_name='br-int',has_traffic_filtering=True,id=44a7351c-7369-4cd4-b7b6-5ec7d8691901,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44a7351c-73')
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:55:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "073dacdd-40ea-46ff-8d11-e64a22034430", "address": "fa:16:3e:33:b1:80", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073dacdd-40", "ovs_interfaceid": "073dacdd-40ea-46ff-8d11-e64a22034430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "073dacdd-40ea-46ff-8d11-e64a22034430", "address": "fa:16:3e:33:b1:80", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073dacdd-40", "ovs_interfaceid": "073dacdd-40ea-46ff-8d11-e64a22034430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:b1:80,bridge_name='br-int',has_traffic_filtering=True,id=073dacdd-40ea-46ff-8d11-e64a22034430,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap073dacdd-40') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:b1:80,bridge_name='br-int',has_traffic_filtering=True,id=073dacdd-40ea-46ff-8d11-e64a22034430,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap073dacdd-40') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap073dacdd-40, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:36 user nova-compute[74611]: WARNING nova.compute.manager [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc for instance with vm_state active and task_state deleting.
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-unplugged-44a7351c-7369-4cd4-b7b6-5ec7d8691901 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-unplugged-44a7351c-7369-4cd4-b7b6-5ec7d8691901 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-unplugged-44a7351c-7369-4cd4-b7b6-5ec7d8691901 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-44a7351c-7369-4cd4-b7b6-5ec7d8691901 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-44a7351c-7369-4cd4-b7b6-5ec7d8691901 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:36 user nova-compute[74611]: WARNING nova.compute.manager [req-aa000313-2f3a-434f-9c1f-ba9164e288a3 req-4aac7cb9-b07a-455f-ae73-5fff85faa846 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-44a7351c-7369-4cd4-b7b6-5ec7d8691901 for instance with vm_state active and task_state deleting.
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44bfab72-b1bc-40d9-829e-4771b24cadec) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: INFO os_vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:b1:80,bridge_name='br-int',has_traffic_filtering=True,id=073dacdd-40ea-46ff-8d11-e64a22034430,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap073dacdd-40')
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:55:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58c272d9-ef57-4958-95e8-baa49c651ab1", "address": "fa:16:3e:95:46:59", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c272d9-ef", "ovs_interfaceid": "58c272d9-ef57-4958-95e8-baa49c651ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "58c272d9-ef57-4958-95e8-baa49c651ab1", "address": "fa:16:3e:95:46:59", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c272d9-ef", "ovs_interfaceid": "58c272d9-ef57-4958-95e8-baa49c651ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:46:59,bridge_name='br-int',has_traffic_filtering=True,id=58c272d9-ef57-4958-95e8-baa49c651ab1,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c272d9-ef') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:46:59,bridge_name='br-int',has_traffic_filtering=True,id=58c272d9-ef57-4958-95e8-baa49c651ab1,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c272d9-ef') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58c272d9-ef, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2a36f76-4480-4c77-b8cd-3bfa6ba44681) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: INFO os_vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:46:59,bridge_name='br-int',has_traffic_filtering=True,id=58c272d9-ef57-4958-95e8-baa49c651ab1,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c272d9-ef')
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:55:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "address": "fa:16:3e:42:01:05", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38783fd3-e9", "ovs_interfaceid": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "address": "fa:16:3e:42:01:05", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38783fd3-e9", "ovs_interfaceid": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:01:05,bridge_name='br-int',has_traffic_filtering=True,id=38783fd3-e90d-48ba-a670-41f195ccdfc8,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38783fd3-e9') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:01:05,bridge_name='br-int',has_traffic_filtering=True,id=38783fd3-e90d-48ba-a670-41f195ccdfc8,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38783fd3-e9') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38783fd3-e9, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-073dacdd-40ea-46ff-8d11-e64a22034430 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-073dacdd-40ea-46ff-8d11-e64a22034430 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:36 user nova-compute[74611]: WARNING nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-073dacdd-40ea-46ff-8d11-e64a22034430 for instance with vm_state active and task_state deleting.
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-unplugged-58c272d9-ef57-4958-95e8-baa49c651ab1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-unplugged-58c272d9-ef57-4958-95e8-baa49c651ab1 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-unplugged-58c272d9-ef57-4958-95e8-baa49c651ab1 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-58c272d9-ef57-4958-95e8-baa49c651ab1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-58c272d9-ef57-4958-95e8-baa49c651ab1 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:36 user nova-compute[74611]: WARNING nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-58c272d9-ef57-4958-95e8-baa49c651ab1 for instance with vm_state active and task_state deleting.
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-unplugged-38783fd3-e90d-48ba-a670-41f195ccdfc8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-unplugged-38783fd3-e90d-48ba-a670-41f195ccdfc8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-unplugged-38783fd3-e90d-48ba-a670-41f195ccdfc8 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-38783fd3-e90d-48ba-a670-41f195ccdfc8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-38783fd3-e90d-48ba-a670-41f195ccdfc8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:36 user nova-compute[74611]: WARNING nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-38783fd3-e90d-48ba-a670-41f195ccdfc8 for instance with vm_state active and task_state deleting.
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-unplugged-24fd98ca-fe56-4410-8409-68f9010bf1ae {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-unplugged-24fd98ca-fe56-4410-8409-68f9010bf1ae {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-unplugged-24fd98ca-fe56-4410-8409-68f9010bf1ae for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-24fd98ca-fe56-4410-8409-68f9010bf1ae {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-24fd98ca-fe56-4410-8409-68f9010bf1ae {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:36 user nova-compute[74611]: WARNING nova.compute.manager [req-2d68a37f-4a9f-4023-98ac-fbb9e23659af req-3f53e77a-cde0-42c0-9b22-bd7dec41e93b service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-24fd98ca-fe56-4410-8409-68f9010bf1ae for instance with vm_state active and task_state deleting.
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52caae5b-5672-4584-93bd-cb06391664fb) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Acquiring lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:36 user nova-compute[74611]: INFO nova.compute.manager [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Detaching volume f3079aaf-9e56-4219-a7ef-32f459f61957
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: INFO os_vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:01:05,bridge_name='br-int',has_traffic_filtering=True,id=38783fd3-e90d-48ba-a670-41f195ccdfc8,network=Network(1f049580-cb5c-4dec-bbe5-efecba6f0e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38783fd3-e9')
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:55:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "address": "fa:16:3e:f1:aa:7c", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae2585-56", "ovs_interfaceid": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "address": "fa:16:3e:f1:aa:7c", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae2585-56", "ovs_interfaceid": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:aa:7c,bridge_name='br-int',has_traffic_filtering=True,id=08ae2585-56bf-44f5-bf94-d06952b8a60d,network=Network(21f8ed5b-00f0-404f-b533-220e84f88c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ae2585-56') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:aa:7c,bridge_name='br-int',has_traffic_filtering=True,id=08ae2585-56bf-44f5-bf94-d06952b8a60d,network=Network(21f8ed5b-00f0-404f-b533-220e84f88c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ae2585-56') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08ae2585-56, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:36 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Instance destroyed successfully.
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.objects.instance [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lazy-loading 'resources' on Instance uuid 54fdbd33-6f7c-440b-968b-cd743e2562c4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1703896712',display_name='tempest-AttachSCSIVolumeTestJSON-server-1703896712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1703896712',id=9,image_ref='3f3da546-6a65-4512-82f8-1d9c387985df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOe2LY8QjJ7Fu3Zrkp9Lu+RFNKW9A0N4TA+GoElOwfIjxUP6qw9rv3J0cPyjZMKgcW8Q8j9f3tlqlcKE7xBEWJwA1Uxl2XaoB7HbroZIyblZKnsHvbzCLSQUpm/+viGNg==',key_name='tempest-keypair-548196098',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:54:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41d4b071d0124c118e77acf5595e7c00',ramdisk_id='',reservation_id='r-3f5knjok',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f3da546-6a65-4512-82f8-1d9c387985df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1150883813',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1150883813-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:54:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a35ffdeb7c9d495791868be7cb705abd',uuid=54fdbd33-6f7c-440b-968b-cd743e2562c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "address": "fa:16:3e:7d:87:b9", "network": {"id": "02ef9d76-af74-4ee0-85f4-f7655b4d4d9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1671331735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d4b071d0124c118e77acf5595e7c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bcb0be-cc", "ovs_interfaceid": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Converting VIF {"id": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "address": "fa:16:3e:7d:87:b9", "network": {"id": "02ef9d76-af74-4ee0-85f4-f7655b4d4d9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1671331735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d4b071d0124c118e77acf5595e7c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bcb0be-cc", "ovs_interfaceid": "b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:87:b9,bridge_name='br-int',has_traffic_filtering=True,id=b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6,network=Network(02ef9d76-af74-4ee0-85f4-f7655b4d4d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bcb0be-cc') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_vif [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:87:b9,bridge_name='br-int',has_traffic_filtering=True,id=b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6,network=Network(02ef9d76-af74-4ee0-85f4-f7655b4d4d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bcb0be-cc') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:56:36 user nova-compute[74611]: INFO nova.virt.block_device [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Attempting to driver detach volume f3079aaf-9e56-4219-a7ef-32f459f61957 from mountpoint /dev/vdb
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4bcb0be-cc, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=397e490d-4e4f-40f5-90d7-3953b206dfc5) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Attempting to detach device vdb from instance 5b70fc11-140f-4c9a-9e75-2b33705d8c6d from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 09:56:36 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:56:36 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 09:56:36 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:56:36 user nova-compute[74611]:   <serial>f3079aaf-9e56-4219-a7ef-32f459f61957</serial>
Nov 13 09:56:36 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 09:56:36 user nova-compute[74611]: </disk>
Nov 13 09:56:36 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=295a2dc4-a799-404b-b753-524d31c47355) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:36 user nova-compute[74611]: INFO os_vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:aa:7c,bridge_name='br-int',has_traffic_filtering=True,id=08ae2585-56bf-44f5-bf94-d06952b8a60d,network=Network(21f8ed5b-00f0-404f-b533-220e84f88c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ae2585-56')
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1854338987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1854338987',id=12,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfCRBfwTkPlxUj3+P93Y8bMippJb0oJgZVjX31N/asjCOhHiRo9BPi4BKmodQ8kdicw9pEawS0W5o7UIjXcT4sJKraWXTnuh+hSpNGRjqW+mR0IhYoUmoQOHuKaD4ZMGw==',key_name='tempest-keypair-136654829',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:55:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2aa3bd8dccd14bab978842976f64310f',ramdisk_id='',reservation_id='r-ymp51byu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-570022671',owner_user_name='tempest-TaggedBootDevicesTest-570022671-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a21e69a79408f967e27e24e7aca9d',uuid=47f298b4-50b7-4dac-b9ee-a904be6445b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "address": "fa:16:3e:49:7a:2f", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24fd98ca-fe", "ovs_interfaceid": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converting VIF {"id": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "address": "fa:16:3e:49:7a:2f", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24fd98ca-fe", "ovs_interfaceid": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:7a:2f,bridge_name='br-int',has_traffic_filtering=True,id=24fd98ca-fe56-4410-8409-68f9010bf1ae,network=Network(21f8ed5b-00f0-404f-b533-220e84f88c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24fd98ca-fe') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:7a:2f,bridge_name='br-int',has_traffic_filtering=True,id=24fd98ca-fe56-4410-8409-68f9010bf1ae,network=Network(21f8ed5b-00f0-404f-b533-220e84f88c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24fd98ca-fe') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Successfully detached device vdb from instance 5b70fc11-140f-4c9a-9e75-2b33705d8c6d from the persistent domain config.
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b70fc11-140f-4c9a-9e75-2b33705d8c6d from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 09:56:36 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:56:36 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 09:56:36 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:56:36 user nova-compute[74611]:   <serial>f3079aaf-9e56-4219-a7ef-32f459f61957</serial>
Nov 13 09:56:36 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 09:56:36 user nova-compute[74611]: </disk>
Nov 13 09:56:36 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24fd98ca-fe, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: INFO os_vif [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:87:b9,bridge_name='br-int',has_traffic_filtering=True,id=b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6,network=Network(02ef9d76-af74-4ee0-85f4-f7655b4d4d9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bcb0be-cc')
Nov 13 09:56:36 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Deleting instance files /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4_del
Nov 13 09:56:36 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Deletion of /opt/stack/data/nova/instances/54fdbd33-6f7c-440b-968b-cd743e2562c4_del complete
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea5cc7fa-c6e9-43e8-ac6c-61885d3e2307) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:36 user nova-compute[74611]: INFO os_vif [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:7a:2f,bridge_name='br-int',has_traffic_filtering=True,id=24fd98ca-fe56-4410-8409-68f9010bf1ae,network=Network(21f8ed5b-00f0-404f-b533-220e84f88c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24fd98ca-fe')
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VcWOGCFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:36 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[130679c2-9c59-470b-80c9-83c7f814fb64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 09:56:36 user nova-compute[74611]: No targets found.
Nov 13 09:56:36 user nova-compute[74611]: iSNS:
Nov 13 09:56:36 user nova-compute[74611]: No targets found.
Nov 13 09:56:36 user nova-compute[74611]: STATIC:
Nov 13 09:56:36 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e
Nov 13 09:56:36 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:36 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:36 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e
Nov 13 09:56:36 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:36 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:36 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4
Nov 13 09:56:36 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:36 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:36 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957
Nov 13 09:56:36 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:36 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:36 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d
Nov 13 09:56:36 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:36 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:36 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed
Nov 13 09:56:36 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:36 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:36 user nova-compute[74611]: FIRMWARE:
Nov 13 09:56:36 user nova-compute[74611]: No targets found.
Nov 13 09:56:36 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 09:56:36 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 09:56:36 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:36 user nova-compute[74611]: INFO nova.compute.manager [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c62465-5184-4cfd-8a85-f3ac64bbeb79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a0d288-dbb3-44da-81b2-f4696a563a18]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:36 user nova-compute[74611]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:36 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:36 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:36 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:36 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:36 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:36 user nova-compute[74611]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:36 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:36 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:36 user nova-compute[74611]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 (non-flash)
Nov 13 09:56:36 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:36 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb6462a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4'): ({'sde'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 09:56:36 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Removing single pathed devices sde {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66dfec4-ab69-42ef-8df9-7bbfa3323954]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.objects.instance [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lazy-loading 'flavor' on Instance uuid eea01f90-3c79-4304-913e-8cf7e9749480 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a40c54-1feb-415a-8e08-7a147ce7106b]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Flushing IO for device /dev/sde {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12e0a88-76c7-408a-ba94-8ecc8e0b7e60]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-plugged-08ae2585-56bf-44f5-bf94-d06952b8a60d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] Acquiring lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] No waiting events found dispatching network-vif-plugged-08ae2585-56bf-44f5-bf94-d06952b8a60d {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:37 user nova-compute[74611]: WARNING nova.compute.manager [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received unexpected event network-vif-plugged-08ae2585-56bf-44f5-bf94-d06952b8a60d for instance with vm_state active and task_state deleting.
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Received event network-vif-unplugged-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] Acquiring lock "54fdbd33-6f7c-440b-968b-cd743e2562c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] No waiting events found dispatching network-vif-unplugged-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Received event network-vif-unplugged-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Received event network-vif-plugged-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] Acquiring lock "54fdbd33-6f7c-440b-968b-cd743e2562c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] No waiting events found dispatching network-vif-plugged-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:37 user nova-compute[74611]: WARNING nova.compute.manager [req-12f6b04f-7465-4bf5-808b-16b620e45b96 req-48f079e1-1df4-4bde-8695-5e55c1364735 service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Received unexpected event network-vif-plugged-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 for instance with vm_state active and task_state deleting.
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83de0bc7-e97b-4e0d-8377-8e297835ad65 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "eea01f90-3c79-4304-913e-8cf7e9749480" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.074s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f483a7-0134-4d31-b8d1-8e286765f2be]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] SCSI volumes sde have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b215b7f-6168-4619-84d9-16115f93ea43]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e4bd77-652a-48ea-b04f-1a57ce646e2f]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4, portal: 172.16.0.220,3260]
Nov 13 09:56:37 user nova-compute[74611]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1186c1-b67c-4ca8-9c85-4e95a74840f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[96219bbb-072d-4937-a3fa-8304d7cdd4a6]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] <== disconnect_volume: return (357ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTbCPZVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:37 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[509015e6-e933-4826-bea9-70ab476e0cdb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 09:56:37 user nova-compute[74611]: No targets found.
Nov 13 09:56:37 user nova-compute[74611]: iSNS:
Nov 13 09:56:37 user nova-compute[74611]: No targets found.
Nov 13 09:56:37 user nova-compute[74611]: STATIC:
Nov 13 09:56:37 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e
Nov 13 09:56:37 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:37 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:37 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e
Nov 13 09:56:37 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:37 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:37 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957
Nov 13 09:56:37 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:37 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:37 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d
Nov 13 09:56:37 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:37 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:37 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed
Nov 13 09:56:37 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:37 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:37 user nova-compute[74611]: FIRMWARE:
Nov 13 09:56:37 user nova-compute[74611]: No targets found.
Nov 13 09:56:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 09:56:37 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 09:56:37 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[38077719-c681-41d6-b24c-86a1a1bd8dc1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b70fc11-140f-4c9a-9e75-2b33705d8c6d {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[450c677e-430c-45f3-8c08-5f88febdb048]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:37 user nova-compute[74611]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:37 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:37 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:37 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:37 user nova-compute[74611]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:37 user nova-compute[74611]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e (non-flash)
Nov 13 09:56:37 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:37 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7c14dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e'): ({'sdc'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Removing single pathed devices sdc {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5528ed0c-b1e7-4447-a27d-f370b5590701]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3a8473-8cc5-4ff6-8f2f-1152c076a69b]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Flushing IO for device /dev/sdc {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[988ab4ef-e779-41c3-8d87-39fb96faee2c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f693a06-e7f7-49b2-9cba-6f584e9a26bb]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] SCSI volumes sdc have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[28382eab-519e-4558-a323-b536890de15c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[97128cff-f5e2-4781-8e6e-4751fb7e6f72]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e, portal: 172.16.0.220,3260]
Nov 13 09:56:37 user nova-compute[74611]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b94a6b2-ce65-40bc-99b9-1263774b589e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[94baccbb-1673-4463-b2ce-abb75eb94864]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] <== disconnect_volume: return (309ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsGRiqFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:37 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9970e43c-f60e-46fe-b3e3-64f1684e676c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 09:56:37 user nova-compute[74611]: No targets found.
Nov 13 09:56:37 user nova-compute[74611]: iSNS:
Nov 13 09:56:37 user nova-compute[74611]: No targets found.
Nov 13 09:56:37 user nova-compute[74611]: STATIC:
Nov 13 09:56:37 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e
Nov 13 09:56:37 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:37 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:37 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957
Nov 13 09:56:37 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:37 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:37 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d
Nov 13 09:56:37 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:37 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:37 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed
Nov 13 09:56:37 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:37 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:37 user nova-compute[74611]: FIRMWARE:
Nov 13 09:56:37 user nova-compute[74611]: No targets found.
Nov 13 09:56:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 09:56:37 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 09:56:37 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de4f914-6688-42e3-a29a-308f53646c5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "interface-eea01f90-3c79-4304-913e-8cf7e9749480-266e9729-66ec-47c1-b5a4-a23e4cb79de6" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "interface-eea01f90-3c79-4304-913e-8cf7e9749480-266e9729-66ec-47c1-b5a4-a23e4cb79de6" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.objects.instance [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lazy-loading 'flavor' on Instance uuid eea01f90-3c79-4304-913e-8cf7e9749480 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea6532b-f0b2-4433-b061-01c1afc8d343]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:37 user nova-compute[74611]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:37 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:37 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:37 user nova-compute[74611]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:37 user nova-compute[74611]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e (non-flash)
Nov 13 09:56:37 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64681f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e'): ({'sdd'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Removing single pathed devices sdd {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-560513437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-560513437',id=8,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeQwNIdKbZkcJ1bL6vxLyRaw/tiXK1lBMCzqrmneLrH3GH4oV5/eRe+ZKc6KvSL9xj8s0omUXtq4rOBJVCBpsYTYfMFZFh2iLGaIRkl6/UO9iRuPbpk3z3yXYcyxqHiGw==',key_name='tempest-keypair-788651981',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:54:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f6f36a09d514934ab7e11e7e945658f',ramdisk_id='',reservation_id='r-o8x6c9da',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-987448261',owner_user_name='tempest-TaggedAttachmentsTest-987448261-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:54:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4627e309322495f90a6e412f7e36c75',uuid=eea01f90-3c79-4304-913e-8cf7e9749480,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "address": "fa:16:3e:0e:84:69", "network": {"id": "55f5861f-a3bd-4036-b97e-e41fbe61acb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1033512839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap266e9729-66", "ovs_interfaceid": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Converting VIF {"id": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "address": "fa:16:3e:0e:84:69", "network": {"id": "55f5861f-a3bd-4036-b97e-e41fbe61acb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1033512839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap266e9729-66", "ovs_interfaceid": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:84:69,bridge_name='br-int',has_traffic_filtering=True,id=266e9729-66ec-47c1-b5a4-a23e4cb79de6,network=Network(55f5861f-a3bd-4036-b97e-e41fbe61acb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap266e9729-66') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:84:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap266e9729-66"/></interface> {{(pid=74611) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b42ac46-1141-4ef7-888b-247b4a1b8f28]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:84:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap266e9729-66"/></interface> {{(pid=74611) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Attempting to detach device tap266e9729-66 from instance eea01f90-3c79-4304-913e-8cf7e9749480 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] detach device xml: <interface type="ethernet">
Nov 13 09:56:37 user nova-compute[74611]:   <mac address="fa:16:3e:0e:84:69"/>
Nov 13 09:56:37 user nova-compute[74611]:   <model type="virtio"/>
Nov 13 09:56:37 user nova-compute[74611]:   <mtu size="1442"/>
Nov 13 09:56:37 user nova-compute[74611]:   <target dev="tap266e9729-66"/>
Nov 13 09:56:37 user nova-compute[74611]: </interface>
Nov 13 09:56:37 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:84:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap266e9729-66"/></interface> {{(pid=74611) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0e:84:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap266e9729-66"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 13 09:56:37 user nova-compute[74611]:   <name>instance-00000008</name>
Nov 13 09:56:37 user nova-compute[74611]:   <uuid>eea01f90-3c79-4304-913e-8cf7e9749480</uuid>
Nov 13 09:56:37 user nova-compute[74611]:   <metadata>
Nov 13 09:56:37 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:56:37 user nova-compute[74611]:   <nova:package version="0.0.0"/>
Nov 13 09:56:37 user nova-compute[74611]:   <nova:name>tempest-device-tagging-server-560513437</nova:name>
Nov 13 09:56:37 user nova-compute[74611]:   <nova:creationTime>2023-11-13 09:56:05</nova:creationTime>
Nov 13 09:56:37 user nova-compute[74611]:   <nova:flavor name="m1.tiny">
Nov 13 09:56:37 user nova-compute[74611]:     <nova:memory>512</nova:memory>
Nov 13 09:56:37 user nova-compute[74611]:     <nova:disk>1</nova:disk>
Nov 13 09:56:37 user nova-compute[74611]:     <nova:swap>0</nova:swap>
Nov 13 09:56:37 user nova-compute[74611]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:56:37 user nova-compute[74611]:     <nova:vcpus>1</nova:vcpus>
Nov 13 09:56:37 user nova-compute[74611]:   </nova:flavor>
Nov 13 09:56:37 user nova-compute[74611]:   <nova:owner>
Nov 13 09:56:37 user nova-compute[74611]:     <nova:user uuid="a4627e309322495f90a6e412f7e36c75">tempest-TaggedAttachmentsTest-987448261-project-member</nova:user>
Nov 13 09:56:37 user nova-compute[74611]:     <nova:project uuid="9f6f36a09d514934ab7e11e7e945658f">tempest-TaggedAttachmentsTest-987448261</nova:project>
Nov 13 09:56:37 user nova-compute[74611]:   </nova:owner>
Nov 13 09:56:37 user nova-compute[74611]:   <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:56:37 user nova-compute[74611]:   <nova:ports>
Nov 13 09:56:37 user nova-compute[74611]:     <nova:port uuid="805b4d7d-b250-40e4-af31-e9f281182115">
Nov 13 09:56:37 user nova-compute[74611]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 09:56:37 user nova-compute[74611]:     </nova:port>
Nov 13 09:56:37 user nova-compute[74611]:     <nova:port uuid="266e9729-66ec-47c1-b5a4-a23e4cb79de6">
Nov 13 09:56:37 user nova-compute[74611]:       <nova:ip type="fixed" address="10.10.10.152" ipVersion="4"/>
Nov 13 09:56:37 user nova-compute[74611]:     </nova:port>
Nov 13 09:56:37 user nova-compute[74611]:   </nova:ports>
Nov 13 09:56:37 user nova-compute[74611]: </nova:instance>
Nov 13 09:56:37 user nova-compute[74611]:   </metadata>
Nov 13 09:56:37 user nova-compute[74611]:   <memory unit='KiB'>524288</memory>
Nov 13 09:56:37 user nova-compute[74611]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 09:56:37 user nova-compute[74611]:   <vcpu placement='static'>1</vcpu>
Nov 13 09:56:37 user nova-compute[74611]:   <resource>
Nov 13 09:56:37 user nova-compute[74611]:     <partition>/machine</partition>
Nov 13 09:56:37 user nova-compute[74611]:   </resource>
Nov 13 09:56:37 user nova-compute[74611]:   <sysinfo type='smbios'>
Nov 13 09:56:37 user nova-compute[74611]:     <system>
Nov 13 09:56:37 user nova-compute[74611]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 09:56:37 user nova-compute[74611]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 09:56:37 user nova-compute[74611]:       <entry name='version'>0.0.0</entry>
Nov 13 09:56:37 user nova-compute[74611]:       <entry name='serial'>eea01f90-3c79-4304-913e-8cf7e9749480</entry>
Nov 13 09:56:37 user nova-compute[74611]:       <entry name='uuid'>eea01f90-3c79-4304-913e-8cf7e9749480</entry>
Nov 13 09:56:37 user nova-compute[74611]:       <entry name='family'>Virtual Machine</entry>
Nov 13 09:56:37 user nova-compute[74611]:     </system>
Nov 13 09:56:37 user nova-compute[74611]:   </sysinfo>
Nov 13 09:56:37 user nova-compute[74611]:   <os>
Nov 13 09:56:37 user nova-compute[74611]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 09:56:37 user nova-compute[74611]:     <boot dev='hd'/>
Nov 13 09:56:37 user nova-compute[74611]:     <smbios mode='sysinfo'/>
Nov 13 09:56:37 user nova-compute[74611]:   </os>
Nov 13 09:56:37 user nova-compute[74611]:   <features>
Nov 13 09:56:37 user nova-compute[74611]:     <acpi/>
Nov 13 09:56:37 user nova-compute[74611]:     <apic/>
Nov 13 09:56:37 user nova-compute[74611]:     <vmcoreinfo state='on'/>
Nov 13 09:56:37 user nova-compute[74611]:   </features>
Nov 13 09:56:37 user nova-compute[74611]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 09:56:37 user nova-compute[74611]:     <model fallback='forbid'>Nehalem</model>
Nov 13 09:56:37 user nova-compute[74611]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 09:56:37 user nova-compute[74611]:     <feature policy='require' name='vme'/>
Nov 13 09:56:37 user nova-compute[74611]:     <feature policy='require' name='x2apic'/>
Nov 13 09:56:37 user nova-compute[74611]:     <feature policy='require' name='hypervisor'/>
Nov 13 09:56:37 user nova-compute[74611]:   </cpu>
Nov 13 09:56:37 user nova-compute[74611]:   <clock offset='utc'>
Nov 13 09:56:37 user nova-compute[74611]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 09:56:37 user nova-compute[74611]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 09:56:37 user nova-compute[74611]:     <timer name='hpet' present='no'/>
Nov 13 09:56:37 user nova-compute[74611]:   </clock>
Nov 13 09:56:37 user nova-compute[74611]:   <on_poweroff>destroy</on_poweroff>
Nov 13 09:56:37 user nova-compute[74611]:   <on_reboot>restart</on_reboot>
Nov 13 09:56:37 user nova-compute[74611]:   <on_crash>destroy</on_crash>
Nov 13 09:56:37 user nova-compute[74611]:   <devices>
Nov 13 09:56:37 user nova-compute[74611]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 09:56:37 user nova-compute[74611]:     <disk type='file' device='disk'>
Nov 13 09:56:37 user nova-compute[74611]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 09:56:37 user nova-compute[74611]:       <source file='/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk' index='2'/>
Nov 13 09:56:37 user nova-compute[74611]:       <backingStore type='file' index='3'>
Nov 13 09:56:37 user nova-compute[74611]:         <format type='raw'/>
Nov 13 09:56:37 user nova-compute[74611]:         <source file='/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915'/>
Nov 13 09:56:37 user nova-compute[74611]:         <backingStore/>
Nov 13 09:56:37 user nova-compute[74611]:       </backingStore>
Nov 13 09:56:37 user nova-compute[74611]:       <target dev='vda' bus='virtio'/>
Nov 13 09:56:37 user nova-compute[74611]:       <alias name='virtio-disk0'/>
Nov 13 09:56:37 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 09:56:37 user nova-compute[74611]:     </disk>
Nov 13 09:56:37 user nova-compute[74611]:     <disk type='file' device='cdrom'>
Nov 13 09:56:37 user nova-compute[74611]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 09:56:37 user nova-compute[74611]:       <source file='/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk.config' index='1'/>
Nov 13 09:56:37 user nova-compute[74611]:       <backingStore/>
Nov 13 09:56:37 user nova-compute[74611]:       <target dev='hda' bus='ide'/>
Nov 13 09:56:37 user nova-compute[74611]:       <readonly/>
Nov 13 09:56:37 user nova-compute[74611]:       <alias name='ide0-0-0'/>
Nov 13 09:56:37 user nova-compute[74611]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 09:56:37 user nova-compute[74611]:     </disk>
Nov 13 09:56:37 user nova-compute[74611]:     <controller type='usb' index='0' model='none'>
Nov 13 09:56:37 user nova-compute[74611]:       <alias name='usb'/>
Nov 13 09:56:37 user nova-compute[74611]:     </controller>
Nov 13 09:56:37 user nova-compute[74611]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 09:56:37 user nova-compute[74611]:       <alias name='pci.0'/>
Nov 13 09:56:37 user nova-compute[74611]:     </controller>
Nov 13 09:56:37 user nova-compute[74611]:     <controller type='ide' index='0'>
Nov 13 09:56:37 user nova-compute[74611]:       <alias name='ide'/>
Nov 13 09:56:37 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 09:56:37 user nova-compute[74611]:     </controller>
Nov 13 09:56:37 user nova-compute[74611]:     <interface type='ethernet'>
Nov 13 09:56:37 user nova-compute[74611]:       <mac address='fa:16:3e:05:dc:a6'/>
Nov 13 09:56:37 user nova-compute[74611]:       <target dev='tap805b4d7d-b2'/>
Nov 13 09:56:37 user nova-compute[74611]:       <model type='virtio'/>
Nov 13 09:56:37 user nova-compute[74611]:       <mtu size='1442'/>
Nov 13 09:56:37 user nova-compute[74611]:       <alias name='net0'/>
Nov 13 09:56:37 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 09:56:37 user nova-compute[74611]:     </interface>
Nov 13 09:56:37 user nova-compute[74611]:     <interface type='ethernet'>
Nov 13 09:56:37 user nova-compute[74611]:       <mac address='fa:16:3e:0e:84:69'/>
Nov 13 09:56:37 user nova-compute[74611]:       <target dev='tap266e9729-66'/>
Nov 13 09:56:37 user nova-compute[74611]:       <model type='virtio'/>
Nov 13 09:56:37 user nova-compute[74611]:       <mtu size='1442'/>
Nov 13 09:56:37 user nova-compute[74611]:       <alias name='net1'/>
Nov 13 09:56:37 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 13 09:56:37 user nova-compute[74611]:     </interface>
Nov 13 09:56:37 user nova-compute[74611]:     <serial type='pty'>
Nov 13 09:56:37 user nova-compute[74611]:       <source path='/dev/pts/8'/>
Nov 13 09:56:37 user nova-compute[74611]:       <log file='/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/console.log' append='off'/>
Nov 13 09:56:37 user nova-compute[74611]:       <target type='isa-serial' port='0'>
Nov 13 09:56:37 user nova-compute[74611]:         <model name='isa-serial'/>
Nov 13 09:56:37 user nova-compute[74611]:       </target>
Nov 13 09:56:37 user nova-compute[74611]:       <alias name='serial0'/>
Nov 13 09:56:37 user nova-compute[74611]:     </serial>
Nov 13 09:56:37 user nova-compute[74611]:     <console type='pty' tty='/dev/pts/8'>
Nov 13 09:56:37 user nova-compute[74611]:       <source path='/dev/pts/8'/>
Nov 13 09:56:37 user nova-compute[74611]:       <log file='/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/console.log' append='off'/>
Nov 13 09:56:37 user nova-compute[74611]:       <target type='serial' port='0'/>
Nov 13 09:56:37 user nova-compute[74611]:       <alias name='serial0'/>
Nov 13 09:56:37 user nova-compute[74611]:     </console>
Nov 13 09:56:37 user nova-compute[74611]:     <input type='mouse' bus='ps2'>
Nov 13 09:56:37 user nova-compute[74611]:       <alias name='input0'/>
Nov 13 09:56:37 user nova-compute[74611]:     </input>
Nov 13 09:56:37 user nova-compute[74611]:     <input type='keyboard' bus='ps2'>
Nov 13 09:56:37 user nova-compute[74611]:       <alias name='input1'/>
Nov 13 09:56:37 user nova-compute[74611]:     </input>
Nov 13 09:56:37 user nova-compute[74611]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 13 09:56:37 user nova-compute[74611]:       <listen type='address' address='0.0.0.0'/>
Nov 13 09:56:37 user nova-compute[74611]:     </graphics>
Nov 13 09:56:37 user nova-compute[74611]:     <audio id='1' type='none'/>
Nov 13 09:56:37 user nova-compute[74611]:     <video>
Nov 13 09:56:37 user nova-compute[74611]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 09:56:37 user nova-compute[74611]:       <alias name='video0'/>
Nov 13 09:56:37 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 09:56:37 user nova-compute[74611]:     </video>
Nov 13 09:56:37 user nova-compute[74611]:     <memballoon model='virtio'>
Nov 13 09:56:37 user nova-compute[74611]:       <stats period='10'/>
Nov 13 09:56:37 user nova-compute[74611]:       <alias name='balloon0'/>
Nov 13 09:56:37 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 09:56:37 user nova-compute[74611]:     </memballoon>
Nov 13 09:56:37 user nova-compute[74611]:     <rng model='virtio'>
Nov 13 09:56:37 user nova-compute[74611]:       <backend model='random'>/dev/urandom</backend>
Nov 13 09:56:37 user nova-compute[74611]:       <alias name='rng0'/>
Nov 13 09:56:37 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 09:56:37 user nova-compute[74611]:     </rng>
Nov 13 09:56:37 user nova-compute[74611]:   </devices>
Nov 13 09:56:37 user nova-compute[74611]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 09:56:37 user nova-compute[74611]:     <label>libvirt-eea01f90-3c79-4304-913e-8cf7e9749480</label>
Nov 13 09:56:37 user nova-compute[74611]:     <imagelabel>libvirt-eea01f90-3c79-4304-913e-8cf7e9749480</imagelabel>
Nov 13 09:56:37 user nova-compute[74611]:   </seclabel>
Nov 13 09:56:37 user nova-compute[74611]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 09:56:37 user nova-compute[74611]:     <label>+64055:+108</label>
Nov 13 09:56:37 user nova-compute[74611]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 09:56:37 user nova-compute[74611]:   </seclabel>
Nov 13 09:56:37 user nova-compute[74611]: </domain>
Nov 13 09:56:37 user nova-compute[74611]:  {{(pid=74611) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 09:56:37 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Successfully detached device tap266e9729-66 from instance eea01f90-3c79-4304-913e-8cf7e9749480 from the persistent domain config.
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] (1/8): Attempting to detach device tap266e9729-66 with device alias net1 from instance eea01f90-3c79-4304-913e-8cf7e9749480 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] detach device xml: <interface type="ethernet">
Nov 13 09:56:37 user nova-compute[74611]:   <mac address="fa:16:3e:0e:84:69"/>
Nov 13 09:56:37 user nova-compute[74611]:   <model type="virtio"/>
Nov 13 09:56:37 user nova-compute[74611]:   <mtu size="1442"/>
Nov 13 09:56:37 user nova-compute[74611]:   <target dev="tap266e9729-66"/>
Nov 13 09:56:37 user nova-compute[74611]: </interface>
Nov 13 09:56:37 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb6acd2-8620-4863-a95d-95d94524f453]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Flushing IO for device /dev/sdd {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[90815086-9804-4b57-b837-86d9d09811d9]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a92b37-d59a-49b4-991f-24d2278d6423]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] SCSI volumes sdd have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1c0a18-5599-45d5-88f7-be95c59ddfc9]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[205ec332-3940-4857-949f-db56d1cab139]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e, portal: 172.16.0.220,3260]
Nov 13 09:56:37 user nova-compute[74611]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:37 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Took 0.96 seconds to deallocate network for instance.
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7762389-e6c5-4998-9147-658237a6be3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9f4ef2-c273-4bea-ba50-058a7c613ae2]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] <== disconnect_volume: return (340ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 09:56:37 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Deleting instance files /opt/stack/data/nova/instances/47f298b4-50b7-4dac-b9ee-a904be6445b9_del
Nov 13 09:56:37 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Deletion of /opt/stack/data/nova/instances/47f298b4-50b7-4dac-b9ee-a904be6445b9_del complete
Nov 13 09:56:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Start waiting for the detach event from libvirt for device tap266e9729-66 with device alias net1 for instance eea01f90-3c79-4304-913e-8cf7e9749480 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 09:56:38 user nova-compute[74611]: INFO nova.compute.manager [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Took 3.93 seconds to destroy the instance on the hypervisor.
Nov 13 09:56:38 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:38 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Deleted allocations for instance 54fdbd33-6f7c-440b-968b-cd743e2562c4
Nov 13 09:56:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e958faff-4e61-462a-8c11-c89b12fa2a3a tempest-AttachSCSIVolumeTestJSON-1150883813 tempest-AttachSCSIVolumeTestJSON-1150883813-project-member] Lock "54fdbd33-6f7c-440b-968b-cd743e2562c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.528s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-579f5707-d409-4d5c-932e-21b2e904b5c4 req-b5df451e-cb96-4445-8ea3-21fc57d2c31b service nova] [instance: 54fdbd33-6f7c-440b-968b-cd743e2562c4] Received event network-vif-deleted-b4bcb0be-ccc9-41d6-ae5e-7d5fa53eead6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-a9d9d3e3-7409-412c-b337-5dc5d8a3cfc5 req-1ad25700-8a46-4dda-841d-20eade8bd016 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received event network-vif-unplugged-266e9729-66ec-47c1-b5a4-a23e4cb79de6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a9d9d3e3-7409-412c-b337-5dc5d8a3cfc5 req-1ad25700-8a46-4dda-841d-20eade8bd016 service nova] Acquiring lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a9d9d3e3-7409-412c-b337-5dc5d8a3cfc5 req-1ad25700-8a46-4dda-841d-20eade8bd016 service nova] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a9d9d3e3-7409-412c-b337-5dc5d8a3cfc5 req-1ad25700-8a46-4dda-841d-20eade8bd016 service nova] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-a9d9d3e3-7409-412c-b337-5dc5d8a3cfc5 req-1ad25700-8a46-4dda-841d-20eade8bd016 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] No waiting events found dispatching network-vif-unplugged-266e9729-66ec-47c1-b5a4-a23e4cb79de6 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:38 user nova-compute[74611]: WARNING nova.compute.manager [req-a9d9d3e3-7409-412c-b337-5dc5d8a3cfc5 req-1ad25700-8a46-4dda-841d-20eade8bd016 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received unexpected event network-vif-unplugged-266e9729-66ec-47c1-b5a4-a23e4cb79de6 for instance with vm_state active and task_state None.
Nov 13 09:56:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-a9d9d3e3-7409-412c-b337-5dc5d8a3cfc5 req-1ad25700-8a46-4dda-841d-20eade8bd016 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received event network-vif-plugged-266e9729-66ec-47c1-b5a4-a23e4cb79de6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a9d9d3e3-7409-412c-b337-5dc5d8a3cfc5 req-1ad25700-8a46-4dda-841d-20eade8bd016 service nova] Acquiring lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a9d9d3e3-7409-412c-b337-5dc5d8a3cfc5 req-1ad25700-8a46-4dda-841d-20eade8bd016 service nova] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a9d9d3e3-7409-412c-b337-5dc5d8a3cfc5 req-1ad25700-8a46-4dda-841d-20eade8bd016 service nova] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-a9d9d3e3-7409-412c-b337-5dc5d8a3cfc5 req-1ad25700-8a46-4dda-841d-20eade8bd016 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] No waiting events found dispatching network-vif-plugged-266e9729-66ec-47c1-b5a4-a23e4cb79de6 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:38 user nova-compute[74611]: WARNING nova.compute.manager [req-a9d9d3e3-7409-412c-b337-5dc5d8a3cfc5 req-1ad25700-8a46-4dda-841d-20eade8bd016 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received unexpected event network-vif-plugged-266e9729-66ec-47c1-b5a4-a23e4cb79de6 for instance with vm_state active and task_state None.
Nov 13 09:56:39 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:56:39 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:56:39 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:56:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:56:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:39 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:56:39 user nova-compute[74611]: INFO nova.compute.claims [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Claim successful on node user
Nov 13 09:56:39 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:56:39 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:56:40 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:56:40 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG nova.policy [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6bc911a5649643a6a3606d8b80e20eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e3b3233a5b43d682200d91f29a80b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:56:40 user nova-compute[74611]: INFO nova.virt.block_device [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Booting with blank volume at /dev/vda
Nov 13 09:56:40 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Successfully created port: 37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-cacd0a1e-e94b-4d2b-b7f2-fb93247144ec req-57dcb6f2-e36a-4069-8919-64289a42d576 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-deleted-0bcd0f90-f88f-45b7-a157-d8a879bbf7dc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:40 user nova-compute[74611]: INFO nova.compute.manager [req-cacd0a1e-e94b-4d2b-b7f2-fb93247144ec req-57dcb6f2-e36a-4069-8919-64289a42d576 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Neutron deleted interface 0bcd0f90-f88f-45b7-a157-d8a879bbf7dc; detaching it from the instance and deleting it from the info cache
Nov 13 09:56:40 user nova-compute[74611]: DEBUG nova.network.neutron [req-cacd0a1e-e94b-4d2b-b7f2-fb93247144ec req-57dcb6f2-e36a-4069-8919-64289a42d576 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updating instance_info_cache with network_info: [{"id": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "address": "fa:16:3e:0a:d3:f1", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44a7351c-73", "ovs_interfaceid": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073dacdd-40ea-46ff-8d11-e64a22034430", "address": "fa:16:3e:33:b1:80", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073dacdd-40", "ovs_interfaceid": "073dacdd-40ea-46ff-8d11-e64a22034430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58c272d9-ef57-4958-95e8-baa49c651ab1", "address": "fa:16:3e:95:46:59", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c272d9-ef", "ovs_interfaceid": "58c272d9-ef57-4958-95e8-baa49c651ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "address": "fa:16:3e:42:01:05", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38783fd3-e9", "ovs_interfaceid": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "address": "fa:16:3e:f1:aa:7c", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae2585-56", "ovs_interfaceid": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "address": "fa:16:3e:49:7a:2f", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24fd98ca-fe", "ovs_interfaceid": "24fd98ca-fe56-4410-8409-68f9010bf1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-cacd0a1e-e94b-4d2b-b7f2-fb93247144ec req-57dcb6f2-e36a-4069-8919-64289a42d576 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Detach interface failed, port_id=0bcd0f90-f88f-45b7-a157-d8a879bbf7dc, reason: Instance 47f298b4-50b7-4dac-b9ee-a904be6445b9 could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-cacd0a1e-e94b-4d2b-b7f2-fb93247144ec req-57dcb6f2-e36a-4069-8919-64289a42d576 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-deleted-24fd98ca-fe56-4410-8409-68f9010bf1ae {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:40 user nova-compute[74611]: INFO nova.compute.manager [req-cacd0a1e-e94b-4d2b-b7f2-fb93247144ec req-57dcb6f2-e36a-4069-8919-64289a42d576 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Neutron deleted interface 24fd98ca-fe56-4410-8409-68f9010bf1ae; detaching it from the instance and deleting it from the info cache
Nov 13 09:56:40 user nova-compute[74611]: DEBUG nova.network.neutron [req-cacd0a1e-e94b-4d2b-b7f2-fb93247144ec req-57dcb6f2-e36a-4069-8919-64289a42d576 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updating instance_info_cache with network_info: [{"id": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "address": "fa:16:3e:0a:d3:f1", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44a7351c-73", "ovs_interfaceid": "44a7351c-7369-4cd4-b7b6-5ec7d8691901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073dacdd-40ea-46ff-8d11-e64a22034430", "address": "fa:16:3e:33:b1:80", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073dacdd-40", "ovs_interfaceid": "073dacdd-40ea-46ff-8d11-e64a22034430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58c272d9-ef57-4958-95e8-baa49c651ab1", "address": "fa:16:3e:95:46:59", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c272d9-ef", "ovs_interfaceid": "58c272d9-ef57-4958-95e8-baa49c651ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "address": "fa:16:3e:42:01:05", "network": {"id": "1f049580-cb5c-4dec-bbe5-efecba6f0e6d", "bridge": "br-int", "label": "tempest-device-tagging-net1-2095229208", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38783fd3-e9", "ovs_interfaceid": "38783fd3-e90d-48ba-a670-41f195ccdfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "address": "fa:16:3e:f1:aa:7c", "network": {"id": "21f8ed5b-00f0-404f-b533-220e84f88c49", "bridge": "br-int", "label": "tempest-device-tagging-net2-451394540", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2aa3bd8dccd14bab978842976f64310f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae2585-56", "ovs_interfaceid": "08ae2585-56bf-44f5-bf94-d06952b8a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-cacd0a1e-e94b-4d2b-b7f2-fb93247144ec req-57dcb6f2-e36a-4069-8919-64289a42d576 service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Detach interface failed, port_id=24fd98ca-fe56-4410-8409-68f9010bf1ae, reason: Instance 47f298b4-50b7-4dac-b9ee-a904be6445b9 could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Successfully updated port: 37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquired lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG nova.compute.manager [req-95e88672-b25d-4d1b-adad-50dabdb1d16d req-06924da4-6238-4104-9da8-847ec89b726c service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received event network-changed-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG nova.compute.manager [req-95e88672-b25d-4d1b-adad-50dabdb1d16d req-06924da4-6238-4104-9da8-847ec89b726c service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Refreshing instance network info cache due to event network-changed-37c25482-a620-4013-9e9d-e14c53d87bc4. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-95e88672-b25d-4d1b-adad-50dabdb1d16d req-06924da4-6238-4104-9da8-847ec89b726c service nova] Acquiring lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:41 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Took 3.45 seconds to deallocate network for instance.
Nov 13 09:56:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Updating instance_info_cache with network_info: [{"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Releasing lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Instance network_info: |[{"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-95e88672-b25d-4d1b-adad-50dabdb1d16d req-06924da4-6238-4104-9da8-847ec89b726c service nova] Acquired lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG nova.network.neutron [req-95e88672-b25d-4d1b-adad-50dabdb1d16d req-06924da4-6238-4104-9da8-847ec89b726c service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Refreshing network info cache for port 37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG nova.network.neutron [req-95e88672-b25d-4d1b-adad-50dabdb1d16d req-06924da4-6238-4104-9da8-847ec89b726c service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Updated VIF entry in instance network info cache for port 37c25482-a620-4013-9e9d-e14c53d87bc4. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG nova.network.neutron [req-95e88672-b25d-4d1b-adad-50dabdb1d16d req-06924da4-6238-4104-9da8-847ec89b726c service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Updating instance_info_cache with network_info: [{"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-95e88672-b25d-4d1b-adad-50dabdb1d16d req-06924da4-6238-4104-9da8-847ec89b726c service nova] Releasing lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG nova.compute.manager [req-d1073a35-55c0-4cbe-ae2c-be110e6932ef req-f950d272-61cf-470f-b7b8-d53f1453a3be service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-deleted-58c272d9-ef57-4958-95e8-baa49c651ab1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG nova.compute.manager [req-d1073a35-55c0-4cbe-ae2c-be110e6932ef req-f950d272-61cf-470f-b7b8-d53f1453a3be service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-deleted-08ae2585-56bf-44f5-bf94-d06952b8a60d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG nova.compute.manager [req-d1073a35-55c0-4cbe-ae2c-be110e6932ef req-f950d272-61cf-470f-b7b8-d53f1453a3be service nova] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Received event network-vif-deleted-38783fd3-e90d-48ba-a670-41f195ccdfc8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:43 user nova-compute[74611]: INFO nova.compute.manager [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] [instance: 47f298b4-50b7-4dac-b9ee-a904be6445b9] Took 2.12 seconds to detach 3 volumes for instance.
Nov 13 09:56:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:44 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c is timed out.
Nov 13 09:56:44 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Successfully detached device vdb from instance 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c from the live domain config.
Nov 13 09:56:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TNolwqLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:44 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f70736-b6d8-4abb-ab9d-9a480bb85761]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 09:56:44 user nova-compute[74611]: No targets found.
Nov 13 09:56:44 user nova-compute[74611]: iSNS:
Nov 13 09:56:44 user nova-compute[74611]: No targets found.
Nov 13 09:56:44 user nova-compute[74611]: STATIC:
Nov 13 09:56:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957
Nov 13 09:56:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d
Nov 13 09:56:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed
Nov 13 09:56:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:44 user nova-compute[74611]: FIRMWARE:
Nov 13 09:56:44 user nova-compute[74611]: No targets found.
Nov 13 09:56:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 09:56:44 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 09:56:44 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d14430-b2b7-478e-af31-14c1fbc0c824]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6830637b-7344-4e39-b734-aeb8309da754]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:44 user nova-compute[74611]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:44 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed (non-flash)
Nov 13 09:56:44 user nova-compute[74611]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:44 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64629240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed'): ({'sdk'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Removing single pathed devices sdk {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0e3024-b1b2-4cdd-a148-9ad4397485b4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.494s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf3899b-0b63-4d5b-b257-ce7b02eeca3a]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Flushing IO for device /dev/sdk {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:44 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Deleted allocations for instance 47f298b4-50b7-4dac-b9ee-a904be6445b9
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f14487c-9424-4e35-892a-16860f04dc34]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.038s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ce9cdb-81f1-4dd9-9aea-e317fe813b21]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] SCSI volumes sdk have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e456b9-7d1e-459c-b6be-fb4b53610f09]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-70620836-fc45-4b25-b771-c6b1864593ab tempest-TaggedBootDevicesTest-570022671 tempest-TaggedBootDevicesTest-570022671-project-member] Lock "47f298b4-50b7-4dac-b9ee-a904be6445b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.208s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0b83db-91fc-48b7-8d05-a534d9ca0615]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed, portal: 172.16.0.220,3260]
Nov 13 09:56:44 user nova-compute[74611]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9db5b9-413f-4e8c-9270-f55f4cb4d9ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ad5d8e-1f04-4ab0-b457-cffbe33931fb]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] <== disconnect_volume: return (346ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.objects.instance [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Lazy-loading 'flavor' on Instance uuid 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:45 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:56:45 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=7015MB free_disk=25.456905364990234GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c39b4c5a-38ad-4021-98b1-16971023da9a tempest-VolumesAssistedSnapshotsTest-238799406 tempest-VolumesAssistedSnapshotsTest-238799406-project-admin] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.821s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 85cb3adb-b2b3-49ec-92ab-c2b7a028241a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 1c66c8a8-abb5-4f60-8464-074627c213d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance fe53a1a8-de5b-4679-bddb-1da5204dbab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 5b70fc11-140f-4c9a-9e75-2b33705d8c6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance eea01f90-3c79-4304-913e-8cf7e9749480 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 89038547-5416-4942-8070-dd5dd8e4b6c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 1958dc22-14f4-42ca-966d-f489e402e001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG os_brick.utils [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1a020c-e3ed-4f92-aa6d-48abc9503fe8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a648742-fc84-467d-9f8d-7fcda4e04219]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45046a4-6f44-41a7-a8eb-a573c2839f47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0633d0c5-4969-4ced-bfd6-c0e9f2aadf4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:56:45 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:56:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feeff79-3658-4232-beaf-beb91a2cb2e8]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG os_brick.utils [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:45 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Updating existing volume attachment record: a66edeb7-683a-4173-ad85-8428d60c4caa {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:56:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:56:49 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Creating image(s)
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Ensure instance console log exists: /opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Start _get_guest_xml network_info=[{"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'a66edeb7-683a-4173-ad85-8428d60c4caa', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItvJYDgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c2479a4-1384-4845-86d8-b5fd26fa6ec4', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a', 'serial': 'ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:56:49 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:56:49 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItvJYDgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:49 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:50 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:50 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8313600-e60f-47fe-b63c-c0f6e95a5a52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:56:50 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[486c249c-194c-4ca8-9779-a393578a815c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a] added
Nov 13 09:56:50 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f523925-19cc-4832-9953-2180695c27d7]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e947e6fa-ab18-47d2-b4d6-f827fba05426]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItvJYDgb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItvJYDgb" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a51466-f4ae-40c5-b88c-92c86e6d19d0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ItvJYDgb'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a8fbb6-9bf9-47c1-8a22-108e899d12b3]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7db9a9-454d-4226-a847-97dd6d1d4eb5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:50 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:50 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:50 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:50 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ad809d-341d-4c79-9c51-de826500fa4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a, portal: 172.16.0.220,3260]
Nov 13 09:56:50 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:50 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.056s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cb2574-1d69-43fd-82fa-60d389014a7d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[65610c32-ab0b-4dff-97fa-9745963181ff]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:50 user nova-compute[74611]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:56:50 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:50 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:50 user nova-compute[74611]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:56:50 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:50 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[193846cf-c6ea-4884-b7fd-0263cc9cdc23]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:56:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItvJYDgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26431613863616236', 'path': '/dev/sdc'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431613863616236', 'path': '/dev/sdc'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:56:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-937478887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-937478887',id=16,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83e3b3233a5b43d682200d91f29a80b4',ramdisk_id='',reservation_id='r-qh3r9bur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-182847603',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:56:40Z,user_data=None,user_id='6bc911a5649643a6a3606d8b80e20eb0',uuid=7c2479a4-1384-4845-86d8-b5fd26fa6ec4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converting VIF {"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:fe:e6,bridge_name='br-int',has_traffic_filtering=True,id=37c25482-a620-4013-9e9d-e14c53d87bc4,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37c25482-a6') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG nova.objects.instance [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:56:51 user nova-compute[74611]:   <uuid>7c2479a4-1384-4845-86d8-b5fd26fa6ec4</uuid>
Nov 13 09:56:51 user nova-compute[74611]:   <name>instance-00000010</name>
Nov 13 09:56:51 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:56:51 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:56:51 user nova-compute[74611]:   <metadata>
Nov 13 09:56:51 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:56:51 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:56:51 user nova-compute[74611]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-937478887</nova:name>
Nov 13 09:56:51 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:56:49</nova:creationTime>
Nov 13 09:56:51 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:56:51 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:56:51 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:56:51 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:56:51 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:56:51 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:56:51 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:56:51 user nova-compute[74611]:       <nova:owner>
Nov 13 09:56:51 user nova-compute[74611]:         <nova:user uuid="6bc911a5649643a6a3606d8b80e20eb0">tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member</nova:user>
Nov 13 09:56:51 user nova-compute[74611]:         <nova:project uuid="83e3b3233a5b43d682200d91f29a80b4">tempest-ServerBootFromVolumeStableRescueTest-182847603</nova:project>
Nov 13 09:56:51 user nova-compute[74611]:       </nova:owner>
Nov 13 09:56:51 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:56:51 user nova-compute[74611]:       <nova:ports>
Nov 13 09:56:51 user nova-compute[74611]:         <nova:port uuid="37c25482-a620-4013-9e9d-e14c53d87bc4">
Nov 13 09:56:51 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 09:56:51 user nova-compute[74611]:         </nova:port>
Nov 13 09:56:51 user nova-compute[74611]:       </nova:ports>
Nov 13 09:56:51 user nova-compute[74611]:     </nova:instance>
Nov 13 09:56:51 user nova-compute[74611]:   </metadata>
Nov 13 09:56:51 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:56:51 user nova-compute[74611]:     <system>
Nov 13 09:56:51 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:56:51 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:56:51 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:56:51 user nova-compute[74611]:       <entry name="serial">7c2479a4-1384-4845-86d8-b5fd26fa6ec4</entry>
Nov 13 09:56:51 user nova-compute[74611]:       <entry name="uuid">7c2479a4-1384-4845-86d8-b5fd26fa6ec4</entry>
Nov 13 09:56:51 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:56:51 user nova-compute[74611]:     </system>
Nov 13 09:56:51 user nova-compute[74611]:   </sysinfo>
Nov 13 09:56:51 user nova-compute[74611]:   <os>
Nov 13 09:56:51 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:56:51 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:56:51 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:56:51 user nova-compute[74611]:   </os>
Nov 13 09:56:51 user nova-compute[74611]:   <features>
Nov 13 09:56:51 user nova-compute[74611]:     <acpi/>
Nov 13 09:56:51 user nova-compute[74611]:     <apic/>
Nov 13 09:56:51 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:56:51 user nova-compute[74611]:   </features>
Nov 13 09:56:51 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:56:51 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:56:51 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:56:51 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:56:51 user nova-compute[74611]:   </clock>
Nov 13 09:56:51 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:56:51 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:56:51 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:56:51 user nova-compute[74611]:   </cpu>
Nov 13 09:56:51 user nova-compute[74611]:   <devices>
Nov 13 09:56:51 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 09:56:51 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:56:51 user nova-compute[74611]:       <source dev="/dev/sdc"/>
Nov 13 09:56:51 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:56:51 user nova-compute[74611]:       <serial>ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a</serial>
Nov 13 09:56:51 user nova-compute[74611]:     </disk>
Nov 13 09:56:51 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:56:51 user nova-compute[74611]:       <mac address="fa:16:3e:6e:fe:e6"/>
Nov 13 09:56:51 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:56:51 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:56:51 user nova-compute[74611]:       <target dev="tap37c25482-a6"/>
Nov 13 09:56:51 user nova-compute[74611]:     </interface>
Nov 13 09:56:51 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:56:51 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/console.log" append="off"/>
Nov 13 09:56:51 user nova-compute[74611]:     </serial>
Nov 13 09:56:51 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:56:51 user nova-compute[74611]:     <video>
Nov 13 09:56:51 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:56:51 user nova-compute[74611]:     </video>
Nov 13 09:56:51 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:56:51 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:56:51 user nova-compute[74611]:     </rng>
Nov 13 09:56:51 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:56:51 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:56:51 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:56:51 user nova-compute[74611]:     </memballoon>
Nov 13 09:56:51 user nova-compute[74611]:   </devices>
Nov 13 09:56:51 user nova-compute[74611]: </domain>
Nov 13 09:56:51 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:56:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-937478887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-937478887',id=16,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83e3b3233a5b43d682200d91f29a80b4',ramdisk_id='',reservation_id='r-qh3r9bur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-182847603',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:56:40Z,user_data=None,user_id='6bc911a5649643a6a3606d8b80e20eb0',uuid=7c2479a4-1384-4845-86d8-b5fd26fa6ec4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converting VIF {"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:fe:e6,bridge_name='br-int',has_traffic_filtering=True,id=37c25482-a620-4013-9e9d-e14c53d87bc4,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37c25482-a6') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG os_vif [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:fe:e6,bridge_name='br-int',has_traffic_filtering=True,id=37c25482-a620-4013-9e9d-e14c53d87bc4,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37c25482-a6') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96a001aa-1ea7-5fc2-8f66-3332d386cd36', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37c25482-a6, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37c25482-a6, col_values=(('qos', UUID('01be56ec-91df-4ea2-9044-4175d59da97e')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37c25482-a6, col_values=(('external_ids', {'iface-id': '37c25482-a620-4013-9e9d-e14c53d87bc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:fe:e6', 'vm-uuid': '7c2479a4-1384-4845-86d8-b5fd26fa6ec4'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:51 user nova-compute[74611]: INFO os_vif [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:fe:e6,bridge_name='br-int',has_traffic_filtering=True,id=37c25482-a620-4013-9e9d-e14c53d87bc4,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37c25482-a6')
Nov 13 09:56:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:56:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] No VIF found with MAC fa:16:3e:6e:fe:e6, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:56:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-d325c391-33c1-47b7-8723-d9def0280d14 req-21de23aa-c6bc-4dc6-9071-1fd22f395c38 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d325c391-33c1-47b7-8723-d9def0280d14 req-21de23aa-c6bc-4dc6-9071-1fd22f395c38 service nova] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d325c391-33c1-47b7-8723-d9def0280d14 req-21de23aa-c6bc-4dc6-9071-1fd22f395c38 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d325c391-33c1-47b7-8723-d9def0280d14 req-21de23aa-c6bc-4dc6-9071-1fd22f395c38 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-d325c391-33c1-47b7-8723-d9def0280d14 req-21de23aa-c6bc-4dc6-9071-1fd22f395c38 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] No waiting events found dispatching network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:52 user nova-compute[74611]: WARNING nova.compute.manager [req-d325c391-33c1-47b7-8723-d9def0280d14 req-21de23aa-c6bc-4dc6-9071-1fd22f395c38 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received unexpected event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 for instance with vm_state building and task_state spawning.
Nov 13 09:56:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:56:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:56:54 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Instance spawned successfully.
Nov 13 09:56:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:56:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:56:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:56:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:56:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:56:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:56:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:56:54 user nova-compute[74611]: INFO nova.compute.manager [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 13 09:56:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:56:55 user nova-compute[74611]: INFO nova.compute.manager [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Took 15.52 seconds to build instance.
Nov 13 09:56:55 user nova-compute[74611]: DEBUG nova.compute.manager [req-b8dce2cc-00f4-475d-9e8c-fa510818ddd4 req-1fffd9f8-0e4a-4fac-825b-61bdb55089f2 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b8dce2cc-00f4-475d-9e8c-fa510818ddd4 req-1fffd9f8-0e4a-4fac-825b-61bdb55089f2 service nova] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:56:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b8dce2cc-00f4-475d-9e8c-fa510818ddd4 req-1fffd9f8-0e4a-4fac-825b-61bdb55089f2 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:56:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b8dce2cc-00f4-475d-9e8c-fa510818ddd4 req-1fffd9f8-0e4a-4fac-825b-61bdb55089f2 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:55 user nova-compute[74611]: DEBUG nova.compute.manager [req-b8dce2cc-00f4-475d-9e8c-fa510818ddd4 req-1fffd9f8-0e4a-4fac-825b-61bdb55089f2 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] No waiting events found dispatching network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:56:55 user nova-compute[74611]: WARNING nova.compute.manager [req-b8dce2cc-00f4-475d-9e8c-fa510818ddd4 req-1fffd9f8-0e4a-4fac-825b-61bdb55089f2 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received unexpected event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 for instance with vm_state active and task_state None.
Nov 13 09:56:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a2644998-679f-4390-8670-480333aae137 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.628s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:57 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5b70fc11-140f-4c9a-9e75-2b33705d8c6d is timed out.
Nov 13 09:56:57 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Successfully detached device vdb from instance 5b70fc11-140f-4c9a-9e75-2b33705d8c6d from the live domain config.
Nov 13 09:56:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtlAmsfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'f3079aaf-9e56-4219-a7ef-32f459f61957'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:56:57 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c48e46c-bad8-426f-871e-1788ba3443fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 09:56:57 user nova-compute[74611]: No targets found.
Nov 13 09:56:57 user nova-compute[74611]: iSNS:
Nov 13 09:56:57 user nova-compute[74611]: No targets found.
Nov 13 09:56:57 user nova-compute[74611]: STATIC:
Nov 13 09:56:57 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957
Nov 13 09:56:57 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:57 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:57 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d
Nov 13 09:56:57 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:57 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:57 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 09:56:57 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:56:57 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:56:57 user nova-compute[74611]: FIRMWARE:
Nov 13 09:56:57 user nova-compute[74611]: No targets found.
Nov 13 09:56:57 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 09:56:57 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 09:56:57 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef7a11a-53c3-47a0-a854-355f29aff18c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec72b71-664c-4511-a30c-8c4b562d1afd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:57 user nova-compute[74611]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:56:57 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:57 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 (non-flash)
Nov 13 09:56:57 user nova-compute[74611]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:56:57 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:56:57 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64629360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6527dd5-0d6a-4475-83d1-d5900b9b2bd8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91e157a-5b38-4616-9fab-a71f0ba77ee7]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead44c04-67ef-4ea9-a47b-8763559eaa3c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ac096c-b93f-4ee3-9f89-8747bad50604]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe5baf1-2664-4372-81fc-606ab6328151]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53ec9a0-7597-40e4-84b6-83bd78fba54b]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957, portal: 172.16.0.220,3260]
Nov 13 09:56:57 user nova-compute[74611]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957, portal: 172.16.0.220,3260] successful.
Nov 13 09:56:57 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3079aaf-9e56-4219-a7ef-32f459f61957 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8510cb6-7ca5-46a6-b785-f535f9171401]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] <== disconnect_volume: return (292ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:56:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 09:56:58 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Waiting for libvirt event about the detach of device tap266e9729-66 with device alias net1 from instance eea01f90-3c79-4304-913e-8cf7e9749480 is timed out.
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:84:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap266e9729-66"/></interface> {{(pid=74611) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0e:84:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap266e9729-66"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 13 09:56:58 user nova-compute[74611]:   <name>instance-00000008</name>
Nov 13 09:56:58 user nova-compute[74611]:   <uuid>eea01f90-3c79-4304-913e-8cf7e9749480</uuid>
Nov 13 09:56:58 user nova-compute[74611]:   <metadata>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:56:58 user nova-compute[74611]:   <nova:package version="0.0.0"/>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:name>tempest-device-tagging-server-560513437</nova:name>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:creationTime>2023-11-13 09:56:05</nova:creationTime>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:flavor name="m1.tiny">
Nov 13 09:56:58 user nova-compute[74611]:     <nova:memory>512</nova:memory>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:disk>1</nova:disk>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:swap>0</nova:swap>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:vcpus>1</nova:vcpus>
Nov 13 09:56:58 user nova-compute[74611]:   </nova:flavor>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:owner>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:user uuid="a4627e309322495f90a6e412f7e36c75">tempest-TaggedAttachmentsTest-987448261-project-member</nova:user>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:project uuid="9f6f36a09d514934ab7e11e7e945658f">tempest-TaggedAttachmentsTest-987448261</nova:project>
Nov 13 09:56:58 user nova-compute[74611]:   </nova:owner>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:ports>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:port uuid="805b4d7d-b250-40e4-af31-e9f281182115">
Nov 13 09:56:58 user nova-compute[74611]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 09:56:58 user nova-compute[74611]:     </nova:port>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:port uuid="266e9729-66ec-47c1-b5a4-a23e4cb79de6">
Nov 13 09:56:58 user nova-compute[74611]:       <nova:ip type="fixed" address="10.10.10.152" ipVersion="4"/>
Nov 13 09:56:58 user nova-compute[74611]:     </nova:port>
Nov 13 09:56:58 user nova-compute[74611]:   </nova:ports>
Nov 13 09:56:58 user nova-compute[74611]: </nova:instance>
Nov 13 09:56:58 user nova-compute[74611]:   </metadata>
Nov 13 09:56:58 user nova-compute[74611]:   <memory unit='KiB'>524288</memory>
Nov 13 09:56:58 user nova-compute[74611]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 09:56:58 user nova-compute[74611]:   <vcpu placement='static'>1</vcpu>
Nov 13 09:56:58 user nova-compute[74611]:   <resource>
Nov 13 09:56:58 user nova-compute[74611]:     <partition>/machine</partition>
Nov 13 09:56:58 user nova-compute[74611]:   </resource>
Nov 13 09:56:58 user nova-compute[74611]:   <sysinfo type='smbios'>
Nov 13 09:56:58 user nova-compute[74611]:     <system>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='version'>0.0.0</entry>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='serial'>eea01f90-3c79-4304-913e-8cf7e9749480</entry>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='uuid'>eea01f90-3c79-4304-913e-8cf7e9749480</entry>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='family'>Virtual Machine</entry>
Nov 13 09:56:58 user nova-compute[74611]:     </system>
Nov 13 09:56:58 user nova-compute[74611]:   </sysinfo>
Nov 13 09:56:58 user nova-compute[74611]:   <os>
Nov 13 09:56:58 user nova-compute[74611]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 09:56:58 user nova-compute[74611]:     <boot dev='hd'/>
Nov 13 09:56:58 user nova-compute[74611]:     <smbios mode='sysinfo'/>
Nov 13 09:56:58 user nova-compute[74611]:   </os>
Nov 13 09:56:58 user nova-compute[74611]:   <features>
Nov 13 09:56:58 user nova-compute[74611]:     <acpi/>
Nov 13 09:56:58 user nova-compute[74611]:     <apic/>
Nov 13 09:56:58 user nova-compute[74611]:     <vmcoreinfo state='on'/>
Nov 13 09:56:58 user nova-compute[74611]:   </features>
Nov 13 09:56:58 user nova-compute[74611]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 09:56:58 user nova-compute[74611]:     <model fallback='forbid'>Nehalem</model>
Nov 13 09:56:58 user nova-compute[74611]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 09:56:58 user nova-compute[74611]:     <feature policy='require' name='vme'/>
Nov 13 09:56:58 user nova-compute[74611]:     <feature policy='require' name='x2apic'/>
Nov 13 09:56:58 user nova-compute[74611]:     <feature policy='require' name='hypervisor'/>
Nov 13 09:56:58 user nova-compute[74611]:   </cpu>
Nov 13 09:56:58 user nova-compute[74611]:   <clock offset='utc'>
Nov 13 09:56:58 user nova-compute[74611]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 09:56:58 user nova-compute[74611]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 09:56:58 user nova-compute[74611]:     <timer name='hpet' present='no'/>
Nov 13 09:56:58 user nova-compute[74611]:   </clock>
Nov 13 09:56:58 user nova-compute[74611]:   <on_poweroff>destroy</on_poweroff>
Nov 13 09:56:58 user nova-compute[74611]:   <on_reboot>restart</on_reboot>
Nov 13 09:56:58 user nova-compute[74611]:   <on_crash>destroy</on_crash>
Nov 13 09:56:58 user nova-compute[74611]:   <devices>
Nov 13 09:56:58 user nova-compute[74611]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 09:56:58 user nova-compute[74611]:     <disk type='file' device='disk'>
Nov 13 09:56:58 user nova-compute[74611]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 09:56:58 user nova-compute[74611]:       <source file='/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk' index='2'/>
Nov 13 09:56:58 user nova-compute[74611]:       <backingStore type='file' index='3'>
Nov 13 09:56:58 user nova-compute[74611]:         <format type='raw'/>
Nov 13 09:56:58 user nova-compute[74611]:         <source file='/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915'/>
Nov 13 09:56:58 user nova-compute[74611]:         <backingStore/>
Nov 13 09:56:58 user nova-compute[74611]:       </backingStore>
Nov 13 09:56:58 user nova-compute[74611]:       <target dev='vda' bus='virtio'/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='virtio-disk0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </disk>
Nov 13 09:56:58 user nova-compute[74611]:     <disk type='file' device='cdrom'>
Nov 13 09:56:58 user nova-compute[74611]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 09:56:58 user nova-compute[74611]:       <source file='/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk.config' index='1'/>
Nov 13 09:56:58 user nova-compute[74611]:       <backingStore/>
Nov 13 09:56:58 user nova-compute[74611]:       <target dev='hda' bus='ide'/>
Nov 13 09:56:58 user nova-compute[74611]:       <readonly/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='ide0-0-0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </disk>
Nov 13 09:56:58 user nova-compute[74611]:     <controller type='usb' index='0' model='none'>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='usb'/>
Nov 13 09:56:58 user nova-compute[74611]:     </controller>
Nov 13 09:56:58 user nova-compute[74611]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='pci.0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </controller>
Nov 13 09:56:58 user nova-compute[74611]:     <controller type='ide' index='0'>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='ide'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 09:56:58 user nova-compute[74611]:     </controller>
Nov 13 09:56:58 user nova-compute[74611]:     <interface type='ethernet'>
Nov 13 09:56:58 user nova-compute[74611]:       <mac address='fa:16:3e:05:dc:a6'/>
Nov 13 09:56:58 user nova-compute[74611]:       <target dev='tap805b4d7d-b2'/>
Nov 13 09:56:58 user nova-compute[74611]:       <model type='virtio'/>
Nov 13 09:56:58 user nova-compute[74611]:       <mtu size='1442'/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='net0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </interface>
Nov 13 09:56:58 user nova-compute[74611]:     <serial type='pty'>
Nov 13 09:56:58 user nova-compute[74611]:       <source path='/dev/pts/8'/>
Nov 13 09:56:58 user nova-compute[74611]:       <log file='/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/console.log' append='off'/>
Nov 13 09:56:58 user nova-compute[74611]:       <target type='isa-serial' port='0'>
Nov 13 09:56:58 user nova-compute[74611]:         <model name='isa-serial'/>
Nov 13 09:56:58 user nova-compute[74611]:       </target>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='serial0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </serial>
Nov 13 09:56:58 user nova-compute[74611]:     <console type='pty' tty='/dev/pts/8'>
Nov 13 09:56:58 user nova-compute[74611]:       <source path='/dev/pts/8'/>
Nov 13 09:56:58 user nova-compute[74611]:       <log file='/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/console.log' append='off'/>
Nov 13 09:56:58 user nova-compute[74611]:       <target type='serial' port='0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='serial0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </console>
Nov 13 09:56:58 user nova-compute[74611]:     <input type='mouse' bus='ps2'>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='input0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </input>
Nov 13 09:56:58 user nova-compute[74611]:     <input type='keyboard' bus='ps2'>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='input1'/>
Nov 13 09:56:58 user nova-compute[74611]:     </input>
Nov 13 09:56:58 user nova-compute[74611]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 13 09:56:58 user nova-compute[74611]:       <listen type='address' address='0.0.0.0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </graphics>
Nov 13 09:56:58 user nova-compute[74611]:     <audio id='1' type='none'/>
Nov 13 09:56:58 user nova-compute[74611]:     <video>
Nov 13 09:56:58 user nova-compute[74611]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='video0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </video>
Nov 13 09:56:58 user nova-compute[74611]:     <memballoon model='virtio'>
Nov 13 09:56:58 user nova-compute[74611]:       <stats period='10'/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='balloon0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </memballoon>
Nov 13 09:56:58 user nova-compute[74611]:     <rng model='virtio'>
Nov 13 09:56:58 user nova-compute[74611]:       <backend model='random'>/dev/urandom</backend>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='rng0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </rng>
Nov 13 09:56:58 user nova-compute[74611]:   </devices>
Nov 13 09:56:58 user nova-compute[74611]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 09:56:58 user nova-compute[74611]:     <label>libvirt-eea01f90-3c79-4304-913e-8cf7e9749480</label>
Nov 13 09:56:58 user nova-compute[74611]:     <imagelabel>libvirt-eea01f90-3c79-4304-913e-8cf7e9749480</imagelabel>
Nov 13 09:56:58 user nova-compute[74611]:   </seclabel>
Nov 13 09:56:58 user nova-compute[74611]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 09:56:58 user nova-compute[74611]:     <label>+64055:+108</label>
Nov 13 09:56:58 user nova-compute[74611]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 09:56:58 user nova-compute[74611]:   </seclabel>
Nov 13 09:56:58 user nova-compute[74611]: </domain>
Nov 13 09:56:58 user nova-compute[74611]:  {{(pid=74611) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 09:56:58 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Successfully detached device tap266e9729-66 from instance eea01f90-3c79-4304-913e-8cf7e9749480 from the live domain config.
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-560513437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-560513437',id=8,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeQwNIdKbZkcJ1bL6vxLyRaw/tiXK1lBMCzqrmneLrH3GH4oV5/eRe+ZKc6KvSL9xj8s0omUXtq4rOBJVCBpsYTYfMFZFh2iLGaIRkl6/UO9iRuPbpk3z3yXYcyxqHiGw==',key_name='tempest-keypair-788651981',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:54:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f6f36a09d514934ab7e11e7e945658f',ramdisk_id='',reservation_id='r-o8x6c9da',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-987448261',owner_user_name='tempest-TaggedAttachmentsTest-987448261-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:54:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4627e309322495f90a6e412f7e36c75',uuid=eea01f90-3c79-4304-913e-8cf7e9749480,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "address": "fa:16:3e:0e:84:69", "network": {"id": "55f5861f-a3bd-4036-b97e-e41fbe61acb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1033512839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap266e9729-66", "ovs_interfaceid": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Converting VIF {"id": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "address": "fa:16:3e:0e:84:69", "network": {"id": "55f5861f-a3bd-4036-b97e-e41fbe61acb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1033512839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap266e9729-66", "ovs_interfaceid": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:84:69,bridge_name='br-int',has_traffic_filtering=True,id=266e9729-66ec-47c1-b5a4-a23e4cb79de6,network=Network(55f5861f-a3bd-4036-b97e-e41fbe61acb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap266e9729-66') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG os_vif [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:84:69,bridge_name='br-int',has_traffic_filtering=True,id=266e9729-66ec-47c1-b5a4-a23e4cb79de6,network=Network(55f5861f-a3bd-4036-b97e-e41fbe61acb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap266e9729-66') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap266e9729-66, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ab6e7ab-a3db-47bc-a7b1-1f5f73099a69) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:58 user nova-compute[74611]: INFO os_vif [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:84:69,bridge_name='br-int',has_traffic_filtering=True,id=266e9729-66ec-47c1-b5a4-a23e4cb79de6,network=Network(55f5861f-a3bd-4036-b97e-e41fbe61acb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap266e9729-66')
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:56:58 user nova-compute[74611]:   <nova:package version="0.0.0"/>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:name>tempest-device-tagging-server-560513437</nova:name>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:creationTime>2023-11-13 09:56:58</nova:creationTime>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:flavor name="m1.tiny">
Nov 13 09:56:58 user nova-compute[74611]:     <nova:memory>512</nova:memory>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:disk>1</nova:disk>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:swap>0</nova:swap>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:vcpus>1</nova:vcpus>
Nov 13 09:56:58 user nova-compute[74611]:   </nova:flavor>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:owner>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:user uuid="a4627e309322495f90a6e412f7e36c75">tempest-TaggedAttachmentsTest-987448261-project-member</nova:user>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:project uuid="9f6f36a09d514934ab7e11e7e945658f">tempest-TaggedAttachmentsTest-987448261</nova:project>
Nov 13 09:56:58 user nova-compute[74611]:   </nova:owner>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:ports>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:port uuid="805b4d7d-b250-40e4-af31-e9f281182115">
Nov 13 09:56:58 user nova-compute[74611]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 09:56:58 user nova-compute[74611]:     </nova:port>
Nov 13 09:56:58 user nova-compute[74611]:   </nova:ports>
Nov 13 09:56:58 user nova-compute[74611]: </nova:instance>
Nov 13 09:56:58 user nova-compute[74611]:  {{(pid=74611) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.objects.instance [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lazy-loading 'flavor' on Instance uuid 5b70fc11-140f-4c9a-9e75-2b33705d8c6d {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-af649376-13ba-4f81-b85c-d8e27c7ac06f tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.630s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.compute.manager [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received event network-vif-deleted-266e9729-66ec-47c1-b5a4-a23e4cb79de6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:56:58 user nova-compute[74611]: INFO nova.compute.manager [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Neutron deleted interface 266e9729-66ec-47c1-b5a4-a23e4cb79de6; detaching it from the instance and deleting it from the info cache
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.network.neutron [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Updating instance_info_cache with network_info: [{"id": "805b4d7d-b250-40e4-af31-e9f281182115", "address": "fa:16:3e:05:dc:a6", "network": {"id": "76b58f11-8450-4eea-b1c5-996e7112fd8b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1065019570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap805b4d7d-b2", "ovs_interfaceid": "805b4d7d-b250-40e4-af31-e9f281182115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquired lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.objects.instance [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] Lazy-loading 'system_metadata' on Instance uuid eea01f90-3c79-4304-913e-8cf7e9749480 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.objects.instance [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] Lazy-loading 'flavor' on Instance uuid eea01f90-3c79-4304-913e-8cf7e9749480 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.objects.base [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] Object Instance<eea01f90-3c79-4304-913e-8cf7e9749480> lazy-loaded attributes: system_metadata,flavor {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-560513437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-560513437',id=8,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeQwNIdKbZkcJ1bL6vxLyRaw/tiXK1lBMCzqrmneLrH3GH4oV5/eRe+ZKc6KvSL9xj8s0omUXtq4rOBJVCBpsYTYfMFZFh2iLGaIRkl6/UO9iRuPbpk3z3yXYcyxqHiGw==',key_name='tempest-keypair-788651981',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:54:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f6f36a09d514934ab7e11e7e945658f',ramdisk_id='',reservation_id='r-o8x6c9da',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-987448261',owner_user_name='tempest-TaggedAttachmentsTest-987448261-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:54:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4627e309322495f90a6e412f7e36c75',uuid=eea01f90-3c79-4304-913e-8cf7e9749480,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "address": "fa:16:3e:0e:84:69", "network": {"id": "55f5861f-a3bd-4036-b97e-e41fbe61acb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1033512839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap266e9729-66", "ovs_interfaceid": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] Converting VIF {"id": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "address": "fa:16:3e:0e:84:69", "network": {"id": "55f5861f-a3bd-4036-b97e-e41fbe61acb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1033512839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap266e9729-66", "ovs_interfaceid": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:84:69,bridge_name='br-int',has_traffic_filtering=True,id=266e9729-66ec-47c1-b5a4-a23e4cb79de6,network=Network(55f5861f-a3bd-4036-b97e-e41fbe61acb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap266e9729-66') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:84:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap266e9729-66"/></interface> {{(pid=74611) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0e:84:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap266e9729-66"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 13 09:56:58 user nova-compute[74611]:   <name>instance-00000008</name>
Nov 13 09:56:58 user nova-compute[74611]:   <uuid>eea01f90-3c79-4304-913e-8cf7e9749480</uuid>
Nov 13 09:56:58 user nova-compute[74611]:   <metadata>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:56:58 user nova-compute[74611]:   <nova:package version="0.0.0"/>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:name>tempest-device-tagging-server-560513437</nova:name>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:creationTime>2023-11-13 09:56:58</nova:creationTime>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:flavor name="m1.tiny">
Nov 13 09:56:58 user nova-compute[74611]:     <nova:memory>512</nova:memory>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:disk>1</nova:disk>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:swap>0</nova:swap>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:vcpus>1</nova:vcpus>
Nov 13 09:56:58 user nova-compute[74611]:   </nova:flavor>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:owner>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:user uuid="a4627e309322495f90a6e412f7e36c75">tempest-TaggedAttachmentsTest-987448261-project-member</nova:user>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:project uuid="9f6f36a09d514934ab7e11e7e945658f">tempest-TaggedAttachmentsTest-987448261</nova:project>
Nov 13 09:56:58 user nova-compute[74611]:   </nova:owner>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:ports>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:port uuid="805b4d7d-b250-40e4-af31-e9f281182115">
Nov 13 09:56:58 user nova-compute[74611]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 09:56:58 user nova-compute[74611]:     </nova:port>
Nov 13 09:56:58 user nova-compute[74611]:   </nova:ports>
Nov 13 09:56:58 user nova-compute[74611]: </nova:instance>
Nov 13 09:56:58 user nova-compute[74611]:   </metadata>
Nov 13 09:56:58 user nova-compute[74611]:   <memory unit='KiB'>524288</memory>
Nov 13 09:56:58 user nova-compute[74611]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 09:56:58 user nova-compute[74611]:   <vcpu placement='static'>1</vcpu>
Nov 13 09:56:58 user nova-compute[74611]:   <resource>
Nov 13 09:56:58 user nova-compute[74611]:     <partition>/machine</partition>
Nov 13 09:56:58 user nova-compute[74611]:   </resource>
Nov 13 09:56:58 user nova-compute[74611]:   <sysinfo type='smbios'>
Nov 13 09:56:58 user nova-compute[74611]:     <system>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='version'>0.0.0</entry>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='serial'>eea01f90-3c79-4304-913e-8cf7e9749480</entry>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='uuid'>eea01f90-3c79-4304-913e-8cf7e9749480</entry>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='family'>Virtual Machine</entry>
Nov 13 09:56:58 user nova-compute[74611]:     </system>
Nov 13 09:56:58 user nova-compute[74611]:   </sysinfo>
Nov 13 09:56:58 user nova-compute[74611]:   <os>
Nov 13 09:56:58 user nova-compute[74611]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 09:56:58 user nova-compute[74611]:     <boot dev='hd'/>
Nov 13 09:56:58 user nova-compute[74611]:     <smbios mode='sysinfo'/>
Nov 13 09:56:58 user nova-compute[74611]:   </os>
Nov 13 09:56:58 user nova-compute[74611]:   <features>
Nov 13 09:56:58 user nova-compute[74611]:     <acpi/>
Nov 13 09:56:58 user nova-compute[74611]:     <apic/>
Nov 13 09:56:58 user nova-compute[74611]:     <vmcoreinfo state='on'/>
Nov 13 09:56:58 user nova-compute[74611]:   </features>
Nov 13 09:56:58 user nova-compute[74611]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 09:56:58 user nova-compute[74611]:     <model fallback='forbid'>Nehalem</model>
Nov 13 09:56:58 user nova-compute[74611]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 09:56:58 user nova-compute[74611]:     <feature policy='require' name='vme'/>
Nov 13 09:56:58 user nova-compute[74611]:     <feature policy='require' name='x2apic'/>
Nov 13 09:56:58 user nova-compute[74611]:     <feature policy='require' name='hypervisor'/>
Nov 13 09:56:58 user nova-compute[74611]:   </cpu>
Nov 13 09:56:58 user nova-compute[74611]:   <clock offset='utc'>
Nov 13 09:56:58 user nova-compute[74611]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 09:56:58 user nova-compute[74611]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 09:56:58 user nova-compute[74611]:     <timer name='hpet' present='no'/>
Nov 13 09:56:58 user nova-compute[74611]:   </clock>
Nov 13 09:56:58 user nova-compute[74611]:   <on_poweroff>destroy</on_poweroff>
Nov 13 09:56:58 user nova-compute[74611]:   <on_reboot>restart</on_reboot>
Nov 13 09:56:58 user nova-compute[74611]:   <on_crash>destroy</on_crash>
Nov 13 09:56:58 user nova-compute[74611]:   <devices>
Nov 13 09:56:58 user nova-compute[74611]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 09:56:58 user nova-compute[74611]:     <disk type='file' device='disk'>
Nov 13 09:56:58 user nova-compute[74611]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 09:56:58 user nova-compute[74611]:       <source file='/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk' index='2'/>
Nov 13 09:56:58 user nova-compute[74611]:       <backingStore type='file' index='3'>
Nov 13 09:56:58 user nova-compute[74611]:         <format type='raw'/>
Nov 13 09:56:58 user nova-compute[74611]:         <source file='/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915'/>
Nov 13 09:56:58 user nova-compute[74611]:         <backingStore/>
Nov 13 09:56:58 user nova-compute[74611]:       </backingStore>
Nov 13 09:56:58 user nova-compute[74611]:       <target dev='vda' bus='virtio'/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='virtio-disk0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </disk>
Nov 13 09:56:58 user nova-compute[74611]:     <disk type='file' device='cdrom'>
Nov 13 09:56:58 user nova-compute[74611]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 09:56:58 user nova-compute[74611]:       <source file='/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk.config' index='1'/>
Nov 13 09:56:58 user nova-compute[74611]:       <backingStore/>
Nov 13 09:56:58 user nova-compute[74611]:       <target dev='hda' bus='ide'/>
Nov 13 09:56:58 user nova-compute[74611]:       <readonly/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='ide0-0-0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </disk>
Nov 13 09:56:58 user nova-compute[74611]:     <controller type='usb' index='0' model='none'>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='usb'/>
Nov 13 09:56:58 user nova-compute[74611]:     </controller>
Nov 13 09:56:58 user nova-compute[74611]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='pci.0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </controller>
Nov 13 09:56:58 user nova-compute[74611]:     <controller type='ide' index='0'>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='ide'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 09:56:58 user nova-compute[74611]:     </controller>
Nov 13 09:56:58 user nova-compute[74611]:     <interface type='ethernet'>
Nov 13 09:56:58 user nova-compute[74611]:       <mac address='fa:16:3e:05:dc:a6'/>
Nov 13 09:56:58 user nova-compute[74611]:       <target dev='tap805b4d7d-b2'/>
Nov 13 09:56:58 user nova-compute[74611]:       <model type='virtio'/>
Nov 13 09:56:58 user nova-compute[74611]:       <mtu size='1442'/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='net0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </interface>
Nov 13 09:56:58 user nova-compute[74611]:     <serial type='pty'>
Nov 13 09:56:58 user nova-compute[74611]:       <source path='/dev/pts/8'/>
Nov 13 09:56:58 user nova-compute[74611]:       <log file='/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/console.log' append='off'/>
Nov 13 09:56:58 user nova-compute[74611]:       <target type='isa-serial' port='0'>
Nov 13 09:56:58 user nova-compute[74611]:         <model name='isa-serial'/>
Nov 13 09:56:58 user nova-compute[74611]:       </target>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='serial0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </serial>
Nov 13 09:56:58 user nova-compute[74611]:     <console type='pty' tty='/dev/pts/8'>
Nov 13 09:56:58 user nova-compute[74611]:       <source path='/dev/pts/8'/>
Nov 13 09:56:58 user nova-compute[74611]:       <log file='/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/console.log' append='off'/>
Nov 13 09:56:58 user nova-compute[74611]:       <target type='serial' port='0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='serial0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </console>
Nov 13 09:56:58 user nova-compute[74611]:     <input type='mouse' bus='ps2'>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='input0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </input>
Nov 13 09:56:58 user nova-compute[74611]:     <input type='keyboard' bus='ps2'>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='input1'/>
Nov 13 09:56:58 user nova-compute[74611]:     </input>
Nov 13 09:56:58 user nova-compute[74611]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 13 09:56:58 user nova-compute[74611]:       <listen type='address' address='0.0.0.0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </graphics>
Nov 13 09:56:58 user nova-compute[74611]:     <audio id='1' type='none'/>
Nov 13 09:56:58 user nova-compute[74611]:     <video>
Nov 13 09:56:58 user nova-compute[74611]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='video0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </video>
Nov 13 09:56:58 user nova-compute[74611]:     <memballoon model='virtio'>
Nov 13 09:56:58 user nova-compute[74611]:       <stats period='10'/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='balloon0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </memballoon>
Nov 13 09:56:58 user nova-compute[74611]:     <rng model='virtio'>
Nov 13 09:56:58 user nova-compute[74611]:       <backend model='random'>/dev/urandom</backend>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='rng0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </rng>
Nov 13 09:56:58 user nova-compute[74611]:   </devices>
Nov 13 09:56:58 user nova-compute[74611]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 09:56:58 user nova-compute[74611]:     <label>libvirt-eea01f90-3c79-4304-913e-8cf7e9749480</label>
Nov 13 09:56:58 user nova-compute[74611]:     <imagelabel>libvirt-eea01f90-3c79-4304-913e-8cf7e9749480</imagelabel>
Nov 13 09:56:58 user nova-compute[74611]:   </seclabel>
Nov 13 09:56:58 user nova-compute[74611]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 09:56:58 user nova-compute[74611]:     <label>+64055:+108</label>
Nov 13 09:56:58 user nova-compute[74611]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 09:56:58 user nova-compute[74611]:   </seclabel>
Nov 13 09:56:58 user nova-compute[74611]: </domain>
Nov 13 09:56:58 user nova-compute[74611]:  {{(pid=74611) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:84:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap266e9729-66"/></interface> {{(pid=74611) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0e:84:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap266e9729-66"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 13 09:56:58 user nova-compute[74611]:   <name>instance-00000008</name>
Nov 13 09:56:58 user nova-compute[74611]:   <uuid>eea01f90-3c79-4304-913e-8cf7e9749480</uuid>
Nov 13 09:56:58 user nova-compute[74611]:   <metadata>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:56:58 user nova-compute[74611]:   <nova:package version="0.0.0"/>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:name>tempest-device-tagging-server-560513437</nova:name>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:creationTime>2023-11-13 09:56:58</nova:creationTime>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:flavor name="m1.tiny">
Nov 13 09:56:58 user nova-compute[74611]:     <nova:memory>512</nova:memory>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:disk>1</nova:disk>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:swap>0</nova:swap>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:vcpus>1</nova:vcpus>
Nov 13 09:56:58 user nova-compute[74611]:   </nova:flavor>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:owner>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:user uuid="a4627e309322495f90a6e412f7e36c75">tempest-TaggedAttachmentsTest-987448261-project-member</nova:user>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:project uuid="9f6f36a09d514934ab7e11e7e945658f">tempest-TaggedAttachmentsTest-987448261</nova:project>
Nov 13 09:56:58 user nova-compute[74611]:   </nova:owner>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:ports>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:port uuid="805b4d7d-b250-40e4-af31-e9f281182115">
Nov 13 09:56:58 user nova-compute[74611]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 09:56:58 user nova-compute[74611]:     </nova:port>
Nov 13 09:56:58 user nova-compute[74611]:   </nova:ports>
Nov 13 09:56:58 user nova-compute[74611]: </nova:instance>
Nov 13 09:56:58 user nova-compute[74611]:   </metadata>
Nov 13 09:56:58 user nova-compute[74611]:   <memory unit='KiB'>524288</memory>
Nov 13 09:56:58 user nova-compute[74611]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 09:56:58 user nova-compute[74611]:   <vcpu placement='static'>1</vcpu>
Nov 13 09:56:58 user nova-compute[74611]:   <resource>
Nov 13 09:56:58 user nova-compute[74611]:     <partition>/machine</partition>
Nov 13 09:56:58 user nova-compute[74611]:   </resource>
Nov 13 09:56:58 user nova-compute[74611]:   <sysinfo type='smbios'>
Nov 13 09:56:58 user nova-compute[74611]:     <system>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='version'>0.0.0</entry>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='serial'>eea01f90-3c79-4304-913e-8cf7e9749480</entry>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='uuid'>eea01f90-3c79-4304-913e-8cf7e9749480</entry>
Nov 13 09:56:58 user nova-compute[74611]:       <entry name='family'>Virtual Machine</entry>
Nov 13 09:56:58 user nova-compute[74611]:     </system>
Nov 13 09:56:58 user nova-compute[74611]:   </sysinfo>
Nov 13 09:56:58 user nova-compute[74611]:   <os>
Nov 13 09:56:58 user nova-compute[74611]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 09:56:58 user nova-compute[74611]:     <boot dev='hd'/>
Nov 13 09:56:58 user nova-compute[74611]:     <smbios mode='sysinfo'/>
Nov 13 09:56:58 user nova-compute[74611]:   </os>
Nov 13 09:56:58 user nova-compute[74611]:   <features>
Nov 13 09:56:58 user nova-compute[74611]:     <acpi/>
Nov 13 09:56:58 user nova-compute[74611]:     <apic/>
Nov 13 09:56:58 user nova-compute[74611]:     <vmcoreinfo state='on'/>
Nov 13 09:56:58 user nova-compute[74611]:   </features>
Nov 13 09:56:58 user nova-compute[74611]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 09:56:58 user nova-compute[74611]:     <model fallback='forbid'>Nehalem</model>
Nov 13 09:56:58 user nova-compute[74611]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 09:56:58 user nova-compute[74611]:     <feature policy='require' name='vme'/>
Nov 13 09:56:58 user nova-compute[74611]:     <feature policy='require' name='x2apic'/>
Nov 13 09:56:58 user nova-compute[74611]:     <feature policy='require' name='hypervisor'/>
Nov 13 09:56:58 user nova-compute[74611]:   </cpu>
Nov 13 09:56:58 user nova-compute[74611]:   <clock offset='utc'>
Nov 13 09:56:58 user nova-compute[74611]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 09:56:58 user nova-compute[74611]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 09:56:58 user nova-compute[74611]:     <timer name='hpet' present='no'/>
Nov 13 09:56:58 user nova-compute[74611]:   </clock>
Nov 13 09:56:58 user nova-compute[74611]:   <on_poweroff>destroy</on_poweroff>
Nov 13 09:56:58 user nova-compute[74611]:   <on_reboot>restart</on_reboot>
Nov 13 09:56:58 user nova-compute[74611]:   <on_crash>destroy</on_crash>
Nov 13 09:56:58 user nova-compute[74611]:   <devices>
Nov 13 09:56:58 user nova-compute[74611]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 09:56:58 user nova-compute[74611]:     <disk type='file' device='disk'>
Nov 13 09:56:58 user nova-compute[74611]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 09:56:58 user nova-compute[74611]:       <source file='/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk' index='2'/>
Nov 13 09:56:58 user nova-compute[74611]:       <backingStore type='file' index='3'>
Nov 13 09:56:58 user nova-compute[74611]:         <format type='raw'/>
Nov 13 09:56:58 user nova-compute[74611]:         <source file='/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915'/>
Nov 13 09:56:58 user nova-compute[74611]:         <backingStore/>
Nov 13 09:56:58 user nova-compute[74611]:       </backingStore>
Nov 13 09:56:58 user nova-compute[74611]:       <target dev='vda' bus='virtio'/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='virtio-disk0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </disk>
Nov 13 09:56:58 user nova-compute[74611]:     <disk type='file' device='cdrom'>
Nov 13 09:56:58 user nova-compute[74611]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 09:56:58 user nova-compute[74611]:       <source file='/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/disk.config' index='1'/>
Nov 13 09:56:58 user nova-compute[74611]:       <backingStore/>
Nov 13 09:56:58 user nova-compute[74611]:       <target dev='hda' bus='ide'/>
Nov 13 09:56:58 user nova-compute[74611]:       <readonly/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='ide0-0-0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </disk>
Nov 13 09:56:58 user nova-compute[74611]:     <controller type='usb' index='0' model='none'>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='usb'/>
Nov 13 09:56:58 user nova-compute[74611]:     </controller>
Nov 13 09:56:58 user nova-compute[74611]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='pci.0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </controller>
Nov 13 09:56:58 user nova-compute[74611]:     <controller type='ide' index='0'>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='ide'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 09:56:58 user nova-compute[74611]:     </controller>
Nov 13 09:56:58 user nova-compute[74611]:     <interface type='ethernet'>
Nov 13 09:56:58 user nova-compute[74611]:       <mac address='fa:16:3e:05:dc:a6'/>
Nov 13 09:56:58 user nova-compute[74611]:       <target dev='tap805b4d7d-b2'/>
Nov 13 09:56:58 user nova-compute[74611]:       <model type='virtio'/>
Nov 13 09:56:58 user nova-compute[74611]:       <mtu size='1442'/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='net0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </interface>
Nov 13 09:56:58 user nova-compute[74611]:     <serial type='pty'>
Nov 13 09:56:58 user nova-compute[74611]:       <source path='/dev/pts/8'/>
Nov 13 09:56:58 user nova-compute[74611]:       <log file='/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/console.log' append='off'/>
Nov 13 09:56:58 user nova-compute[74611]:       <target type='isa-serial' port='0'>
Nov 13 09:56:58 user nova-compute[74611]:         <model name='isa-serial'/>
Nov 13 09:56:58 user nova-compute[74611]:       </target>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='serial0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </serial>
Nov 13 09:56:58 user nova-compute[74611]:     <console type='pty' tty='/dev/pts/8'>
Nov 13 09:56:58 user nova-compute[74611]:       <source path='/dev/pts/8'/>
Nov 13 09:56:58 user nova-compute[74611]:       <log file='/opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480/console.log' append='off'/>
Nov 13 09:56:58 user nova-compute[74611]:       <target type='serial' port='0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='serial0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </console>
Nov 13 09:56:58 user nova-compute[74611]:     <input type='mouse' bus='ps2'>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='input0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </input>
Nov 13 09:56:58 user nova-compute[74611]:     <input type='keyboard' bus='ps2'>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='input1'/>
Nov 13 09:56:58 user nova-compute[74611]:     </input>
Nov 13 09:56:58 user nova-compute[74611]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 13 09:56:58 user nova-compute[74611]:       <listen type='address' address='0.0.0.0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </graphics>
Nov 13 09:56:58 user nova-compute[74611]:     <audio id='1' type='none'/>
Nov 13 09:56:58 user nova-compute[74611]:     <video>
Nov 13 09:56:58 user nova-compute[74611]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='video0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </video>
Nov 13 09:56:58 user nova-compute[74611]:     <memballoon model='virtio'>
Nov 13 09:56:58 user nova-compute[74611]:       <stats period='10'/>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='balloon0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </memballoon>
Nov 13 09:56:58 user nova-compute[74611]:     <rng model='virtio'>
Nov 13 09:56:58 user nova-compute[74611]:       <backend model='random'>/dev/urandom</backend>
Nov 13 09:56:58 user nova-compute[74611]:       <alias name='rng0'/>
Nov 13 09:56:58 user nova-compute[74611]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 09:56:58 user nova-compute[74611]:     </rng>
Nov 13 09:56:58 user nova-compute[74611]:   </devices>
Nov 13 09:56:58 user nova-compute[74611]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 09:56:58 user nova-compute[74611]:     <label>libvirt-eea01f90-3c79-4304-913e-8cf7e9749480</label>
Nov 13 09:56:58 user nova-compute[74611]:     <imagelabel>libvirt-eea01f90-3c79-4304-913e-8cf7e9749480</imagelabel>
Nov 13 09:56:58 user nova-compute[74611]:   </seclabel>
Nov 13 09:56:58 user nova-compute[74611]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 09:56:58 user nova-compute[74611]:     <label>+64055:+108</label>
Nov 13 09:56:58 user nova-compute[74611]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 09:56:58 user nova-compute[74611]:   </seclabel>
Nov 13 09:56:58 user nova-compute[74611]: </domain>
Nov 13 09:56:58 user nova-compute[74611]:  {{(pid=74611) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 09:56:58 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Detaching interface fa:16:3e:0e:84:69 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap266e9729-66' not found.
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-560513437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-560513437',id=8,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeQwNIdKbZkcJ1bL6vxLyRaw/tiXK1lBMCzqrmneLrH3GH4oV5/eRe+ZKc6KvSL9xj8s0omUXtq4rOBJVCBpsYTYfMFZFh2iLGaIRkl6/UO9iRuPbpk3z3yXYcyxqHiGw==',key_name='tempest-keypair-788651981',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:54:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f6f36a09d514934ab7e11e7e945658f',ramdisk_id='',reservation_id='r-o8x6c9da',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-987448261',owner_user_name='tempest-TaggedAttachmentsTest-987448261-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:54:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4627e309322495f90a6e412f7e36c75',uuid=eea01f90-3c79-4304-913e-8cf7e9749480,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "address": "fa:16:3e:0e:84:69", "network": {"id": "55f5861f-a3bd-4036-b97e-e41fbe61acb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1033512839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap266e9729-66", "ovs_interfaceid": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] Converting VIF {"id": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "address": "fa:16:3e:0e:84:69", "network": {"id": "55f5861f-a3bd-4036-b97e-e41fbe61acb1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1033512839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap266e9729-66", "ovs_interfaceid": "266e9729-66ec-47c1-b5a4-a23e4cb79de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:84:69,bridge_name='br-int',has_traffic_filtering=True,id=266e9729-66ec-47c1-b5a4-a23e4cb79de6,network=Network(55f5861f-a3bd-4036-b97e-e41fbe61acb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap266e9729-66') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG os_vif [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:84:69,bridge_name='br-int',has_traffic_filtering=True,id=266e9729-66ec-47c1-b5a4-a23e4cb79de6,network=Network(55f5861f-a3bd-4036-b97e-e41fbe61acb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap266e9729-66') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap266e9729-66, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:56:58 user nova-compute[74611]: INFO os_vif [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:84:69,bridge_name='br-int',has_traffic_filtering=True,id=266e9729-66ec-47c1-b5a4-a23e4cb79de6,network=Network(55f5861f-a3bd-4036-b97e-e41fbe61acb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap266e9729-66')
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [req-c663552d-3d9b-4063-a618-323cd1ee6452 req-c9e1fefd-7b02-4048-91b3-cda6d49c493c service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:56:58 user nova-compute[74611]:   <nova:package version="0.0.0"/>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:name>tempest-device-tagging-server-560513437</nova:name>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:creationTime>2023-11-13 09:56:58</nova:creationTime>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:flavor name="m1.tiny">
Nov 13 09:56:58 user nova-compute[74611]:     <nova:memory>512</nova:memory>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:disk>1</nova:disk>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:swap>0</nova:swap>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:vcpus>1</nova:vcpus>
Nov 13 09:56:58 user nova-compute[74611]:   </nova:flavor>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:owner>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:user uuid="a4627e309322495f90a6e412f7e36c75">tempest-TaggedAttachmentsTest-987448261-project-member</nova:user>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:project uuid="9f6f36a09d514934ab7e11e7e945658f">tempest-TaggedAttachmentsTest-987448261</nova:project>
Nov 13 09:56:58 user nova-compute[74611]:   </nova:owner>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:56:58 user nova-compute[74611]:   <nova:ports>
Nov 13 09:56:58 user nova-compute[74611]:     <nova:port uuid="805b4d7d-b250-40e4-af31-e9f281182115">
Nov 13 09:56:58 user nova-compute[74611]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 09:56:58 user nova-compute[74611]:     </nova:port>
Nov 13 09:56:58 user nova-compute[74611]:   </nova:ports>
Nov 13 09:56:58 user nova-compute[74611]: </nova:instance>
Nov 13 09:56:58 user nova-compute[74611]:  {{(pid=74611) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 13 09:56:58 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Updating instance_info_cache with network_info: [{"id": "805b4d7d-b250-40e4-af31-e9f281182115", "address": "fa:16:3e:05:dc:a6", "network": {"id": "76b58f11-8450-4eea-b1c5-996e7112fd8b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1065019570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap805b4d7d-b2", "ovs_interfaceid": "805b4d7d-b250-40e4-af31-e9f281182115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:56:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Releasing lock "refresh_cache-eea01f90-3c79-4304-913e-8cf7e9749480" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:56:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a9a7060d-ec3f-4220-bc54-79a1b563e5f2 tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "interface-eea01f90-3c79-4304-913e-8cf7e9749480-266e9729-66ec-47c1-b5a4-a23e4cb79de6" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.380s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:10 user nova-compute[74611]: DEBUG nova.compute.manager [req-e345b0b0-0612-49e1-8631-d0d92b685532 req-2adfc344-ebb2-428d-9929-d99b945c92e8 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Received event network-changed-b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:10 user nova-compute[74611]: DEBUG nova.compute.manager [req-e345b0b0-0612-49e1-8631-d0d92b685532 req-2adfc344-ebb2-428d-9929-d99b945c92e8 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Refreshing instance network info cache due to event network-changed-b7d65c35-0bb4-49fc-886d-4f9606372e9a. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:57:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e345b0b0-0612-49e1-8631-d0d92b685532 req-2adfc344-ebb2-428d-9929-d99b945c92e8 service nova] Acquiring lock "refresh_cache-89038547-5416-4942-8070-dd5dd8e4b6c2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:57:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e345b0b0-0612-49e1-8631-d0d92b685532 req-2adfc344-ebb2-428d-9929-d99b945c92e8 service nova] Acquired lock "refresh_cache-89038547-5416-4942-8070-dd5dd8e4b6c2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:57:10 user nova-compute[74611]: DEBUG nova.network.neutron [req-e345b0b0-0612-49e1-8631-d0d92b685532 req-2adfc344-ebb2-428d-9929-d99b945c92e8 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Refreshing network info cache for port b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:57:10 user nova-compute[74611]: DEBUG nova.network.neutron [req-e345b0b0-0612-49e1-8631-d0d92b685532 req-2adfc344-ebb2-428d-9929-d99b945c92e8 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Updated VIF entry in instance network info cache for port b7d65c35-0bb4-49fc-886d-4f9606372e9a. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:57:10 user nova-compute[74611]: DEBUG nova.network.neutron [req-e345b0b0-0612-49e1-8631-d0d92b685532 req-2adfc344-ebb2-428d-9929-d99b945c92e8 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Updating instance_info_cache with network_info: [{"id": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "address": "fa:16:3e:78:67:ad", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d65c35-0b", "ovs_interfaceid": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "89038547-5416-4942-8070-dd5dd8e4b6c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e345b0b0-0612-49e1-8631-d0d92b685532 req-2adfc344-ebb2-428d-9929-d99b945c92e8 service nova] Releasing lock "refresh_cache-89038547-5416-4942-8070-dd5dd8e4b6c2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:57:10 user nova-compute[74611]: DEBUG nova.objects.instance [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lazy-loading 'flavor' on Instance uuid 89038547-5416-4942-8070-dd5dd8e4b6c2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "89038547-5416-4942-8070-dd5dd8e4b6c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:10 user nova-compute[74611]: INFO nova.compute.manager [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Attaching volume 1a761372-122b-47a2-b3af-53c1b5dac478 to /dev/vdb
Nov 13 09:57:10 user nova-compute[74611]: DEBUG os_brick.utils [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd72812e-af1f-4d1d-8887-e90ce2f53097]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6444ac-bfdd-47b1-90cd-524ef1111e2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef559a32-929d-44c7-9b5f-f402b1b27581]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a5961f-f50e-4223-8f4f-e486d88eccae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:57:11 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:57:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e3d368-444c-4b5e-967c-a6893b4314a7]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG os_brick.utils [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:57:11 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Updating existing volume attachment record: 7ac22a93-9ea0-4e10-a02e-8e84c62ac272 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:57:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:57:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJRweuHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:57:14 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:57:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:57:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:57:14 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:57:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:57:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:57:14 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:57:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb8f32b-9f8c-45d3-8f2b-baa3b3117a37]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:57:15 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2158e80b-682a-414d-87e8-aff23f11ebbe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478] added
Nov 13 09:57:15 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[729fce37-1cd5-4500-8edb-317231de0de4]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Acquiring lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Acquiring lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:15 user nova-compute[74611]: INFO nova.compute.manager [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Terminating instance
Nov 13 09:57:15 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[21798bad-5a71-4507-aa79-16d0b0a31a7f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xJRweuHd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xJRweuHd" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[230fe5c4-645c-4823-b76c-86dc92cf4673]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xJRweuHd'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5b9e09-e995-4b9c-901c-654486ef4e8b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3d2654-eab7-4835-956e-bb668bd31541]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:57:15 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:57:15 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:57:15 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:57:15 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fb9939-37e9-475d-8daf-e25cb463a7ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478, portal: 172.16.0.220,3260]
Nov 13 09:57:15 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478, portal: 172.16.0.220,3260] successful.
Nov 13 09:57:15 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d7adf4-11e8-4ba6-b782-a4f70f7b99ea]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a906c5-9eb8-4d4f-be7b-b84be5d9a208]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:57:15 user nova-compute[74611]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 (non-flash)
Nov 13 09:57:15 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:57:15 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:57:15 user nova-compute[74611]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 (non-flash)
Nov 13 09:57:15 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:57:15 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ba8cee-ee36-4a67-b56d-36573eea1b77]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJRweuHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG nova.compute.manager [req-df8565e3-fa71-4b25-b937-56296a8cee69 req-ad4dd95e-a976-4458-9816-47f9daaeb874 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Received event network-vif-unplugged-488eb964-98e4-4e75-ba87-fc1840497377 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-df8565e3-fa71-4b25-b937-56296a8cee69 req-ad4dd95e-a976-4458-9816-47f9daaeb874 service nova] Acquiring lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-df8565e3-fa71-4b25-b937-56296a8cee69 req-ad4dd95e-a976-4458-9816-47f9daaeb874 service nova] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-df8565e3-fa71-4b25-b937-56296a8cee69 req-ad4dd95e-a976-4458-9816-47f9daaeb874 service nova] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG nova.compute.manager [req-df8565e3-fa71-4b25-b937-56296a8cee69 req-ad4dd95e-a976-4458-9816-47f9daaeb874 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] No waiting events found dispatching network-vif-unplugged-488eb964-98e4-4e75-ba87-fc1840497377 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG nova.compute.manager [req-df8565e3-fa71-4b25-b937-56296a8cee69 req-ad4dd95e-a976-4458-9816-47f9daaeb874 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Received event network-vif-unplugged-488eb964-98e4-4e75-ba87-fc1840497377 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:15 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Instance destroyed successfully.
Nov 13 09:57:15 user nova-compute[74611]: DEBUG nova.objects.instance [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lazy-loading 'resources' on Instance uuid 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:54:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-210550892',display_name='tempest-VolumesAssistedSnapshotsTest-server-210550892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-210550892',id=10,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMevTcN51U344Uj6IgiNad9WHrnVuYlpXcxeCPuJoMVj/APulAW9stjZetOFUMz2G8xBULlnAS3oQ+mWtCt84m7RQNvkpluMiw5AhnCK+Po9mCs9NGa2hOU9LtNCfa3zQ==',key_name='tempest-keypair-1584324317',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:54:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abd8a9b04d5a4f65817ea43a6d5b1d65',ramdisk_id='',reservation_id='r-v31hagif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-715196711',owner_user_name='tempest-VolumesAssistedSnapshotsTest-715196711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:54:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc02d92b8a6a48beb1518025204db76f',uuid=8daf2c72-3fcb-42dc-804f-8ba92ffebd7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "488eb964-98e4-4e75-ba87-fc1840497377", "address": "fa:16:3e:e4:cf:27", "network": {"id": "7f214546-77f6-41eb-862b-32bc271a8a52", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028523718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd8a9b04d5a4f65817ea43a6d5b1d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488eb964-98", "ovs_interfaceid": "488eb964-98e4-4e75-ba87-fc1840497377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Converting VIF {"id": "488eb964-98e4-4e75-ba87-fc1840497377", "address": "fa:16:3e:e4:cf:27", "network": {"id": "7f214546-77f6-41eb-862b-32bc271a8a52", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028523718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd8a9b04d5a4f65817ea43a6d5b1d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488eb964-98", "ovs_interfaceid": "488eb964-98e4-4e75-ba87-fc1840497377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:cf:27,bridge_name='br-int',has_traffic_filtering=True,id=488eb964-98e4-4e75-ba87-fc1840497377,network=Network(7f214546-77f6-41eb-862b-32bc271a8a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap488eb964-98') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG os_vif [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:cf:27,bridge_name='br-int',has_traffic_filtering=True,id=488eb964-98e4-4e75-ba87-fc1840497377,network=Network(7f214546-77f6-41eb-862b-32bc271a8a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap488eb964-98') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap488eb964-98, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=057dda03-795e-4532-9e3d-270793abf38f) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:15 user nova-compute[74611]: INFO os_vif [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:cf:27,bridge_name='br-int',has_traffic_filtering=True,id=488eb964-98e4-4e75-ba87-fc1840497377,network=Network(7f214546-77f6-41eb-862b-32bc271a8a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap488eb964-98')
Nov 13 09:57:15 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Deleting instance files /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c_del
Nov 13 09:57:15 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Deletion of /opt/stack/data/nova/instances/8daf2c72-3fcb-42dc-804f-8ba92ffebd7c_del complete
Nov 13 09:57:15 user nova-compute[74611]: INFO nova.compute.manager [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 13 09:57:15 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 09:57:15 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 09:57:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:57:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26135303735353564', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:57:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135303735353564', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:57:16 user nova-compute[74611]: DEBUG nova.objects.instance [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lazy-loading 'flavor' on Instance uuid 89038547-5416-4942-8070-dd5dd8e4b6c2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 09:57:16 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:57:16 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 09:57:16 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:57:16 user nova-compute[74611]:   <serial>1a761372-122b-47a2-b3af-53c1b5dac478</serial>
Nov 13 09:57:16 user nova-compute[74611]: </disk>
Nov 13 09:57:16 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 09:57:16 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:16 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Took 0.76 seconds to deallocate network for instance.
Nov 13 09:57:16 user nova-compute[74611]: DEBUG nova.compute.manager [req-ace79846-908f-4de4-8458-b96da0dd12a1 req-22fdbbef-c2bb-407e-bb78-e1b9e463c1c8 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Received event network-vif-deleted-488eb964-98e4-4e75-ba87-fc1840497377 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:16 user nova-compute[74611]: INFO nova.compute.manager [req-ace79846-908f-4de4-8458-b96da0dd12a1 req-22fdbbef-c2bb-407e-bb78-e1b9e463c1c8 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Neutron deleted interface 488eb964-98e4-4e75-ba87-fc1840497377; detaching it from the instance and deleting it from the info cache
Nov 13 09:57:16 user nova-compute[74611]: DEBUG nova.network.neutron [req-ace79846-908f-4de4-8458-b96da0dd12a1 req-22fdbbef-c2bb-407e-bb78-e1b9e463c1c8 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:16 user nova-compute[74611]: DEBUG nova.compute.manager [req-ace79846-908f-4de4-8458-b96da0dd12a1 req-22fdbbef-c2bb-407e-bb78-e1b9e463c1c8 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Detach interface failed, port_id=488eb964-98e4-4e75-ba87-fc1840497377, reason: Instance 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 09:57:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:57:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:57:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] No VIF found with MAC fa:16:3e:78:67:ad, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:57:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-aeef540b-f419-4ee7-935d-ec2c65cffac7 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.024s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:17 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:57:17 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:57:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:17 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Deleted allocations for instance 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c
Nov 13 09:57:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec08d2d2-b53f-425f-8e39-d9bbde8bea5f tempest-VolumesAssistedSnapshotsTest-715196711 tempest-VolumesAssistedSnapshotsTest-715196711-project-member] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.247s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:17 user nova-compute[74611]: DEBUG nova.compute.manager [req-4517a2fd-4bd3-4723-b016-9f6042319bf6 req-c45035cf-99bf-4bf3-9fd7-b2ca5a177018 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Received event network-vif-plugged-488eb964-98e4-4e75-ba87-fc1840497377 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4517a2fd-4bd3-4723-b016-9f6042319bf6 req-c45035cf-99bf-4bf3-9fd7-b2ca5a177018 service nova] Acquiring lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4517a2fd-4bd3-4723-b016-9f6042319bf6 req-c45035cf-99bf-4bf3-9fd7-b2ca5a177018 service nova] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4517a2fd-4bd3-4723-b016-9f6042319bf6 req-c45035cf-99bf-4bf3-9fd7-b2ca5a177018 service nova] Lock "8daf2c72-3fcb-42dc-804f-8ba92ffebd7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:17 user nova-compute[74611]: DEBUG nova.compute.manager [req-4517a2fd-4bd3-4723-b016-9f6042319bf6 req-c45035cf-99bf-4bf3-9fd7-b2ca5a177018 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] No waiting events found dispatching network-vif-plugged-488eb964-98e4-4e75-ba87-fc1840497377 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:17 user nova-compute[74611]: WARNING nova.compute.manager [req-4517a2fd-4bd3-4723-b016-9f6042319bf6 req-c45035cf-99bf-4bf3-9fd7-b2ca5a177018 service nova] [instance: 8daf2c72-3fcb-42dc-804f-8ba92ffebd7c] Received unexpected event network-vif-plugged-488eb964-98e4-4e75-ba87-fc1840497377 for instance with vm_state deleted and task_state None.
Nov 13 09:57:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "89038547-5416-4942-8070-dd5dd8e4b6c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:19 user nova-compute[74611]: INFO nova.compute.manager [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Detaching volume 1a761372-122b-47a2-b3af-53c1b5dac478
Nov 13 09:57:19 user nova-compute[74611]: INFO nova.virt.block_device [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Attempting to driver detach volume 1a761372-122b-47a2-b3af-53c1b5dac478 from mountpoint /dev/vdb
Nov 13 09:57:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Attempting to detach device vdb from instance 89038547-5416-4942-8070-dd5dd8e4b6c2 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 09:57:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 09:57:19 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:57:19 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 09:57:19 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:57:19 user nova-compute[74611]:   <serial>1a761372-122b-47a2-b3af-53c1b5dac478</serial>
Nov 13 09:57:19 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 09:57:19 user nova-compute[74611]: </disk>
Nov 13 09:57:19 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:57:19 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Successfully detached device vdb from instance 89038547-5416-4942-8070-dd5dd8e4b6c2 from the persistent domain config.
Nov 13 09:57:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89038547-5416-4942-8070-dd5dd8e4b6c2 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 09:57:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 09:57:19 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:57:19 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 09:57:19 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:57:19 user nova-compute[74611]:   <serial>1a761372-122b-47a2-b3af-53c1b5dac478</serial>
Nov 13 09:57:19 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 09:57:19 user nova-compute[74611]: </disk>
Nov 13 09:57:19 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:57:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89038547-5416-4942-8070-dd5dd8e4b6c2 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 09:57:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:21 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:57:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:21 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:57:21 user nova-compute[74611]: INFO nova.compute.claims [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Claim successful on node user
Nov 13 09:57:22 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:57:22 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:57:22 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG nova.policy [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91e7d88000c1476abfb0df6bfca4e0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12e0c04622143f2a0c24258ab90e153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:57:22 user nova-compute[74611]: INFO nova.virt.block_device [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Booting with volume 643e04eb-4c49-4334-81ee-51a6b3478373 at /dev/vda
Nov 13 09:57:22 user nova-compute[74611]: DEBUG os_brick.utils [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d59bbe3-357e-40cd-bb39-143dd51db86d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b6cb06-d8b3-4a9a-8f88-cfa3b745b145]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba836d80-e09f-43e6-8c87-06dd4ac1af1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c047c2f8-f877-4088-936f-94a6ae0b461f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:57:22 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:57:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a40fd4-a708-489f-a5a5-668fcbe962ae]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG os_brick.utils [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:57:22 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Updating existing volume attachment record: d4c46e7e-0521-4b10-b2d4-e2f27a349b3e {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:57:23 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Successfully created port: a49d8a46-5910-496b-a366-dbf873e81748 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:57:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:23 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Successfully updated port: a49d8a46-5910-496b-a366-dbf873e81748 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:57:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "refresh_cache-4dca8fcf-5fed-4cd1-b8db-61f271b93d20" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:57:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquired lock "refresh_cache-4dca8fcf-5fed-4cd1-b8db-61f271b93d20" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:57:23 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:57:23 user nova-compute[74611]: DEBUG nova.compute.manager [req-e50422a9-06c2-44e8-aa44-737fd562bc4d req-009ef230-2463-473e-b5db-e005b8c9fec0 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Received event network-changed-a49d8a46-5910-496b-a366-dbf873e81748 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:23 user nova-compute[74611]: DEBUG nova.compute.manager [req-e50422a9-06c2-44e8-aa44-737fd562bc4d req-009ef230-2463-473e-b5db-e005b8c9fec0 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Refreshing instance network info cache due to event network-changed-a49d8a46-5910-496b-a366-dbf873e81748. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:57:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e50422a9-06c2-44e8-aa44-737fd562bc4d req-009ef230-2463-473e-b5db-e005b8c9fec0 service nova] Acquiring lock "refresh_cache-4dca8fcf-5fed-4cd1-b8db-61f271b93d20" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:57:23 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:57:23 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Updating instance_info_cache with network_info: [{"id": "a49d8a46-5910-496b-a366-dbf873e81748", "address": "fa:16:3e:4f:94:ae", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49d8a46-59", "ovs_interfaceid": "a49d8a46-5910-496b-a366-dbf873e81748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Releasing lock "refresh_cache-4dca8fcf-5fed-4cd1-b8db-61f271b93d20" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:57:23 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Instance network_info: |[{"id": "a49d8a46-5910-496b-a366-dbf873e81748", "address": "fa:16:3e:4f:94:ae", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49d8a46-59", "ovs_interfaceid": "a49d8a46-5910-496b-a366-dbf873e81748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:57:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e50422a9-06c2-44e8-aa44-737fd562bc4d req-009ef230-2463-473e-b5db-e005b8c9fec0 service nova] Acquired lock "refresh_cache-4dca8fcf-5fed-4cd1-b8db-61f271b93d20" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:57:23 user nova-compute[74611]: DEBUG nova.network.neutron [req-e50422a9-06c2-44e8-aa44-737fd562bc4d req-009ef230-2463-473e-b5db-e005b8c9fec0 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Refreshing network info cache for port a49d8a46-5910-496b-a366-dbf873e81748 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:57:24 user nova-compute[74611]: DEBUG nova.network.neutron [req-e50422a9-06c2-44e8-aa44-737fd562bc4d req-009ef230-2463-473e-b5db-e005b8c9fec0 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Updated VIF entry in instance network info cache for port a49d8a46-5910-496b-a366-dbf873e81748. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:57:24 user nova-compute[74611]: DEBUG nova.network.neutron [req-e50422a9-06c2-44e8-aa44-737fd562bc4d req-009ef230-2463-473e-b5db-e005b8c9fec0 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Updating instance_info_cache with network_info: [{"id": "a49d8a46-5910-496b-a366-dbf873e81748", "address": "fa:16:3e:4f:94:ae", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49d8a46-59", "ovs_interfaceid": "a49d8a46-5910-496b-a366-dbf873e81748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e50422a9-06c2-44e8-aa44-737fd562bc4d req-009ef230-2463-473e-b5db-e005b8c9fec0 service nova] Releasing lock "refresh_cache-4dca8fcf-5fed-4cd1-b8db-61f271b93d20" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:57:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:24 user nova-compute[74611]: INFO nova.compute.manager [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Terminating instance
Nov 13 09:57:24 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 09:57:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:25 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Instance destroyed successfully.
Nov 13 09:57:25 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lazy-loading 'resources' on Instance uuid b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2060951892',display_name='tempest-ServersNegativeTestJSON-server-2060951892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2060951892',id=14,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:55:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='afd392465e2d4ff0b511c9e543972244',ramdisk_id='',reservation_id='r-l8fln8wu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1786337240',owner_user_name='tempest-ServersNegativeTestJSON-1786337240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:55:42Z,user_data=None,user_id='21adb30d68754dba856e5d0a3ae6727e',uuid=b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51208b91-d499-4866-86e6-e81e6115952a", "address": "fa:16:3e:bf:dc:b2", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51208b91-d4", "ovs_interfaceid": "51208b91-d499-4866-86e6-e81e6115952a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Converting VIF {"id": "51208b91-d499-4866-86e6-e81e6115952a", "address": "fa:16:3e:bf:dc:b2", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51208b91-d4", "ovs_interfaceid": "51208b91-d499-4866-86e6-e81e6115952a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:dc:b2,bridge_name='br-int',has_traffic_filtering=True,id=51208b91-d499-4866-86e6-e81e6115952a,network=Network(4d389398-6662-48ae-83f4-1db7fafb4ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51208b91-d4') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG os_vif [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:dc:b2,bridge_name='br-int',has_traffic_filtering=True,id=51208b91-d499-4866-86e6-e81e6115952a,network=Network(4d389398-6662-48ae-83f4-1db7fafb4ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51208b91-d4') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51208b91-d4, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60dcb386-f5b6-4234-884b-c553a9d21e87) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:25 user nova-compute[74611]: INFO os_vif [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:dc:b2,bridge_name='br-int',has_traffic_filtering=True,id=51208b91-d499-4866-86e6-e81e6115952a,network=Network(4d389398-6662-48ae-83f4-1db7fafb4ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51208b91-d4')
Nov 13 09:57:25 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Deleting instance files /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3_del
Nov 13 09:57:25 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Deletion of /opt/stack/data/nova/instances/b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3_del complete
Nov 13 09:57:25 user nova-compute[74611]: INFO nova.compute.manager [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 13 09:57:25 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG nova.compute.manager [req-2ae84d7c-c942-4078-bcf0-45479ce6811e req-b58c1f60-e345-419e-aa54-5643621b1cf0 service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Received event network-vif-unplugged-51208b91-d499-4866-86e6-e81e6115952a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2ae84d7c-c942-4078-bcf0-45479ce6811e req-b58c1f60-e345-419e-aa54-5643621b1cf0 service nova] Acquiring lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2ae84d7c-c942-4078-bcf0-45479ce6811e req-b58c1f60-e345-419e-aa54-5643621b1cf0 service nova] Lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2ae84d7c-c942-4078-bcf0-45479ce6811e req-b58c1f60-e345-419e-aa54-5643621b1cf0 service nova] Lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG nova.compute.manager [req-2ae84d7c-c942-4078-bcf0-45479ce6811e req-b58c1f60-e345-419e-aa54-5643621b1cf0 service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] No waiting events found dispatching network-vif-unplugged-51208b91-d499-4866-86e6-e81e6115952a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG nova.compute.manager [req-2ae84d7c-c942-4078-bcf0-45479ce6811e req-b58c1f60-e345-419e-aa54-5643621b1cf0 service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Received event network-vif-unplugged-51208b91-d499-4866-86e6-e81e6115952a for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG nova.compute.manager [req-2ae84d7c-c942-4078-bcf0-45479ce6811e req-b58c1f60-e345-419e-aa54-5643621b1cf0 service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Received event network-vif-plugged-51208b91-d499-4866-86e6-e81e6115952a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2ae84d7c-c942-4078-bcf0-45479ce6811e req-b58c1f60-e345-419e-aa54-5643621b1cf0 service nova] Acquiring lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2ae84d7c-c942-4078-bcf0-45479ce6811e req-b58c1f60-e345-419e-aa54-5643621b1cf0 service nova] Lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2ae84d7c-c942-4078-bcf0-45479ce6811e req-b58c1f60-e345-419e-aa54-5643621b1cf0 service nova] Lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:25 user nova-compute[74611]: DEBUG nova.compute.manager [req-2ae84d7c-c942-4078-bcf0-45479ce6811e req-b58c1f60-e345-419e-aa54-5643621b1cf0 service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] No waiting events found dispatching network-vif-plugged-51208b91-d499-4866-86e6-e81e6115952a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:25 user nova-compute[74611]: WARNING nova.compute.manager [req-2ae84d7c-c942-4078-bcf0-45479ce6811e req-b58c1f60-e345-419e-aa54-5643621b1cf0 service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Received unexpected event network-vif-plugged-51208b91-d499-4866-86e6-e81e6115952a for instance with vm_state active and task_state deleting.
Nov 13 09:57:25 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:26 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Took 0.44 seconds to deallocate network for instance.
Nov 13 09:57:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:26 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:57:26 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:57:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:26 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Deleted allocations for instance b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3
Nov 13 09:57:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f498297-b577-430e-8719-9a895dd03c04 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.934s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:57:27 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Creating image(s)
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Ensure instance console log exists: /opt/stack/data/nova/instances/4dca8fcf-5fed-4cd1-b8db-61f271b93d20/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Start _get_guest_xml network_info=[{"id": "a49d8a46-5910-496b-a366-dbf873e81748", "address": "fa:16:3e:4f:94:ae", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49d8a46-59", "ovs_interfaceid": "a49d8a46-5910-496b-a366-dbf873e81748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'd4c46e7e-0521-4b10-b2d4-e2f27a349b3e', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWyGPcbV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4dca8fcf-5fed-4cd1-b8db-61f271b93d20', 'attached_at': '', 'detached_at': '', 'volume_id': '643e04eb-4c49-4334-81ee-51a6b3478373', 'serial': '643e04eb-4c49-4334-81ee-51a6b3478373'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:57:27 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:57:27 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWyGPcbV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:57:27 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:57:27 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:57:27 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e591332c-42ed-4ea9-86a1-26086ff90f3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Acquiring lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Acquiring lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:57:27 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:27 user nova-compute[74611]: INFO nova.compute.manager [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Terminating instance
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.compute.manager [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[56caa472-a785-463a-8df5-8844e82be435]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373] added
Nov 13 09:57:27 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e92d59-2945-4a3c-88e4-b1c48d2ec8b0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[466bf15f-3c93-4b6b-b317-89a3427084e8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWyGPcbV {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWyGPcbV" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[446b08a6-041b-4b6b-b5d7-54c12d87a4fe]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IWyGPcbV'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a31ff6-778a-4172-83c7-59179e3810c8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e28359-1d77-4ef8-a610-2a47407ec71b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:57:27 user nova-compute[74611]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 (non-flash)
Nov 13 09:57:27 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:57:27 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:57:27 user nova-compute[74611]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 (non-flash)
Nov 13 09:57:27 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:57:27 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[413f7480-78e5-4f2a-bf01-5918800101cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373, portal: 172.16.0.220,3260]
Nov 13 09:57:27 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373, portal: 172.16.0.220,3260] successful.
Nov 13 09:57:27 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a349a8d-13c5-4130-878c-be0022afa632]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2678c4-07cc-4d33-905b-884961b6286c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:57:27 user nova-compute[74611]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 (non-flash)
Nov 13 09:57:27 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:57:27 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:57:27 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:57:27 user nova-compute[74611]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 (non-flash)
Nov 13 09:57:27 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:57:27 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:57:27 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.032s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2f5565-9d66-4ff1-8fa6-3e566ee1555d]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWyGPcbV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-cabe3eea-b61f-4797-8b9b-27addc89503a req-7921a65c-26a2-42c1-92d0-397759a725ae service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Received event network-vif-unplugged-c17146c8-a3ec-4289-b41d-751fff2e490f {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cabe3eea-b61f-4797-8b9b-27addc89503a req-7921a65c-26a2-42c1-92d0-397759a725ae service nova] Acquiring lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cabe3eea-b61f-4797-8b9b-27addc89503a req-7921a65c-26a2-42c1-92d0-397759a725ae service nova] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cabe3eea-b61f-4797-8b9b-27addc89503a req-7921a65c-26a2-42c1-92d0-397759a725ae service nova] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-cabe3eea-b61f-4797-8b9b-27addc89503a req-7921a65c-26a2-42c1-92d0-397759a725ae service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] No waiting events found dispatching network-vif-unplugged-c17146c8-a3ec-4289-b41d-751fff2e490f {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-cabe3eea-b61f-4797-8b9b-27addc89503a req-7921a65c-26a2-42c1-92d0-397759a725ae service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Received event network-vif-unplugged-c17146c8-a3ec-4289-b41d-751fff2e490f for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-0aa853b4-d5fb-4e03-a3f4-0a9ecacccd5c req-92beeb11-a814-440e-a46e-d1f44c08f9b1 service nova] [instance: b1b2d03f-df9d-47c9-9ecc-9a76a25bbcf3] Received event network-vif-deleted-51208b91-d499-4866-86e6-e81e6115952a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:27 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Instance destroyed successfully.
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.objects.instance [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lazy-loading 'resources' on Instance uuid 5b70fc11-140f-4c9a-9e75-2b33705d8c6d {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:54:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1946762089',display_name='tempest-TestVolumeSwap-server-1946762089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1946762089',id=7,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt1we8u0Tg5fbB4Zfz1mK38cJ9vYiLUNrJkgmCeapO9kscK4KLAH0Umww9UKCtaaDjNQuzuccrsbA2t/N19Rn0uEd+U4bWVsruczoFc3J+cL5iEyBvdBaDPn8QhZCG/DA==',key_name='tempest-keypair-51357756',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:54:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67b6ac63cf4a4e7b8a3c5db0242d4612',ramdisk_id='',reservation_id='r-gzev0n0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1312910266',owner_user_name='tempest-TestVolumeSwap-1312910266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:54:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8a64c0b83054c428413ccdb33464864',uuid=5b70fc11-140f-4c9a-9e75-2b33705d8c6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c17146c8-a3ec-4289-b41d-751fff2e490f", "address": "fa:16:3e:88:fb:1e", "network": {"id": "3594b817-94b7-461b-9cc7-b7f99c0605c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-143737876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b6ac63cf4a4e7b8a3c5db0242d4612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17146c8-a3", "ovs_interfaceid": "c17146c8-a3ec-4289-b41d-751fff2e490f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Converting VIF {"id": "c17146c8-a3ec-4289-b41d-751fff2e490f", "address": "fa:16:3e:88:fb:1e", "network": {"id": "3594b817-94b7-461b-9cc7-b7f99c0605c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-143737876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b6ac63cf4a4e7b8a3c5db0242d4612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17146c8-a3", "ovs_interfaceid": "c17146c8-a3ec-4289-b41d-751fff2e490f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:fb:1e,bridge_name='br-int',has_traffic_filtering=True,id=c17146c8-a3ec-4289-b41d-751fff2e490f,network=Network(3594b817-94b7-461b-9cc7-b7f99c0605c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17146c8-a3') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG os_vif [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:fb:1e,bridge_name='br-int',has_traffic_filtering=True,id=c17146c8-a3ec-4289-b41d-751fff2e490f,network=Network(3594b817-94b7-461b-9cc7-b7f99c0605c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17146c8-a3') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc17146c8-a3, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8aadf3f9-65ab-4aba-83bc-28888af860a1) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:57:27 user nova-compute[74611]: INFO os_vif [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:fb:1e,bridge_name='br-int',has_traffic_filtering=True,id=c17146c8-a3ec-4289-b41d-751fff2e490f,network=Network(3594b817-94b7-461b-9cc7-b7f99c0605c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17146c8-a3')
Nov 13 09:57:27 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Deleting instance files /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d_del
Nov 13 09:57:27 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Deletion of /opt/stack/data/nova/instances/5b70fc11-140f-4c9a-9e75-2b33705d8c6d_del complete
Nov 13 09:57:28 user nova-compute[74611]: INFO nova.compute.manager [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 13 09:57:28 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23139613533353436', 'path': '/dev/sdd'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139613533353436', 'path': '/dev/sdd'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "eea01f90-3c79-4304-913e-8cf7e9749480" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "eea01f90-3c79-4304-913e-8cf7e9749480" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:28 user nova-compute[74611]: INFO nova.compute.manager [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Terminating instance
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1315669298',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1315669298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1315669298',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzgUqg7kdjn4KeG9rPNkMbmVu086xV3JV1xbiUBzg4WtgG7GNLkc6mx1YWAf+PnYL0G4TXrG4AJa840v7zu30ubs0bgRP0UrWwbfCA7lfNV8c9MA9jsSCrNEagu7vnnsQ==',key_name='tempest-keypair-1427390821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-iu0ach9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:57:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=4dca8fcf-5fed-4cd1-b8db-61f271b93d20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a49d8a46-5910-496b-a366-dbf873e81748", "address": "fa:16:3e:4f:94:ae", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49d8a46-59", "ovs_interfaceid": "a49d8a46-5910-496b-a366-dbf873e81748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "a49d8a46-5910-496b-a366-dbf873e81748", "address": "fa:16:3e:4f:94:ae", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49d8a46-59", "ovs_interfaceid": "a49d8a46-5910-496b-a366-dbf873e81748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:94:ae,bridge_name='br-int',has_traffic_filtering=True,id=a49d8a46-5910-496b-a366-dbf873e81748,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49d8a46-59') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lazy-loading 'pci_devices' on Instance uuid 4dca8fcf-5fed-4cd1-b8db-61f271b93d20 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:57:28 user nova-compute[74611]:   <uuid>4dca8fcf-5fed-4cd1-b8db-61f271b93d20</uuid>
Nov 13 09:57:28 user nova-compute[74611]:   <name>instance-00000011</name>
Nov 13 09:57:28 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:57:28 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:57:28 user nova-compute[74611]:   <metadata>
Nov 13 09:57:28 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:57:28 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:57:28 user nova-compute[74611]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1315669298</nova:name>
Nov 13 09:57:28 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:57:27</nova:creationTime>
Nov 13 09:57:28 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:57:28 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:57:28 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:57:28 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:57:28 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:57:28 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:57:28 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:57:28 user nova-compute[74611]:       <nova:owner>
Nov 13 09:57:28 user nova-compute[74611]:         <nova:user uuid="91e7d88000c1476abfb0df6bfca4e0fb">tempest-TestVolumeBootPattern-633061604-project-member</nova:user>
Nov 13 09:57:28 user nova-compute[74611]:         <nova:project uuid="f12e0c04622143f2a0c24258ab90e153">tempest-TestVolumeBootPattern-633061604</nova:project>
Nov 13 09:57:28 user nova-compute[74611]:       </nova:owner>
Nov 13 09:57:28 user nova-compute[74611]:       <nova:ports>
Nov 13 09:57:28 user nova-compute[74611]:         <nova:port uuid="a49d8a46-5910-496b-a366-dbf873e81748">
Nov 13 09:57:28 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 09:57:28 user nova-compute[74611]:         </nova:port>
Nov 13 09:57:28 user nova-compute[74611]:       </nova:ports>
Nov 13 09:57:28 user nova-compute[74611]:     </nova:instance>
Nov 13 09:57:28 user nova-compute[74611]:   </metadata>
Nov 13 09:57:28 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:57:28 user nova-compute[74611]:     <system>
Nov 13 09:57:28 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:57:28 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:57:28 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:57:28 user nova-compute[74611]:       <entry name="serial">4dca8fcf-5fed-4cd1-b8db-61f271b93d20</entry>
Nov 13 09:57:28 user nova-compute[74611]:       <entry name="uuid">4dca8fcf-5fed-4cd1-b8db-61f271b93d20</entry>
Nov 13 09:57:28 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:57:28 user nova-compute[74611]:     </system>
Nov 13 09:57:28 user nova-compute[74611]:   </sysinfo>
Nov 13 09:57:28 user nova-compute[74611]:   <os>
Nov 13 09:57:28 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:57:28 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:57:28 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:57:28 user nova-compute[74611]:   </os>
Nov 13 09:57:28 user nova-compute[74611]:   <features>
Nov 13 09:57:28 user nova-compute[74611]:     <acpi/>
Nov 13 09:57:28 user nova-compute[74611]:     <apic/>
Nov 13 09:57:28 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:57:28 user nova-compute[74611]:   </features>
Nov 13 09:57:28 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:57:28 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:57:28 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:57:28 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:57:28 user nova-compute[74611]:   </clock>
Nov 13 09:57:28 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:57:28 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:57:28 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:57:28 user nova-compute[74611]:   </cpu>
Nov 13 09:57:28 user nova-compute[74611]:   <devices>
Nov 13 09:57:28 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 09:57:28 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:57:28 user nova-compute[74611]:       <source dev="/dev/sdd"/>
Nov 13 09:57:28 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:57:28 user nova-compute[74611]:       <serial>643e04eb-4c49-4334-81ee-51a6b3478373</serial>
Nov 13 09:57:28 user nova-compute[74611]:     </disk>
Nov 13 09:57:28 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:57:28 user nova-compute[74611]:       <mac address="fa:16:3e:4f:94:ae"/>
Nov 13 09:57:28 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:57:28 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:57:28 user nova-compute[74611]:       <target dev="tapa49d8a46-59"/>
Nov 13 09:57:28 user nova-compute[74611]:     </interface>
Nov 13 09:57:28 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:57:28 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/4dca8fcf-5fed-4cd1-b8db-61f271b93d20/console.log" append="off"/>
Nov 13 09:57:28 user nova-compute[74611]:     </serial>
Nov 13 09:57:28 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:57:28 user nova-compute[74611]:     <video>
Nov 13 09:57:28 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:57:28 user nova-compute[74611]:     </video>
Nov 13 09:57:28 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:57:28 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:57:28 user nova-compute[74611]:     </rng>
Nov 13 09:57:28 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:57:28 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:57:28 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:57:28 user nova-compute[74611]:     </memballoon>
Nov 13 09:57:28 user nova-compute[74611]:   </devices>
Nov 13 09:57:28 user nova-compute[74611]: </domain>
Nov 13 09:57:28 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1315669298',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1315669298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1315669298',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzgUqg7kdjn4KeG9rPNkMbmVu086xV3JV1xbiUBzg4WtgG7GNLkc6mx1YWAf+PnYL0G4TXrG4AJa840v7zu30ubs0bgRP0UrWwbfCA7lfNV8c9MA9jsSCrNEagu7vnnsQ==',key_name='tempest-keypair-1427390821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-iu0ach9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:57:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=4dca8fcf-5fed-4cd1-b8db-61f271b93d20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a49d8a46-5910-496b-a366-dbf873e81748", "address": "fa:16:3e:4f:94:ae", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49d8a46-59", "ovs_interfaceid": "a49d8a46-5910-496b-a366-dbf873e81748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "a49d8a46-5910-496b-a366-dbf873e81748", "address": "fa:16:3e:4f:94:ae", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49d8a46-59", "ovs_interfaceid": "a49d8a46-5910-496b-a366-dbf873e81748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:94:ae,bridge_name='br-int',has_traffic_filtering=True,id=a49d8a46-5910-496b-a366-dbf873e81748,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49d8a46-59') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG os_vif [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:94:ae,bridge_name='br-int',has_traffic_filtering=True,id=a49d8a46-5910-496b-a366-dbf873e81748,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49d8a46-59') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20a3cbed-646d-5883-a969-64aaf210bb86', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa49d8a46-59, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa49d8a46-59, col_values=(('qos', UUID('9dcedb5e-eb43-48a6-8d22-303dd9859f4f')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa49d8a46-59, col_values=(('external_ids', {'iface-id': 'a49d8a46-5910-496b-a366-dbf873e81748', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:94:ae', 'vm-uuid': '4dca8fcf-5fed-4cd1-b8db-61f271b93d20'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:28 user nova-compute[74611]: INFO os_vif [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:94:ae,bridge_name='br-int',has_traffic_filtering=True,id=a49d8a46-5910-496b-a366-dbf873e81748,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49d8a46-59')
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] No VIF found with MAC fa:16:3e:4f:94:ae, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-4f88c998-9f02-4beb-bc05-04d9dda635b2 req-cc97c739-7edb-48f5-8d9a-81f5f870d720 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received event network-vif-unplugged-805b4d7d-b250-40e4-af31-e9f281182115 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4f88c998-9f02-4beb-bc05-04d9dda635b2 req-cc97c739-7edb-48f5-8d9a-81f5f870d720 service nova] Acquiring lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4f88c998-9f02-4beb-bc05-04d9dda635b2 req-cc97c739-7edb-48f5-8d9a-81f5f870d720 service nova] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4f88c998-9f02-4beb-bc05-04d9dda635b2 req-cc97c739-7edb-48f5-8d9a-81f5f870d720 service nova] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-4f88c998-9f02-4beb-bc05-04d9dda635b2 req-cc97c739-7edb-48f5-8d9a-81f5f870d720 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] No waiting events found dispatching network-vif-unplugged-805b4d7d-b250-40e4-af31-e9f281182115 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-4f88c998-9f02-4beb-bc05-04d9dda635b2 req-cc97c739-7edb-48f5-8d9a-81f5f870d720 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received event network-vif-unplugged-805b4d7d-b250-40e4-af31-e9f281182115 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:29 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Took 1.02 seconds to deallocate network for instance.
Nov 13 09:57:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:29 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Deleted allocations for instance 5b70fc11-140f-4c9a-9e75-2b33705d8c6d
Nov 13 09:57:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-832f31ae-b400-4836-87fc-bc84450062a1 tempest-TestVolumeSwap-1312910266 tempest-TestVolumeSwap-1312910266-project-member] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.519s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-9c1d4aa8-d85e-4e0e-8a37-be2628c31a5a req-980abce3-b1a5-4775-ba47-78f661521498 service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Received event network-vif-plugged-c17146c8-a3ec-4289-b41d-751fff2e490f {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9c1d4aa8-d85e-4e0e-8a37-be2628c31a5a req-980abce3-b1a5-4775-ba47-78f661521498 service nova] Acquiring lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9c1d4aa8-d85e-4e0e-8a37-be2628c31a5a req-980abce3-b1a5-4775-ba47-78f661521498 service nova] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9c1d4aa8-d85e-4e0e-8a37-be2628c31a5a req-980abce3-b1a5-4775-ba47-78f661521498 service nova] Lock "5b70fc11-140f-4c9a-9e75-2b33705d8c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-9c1d4aa8-d85e-4e0e-8a37-be2628c31a5a req-980abce3-b1a5-4775-ba47-78f661521498 service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] No waiting events found dispatching network-vif-plugged-c17146c8-a3ec-4289-b41d-751fff2e490f {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:29 user nova-compute[74611]: WARNING nova.compute.manager [req-9c1d4aa8-d85e-4e0e-8a37-be2628c31a5a req-980abce3-b1a5-4775-ba47-78f661521498 service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Received unexpected event network-vif-plugged-c17146c8-a3ec-4289-b41d-751fff2e490f for instance with vm_state deleted and task_state None.
Nov 13 09:57:29 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Instance destroyed successfully.
Nov 13 09:57:29 user nova-compute[74611]: DEBUG nova.objects.instance [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lazy-loading 'resources' on Instance uuid eea01f90-3c79-4304-913e-8cf7e9749480 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T09:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-560513437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-560513437',id=8,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeQwNIdKbZkcJ1bL6vxLyRaw/tiXK1lBMCzqrmneLrH3GH4oV5/eRe+ZKc6KvSL9xj8s0omUXtq4rOBJVCBpsYTYfMFZFh2iLGaIRkl6/UO9iRuPbpk3z3yXYcyxqHiGw==',key_name='tempest-keypair-788651981',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:54:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f6f36a09d514934ab7e11e7e945658f',ramdisk_id='',reservation_id='r-o8x6c9da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-987448261',owner_user_name='tempest-TaggedAttachmentsTest-987448261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:54:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4627e309322495f90a6e412f7e36c75',uuid=eea01f90-3c79-4304-913e-8cf7e9749480,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "805b4d7d-b250-40e4-af31-e9f281182115", "address": "fa:16:3e:05:dc:a6", "network": {"id": "76b58f11-8450-4eea-b1c5-996e7112fd8b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1065019570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap805b4d7d-b2", "ovs_interfaceid": "805b4d7d-b250-40e4-af31-e9f281182115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Converting VIF {"id": "805b4d7d-b250-40e4-af31-e9f281182115", "address": "fa:16:3e:05:dc:a6", "network": {"id": "76b58f11-8450-4eea-b1c5-996e7112fd8b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1065019570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6f36a09d514934ab7e11e7e945658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap805b4d7d-b2", "ovs_interfaceid": "805b4d7d-b250-40e4-af31-e9f281182115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:dc:a6,bridge_name='br-int',has_traffic_filtering=True,id=805b4d7d-b250-40e4-af31-e9f281182115,network=Network(76b58f11-8450-4eea-b1c5-996e7112fd8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap805b4d7d-b2') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG os_vif [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:dc:a6,bridge_name='br-int',has_traffic_filtering=True,id=805b4d7d-b250-40e4-af31-e9f281182115,network=Network(76b58f11-8450-4eea-b1c5-996e7112fd8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap805b4d7d-b2') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap805b4d7d-b2, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5eea3ea4-982f-45eb-b6eb-b10d0ec96c39) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:29 user nova-compute[74611]: INFO os_vif [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:dc:a6,bridge_name='br-int',has_traffic_filtering=True,id=805b4d7d-b250-40e4-af31-e9f281182115,network=Network(76b58f11-8450-4eea-b1c5-996e7112fd8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap805b4d7d-b2')
Nov 13 09:57:29 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Deleting instance files /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480_del
Nov 13 09:57:29 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Deletion of /opt/stack/data/nova/instances/eea01f90-3c79-4304-913e-8cf7e9749480_del complete
Nov 13 09:57:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-1f36b3e2-7258-427a-b86b-924fa95e15af req-f32d3e0b-f6a3-468f-972c-da03db7dfc04 service nova] [instance: 5b70fc11-140f-4c9a-9e75-2b33705d8c6d] Received event network-vif-deleted-c17146c8-a3ec-4289-b41d-751fff2e490f {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:29 user nova-compute[74611]: INFO nova.compute.manager [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 13 09:57:29 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 09:57:29 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:30 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Took 0.91 seconds to deallocate network for instance.
Nov 13 09:57:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received event network-vif-plugged-805b4d7d-b250-40e4-af31-e9f281182115 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] Acquiring lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] Lock "eea01f90-3c79-4304-913e-8cf7e9749480-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] No waiting events found dispatching network-vif-plugged-805b4d7d-b250-40e4-af31-e9f281182115 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:30 user nova-compute[74611]: WARNING nova.compute.manager [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received unexpected event network-vif-plugged-805b4d7d-b250-40e4-af31-e9f281182115 for instance with vm_state deleted and task_state None.
Nov 13 09:57:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Received event network-vif-plugged-a49d8a46-5910-496b-a366-dbf873e81748 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] Acquiring lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] Lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] Lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] No waiting events found dispatching network-vif-plugged-a49d8a46-5910-496b-a366-dbf873e81748 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:30 user nova-compute[74611]: WARNING nova.compute.manager [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Received unexpected event network-vif-plugged-a49d8a46-5910-496b-a366-dbf873e81748 for instance with vm_state building and task_state spawning.
Nov 13 09:57:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Received event network-vif-plugged-a49d8a46-5910-496b-a366-dbf873e81748 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] Acquiring lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] Lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] Lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] No waiting events found dispatching network-vif-plugged-a49d8a46-5910-496b-a366-dbf873e81748 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:30 user nova-compute[74611]: WARNING nova.compute.manager [req-c9a375d9-caf5-4ccd-9407-7aefdc807d02 req-b2745482-03aa-4390-87b1-077e46566fb9 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Received unexpected event network-vif-plugged-a49d8a46-5910-496b-a366-dbf873e81748 for instance with vm_state building and task_state spawning.
Nov 13 09:57:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:31 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:57:31 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:57:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:31 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Deleted allocations for instance eea01f90-3c79-4304-913e-8cf7e9749480
Nov 13 09:57:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50340693-3091-4b14-a1e9-f2459c3e092d tempest-TaggedAttachmentsTest-987448261 tempest-TaggedAttachmentsTest-987448261-project-member] Lock "eea01f90-3c79-4304-913e-8cf7e9749480" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.908s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:31 user nova-compute[74611]: DEBUG nova.compute.manager [req-ed95b680-6b82-48be-8a8b-7e27b8518775 req-088e4f20-9fd8-43ed-bfbf-80a953ec260d service nova] [instance: eea01f90-3c79-4304-913e-8cf7e9749480] Received event network-vif-deleted-805b4d7d-b250-40e4-af31-e9f281182115 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:57:32 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Instance spawned successfully.
Nov 13 09:57:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:32 user nova-compute[74611]: INFO nova.compute.manager [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Unshelving
Nov 13 09:57:32 user nova-compute[74611]: INFO nova.compute.manager [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 13 09:57:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:57:32 user nova-compute[74611]: INFO nova.compute.manager [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Took 10.84 seconds to build instance.
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6f911dc9-4660-4d77-a421-7501308364c8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.936s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:32 user nova-compute[74611]: INFO nova.virt.block_device [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Booting with volume 119a6505-bb82-4b80-b5ed-d3f7e5f53963 at /dev/vdc
Nov 13 09:57:32 user nova-compute[74611]: DEBUG os_brick.utils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6c772e-33f7-4993-ad60-b206ef3c8d7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7262fe55-c210-43b5-9d91-beae35a28edb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaad6967-4fb3-45f1-8172-6525437b45ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c689172-14ab-4cf8-b06d-84644272e431]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:57:32 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:57:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[16183a73-3b2f-4008-8715-0aa11e88bc8a]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG os_brick.utils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:57:32 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updating existing volume attachment record: 3c3ad5af-2710-425f-afe7-09f0b7f6da09 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:57:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:37 user nova-compute[74611]: DEBUG nova.objects.instance [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'pci_requests' on Instance uuid 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:37 user nova-compute[74611]: DEBUG nova.objects.instance [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'numa_topology' on Instance uuid 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:57:37 user nova-compute[74611]: INFO nova.compute.claims [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Claim successful on node user
Nov 13 09:57:37 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:57:37 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:57:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:38 user nova-compute[74611]: INFO nova.network.neutron [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updating port e730080f-c599-449b-b366-a642be4f9ac7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 13 09:57:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:57:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquired lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:57:38 user nova-compute[74611]: DEBUG nova.network.neutron [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:57:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-4952e37f-d7b2-489f-9e50-f59773abb9bf req-f6fd47b0-2007-49fd-ade5-1edd9d798e88 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received event network-changed-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-4952e37f-d7b2-489f-9e50-f59773abb9bf req-f6fd47b0-2007-49fd-ade5-1edd9d798e88 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Refreshing instance network info cache due to event network-changed-e730080f-c599-449b-b366-a642be4f9ac7. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:57:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4952e37f-d7b2-489f-9e50-f59773abb9bf req-f6fd47b0-2007-49fd-ade5-1edd9d798e88 service nova] Acquiring lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:57:39 user nova-compute[74611]: DEBUG nova.network.neutron [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updating instance_info_cache with network_info: [{"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Releasing lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:57:39 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:57:39 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Creating image(s)
Nov 13 09:57:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "/opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "/opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "/opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:39 user nova-compute[74611]: DEBUG nova.objects.instance [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4952e37f-d7b2-489f-9e50-f59773abb9bf req-f6fd47b0-2007-49fd-ade5-1edd9d798e88 service nova] Acquired lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:57:39 user nova-compute[74611]: DEBUG nova.network.neutron [req-4952e37f-d7b2-489f-9e50-f59773abb9bf req-f6fd47b0-2007-49fd-ade5-1edd9d798e88 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Refreshing network info cache for port e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:57:39 user nova-compute[74611]: DEBUG nova.objects.base [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Object Instance<8cdb9561-3b40-44cc-abf7-2cbff7e60a17> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:57:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "b3077f86d24b8b00183b107703a73b688a91fbfd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "b3077f86d24b8b00183b107703a73b688a91fbfd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd.part --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:40 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 89038547-5416-4942-8070-dd5dd8e4b6c2 is timed out.
Nov 13 09:57:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:40 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Successfully detached device vdb from instance 89038547-5416-4942-8070-dd5dd8e4b6c2 from the live domain config.
Nov 13 09:57:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJRweuHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:57:40 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaac1d1b-43ae-4624-a248-eedc9598fd52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 09:57:40 user nova-compute[74611]: No targets found.
Nov 13 09:57:40 user nova-compute[74611]: iSNS:
Nov 13 09:57:40 user nova-compute[74611]: No targets found.
Nov 13 09:57:40 user nova-compute[74611]: STATIC:
Nov 13 09:57:40 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373
Nov 13 09:57:40 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:57:40 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:57:40 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478
Nov 13 09:57:40 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:57:40 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:57:40 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d
Nov 13 09:57:40 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:57:40 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:57:40 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 09:57:40 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:57:40 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:57:40 user nova-compute[74611]: FIRMWARE:
Nov 13 09:57:40 user nova-compute[74611]: No targets found.
Nov 13 09:57:40 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 09:57:40 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 09:57:40 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8340648d-eb4f-46bc-8349-f239c44e1e9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[045e67fe-e35d-4a0b-9fd9-90b220e12a74]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:57:40 user nova-compute[74611]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 (non-flash)
Nov 13 09:57:40 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:57:40 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:57:40 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:57:40 user nova-compute[74611]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 (non-flash)
Nov 13 09:57:40 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:57:40 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:57:40 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7c14ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa4d5e2-4732-4e06-b01b-4272f1c6a11f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd.part --force-share --output=json" returned: 0 in 0.207s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG nova.virt.images [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] 688f36ff-2206-4352-bb90-d874d5e39c9d was qcow2, converting to raw {{(pid=74611) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd.part /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd.converted {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0416ff5e-e9f9-4df6-9a6f-6389b93a9c19]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[caeb494d-12d3-45bf-aa1f-904f0ecf303a]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[34595e41-ff60-42a2-abcb-8a522b459d36]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG nova.network.neutron [req-4952e37f-d7b2-489f-9e50-f59773abb9bf req-f6fd47b0-2007-49fd-ade5-1edd9d798e88 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updated VIF entry in instance network info cache for port e730080f-c599-449b-b366-a642be4f9ac7. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG nova.network.neutron [req-4952e37f-d7b2-489f-9e50-f59773abb9bf req-f6fd47b0-2007-49fd-ade5-1edd9d798e88 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updating instance_info_cache with network_info: [{"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.076s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b31124-84ce-4778-bd77-4cc1763c0415]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4952e37f-d7b2-489f-9e50-f59773abb9bf req-f6fd47b0-2007-49fd-ade5-1edd9d798e88 service nova] Releasing lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd.part /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd.converted" returned: 0 in 0.288s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd.converted --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[38466fdd-a329-4f58-97db-ce65c042aa63]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478, portal: 172.16.0.220,3260]
Nov 13 09:57:40 user nova-compute[74611]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478, portal: 172.16.0.220,3260] successful.
Nov 13 09:57:40 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a761372-122b-47a2-b3af-53c1b5dac478 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bca78cc-558b-4b25-afe4-07dbe98494d4]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.562s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] <== disconnect_volume: return (564ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-1c66c8a8-abb5-4f60-8464-074627c213d8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-1c66c8a8-abb5-4f60-8464-074627c213d8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:57:40 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "b3077f86d24b8b00183b107703a73b688a91fbfd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.931s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd --force-share --output=json" returned: 0 in 0.186s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "b3077f86d24b8b00183b107703a73b688a91fbfd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "b3077f86d24b8b00183b107703a73b688a91fbfd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd --force-share --output=json" returned: 0 in 0.210s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd,backing_fmt=raw /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Updating instance_info_cache with network_info: [{"id": "af98cec6-7e77-428e-b0df-8901c45fafe5", "address": "fa:16:3e:49:ed:03", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98cec6-7e", "ovs_interfaceid": "af98cec6-7e77-428e-b0df-8901c45fafe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd,backing_fmt=raw /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk 1073741824" returned: 0 in 0.049s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "b3077f86d24b8b00183b107703a73b688a91fbfd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-1c66c8a8-abb5-4f60-8464-074627c213d8" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd --force-share --output=json" returned: 0 in 0.190s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG nova.objects.instance [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'migration_context' on Instance uuid 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG nova.objects.base [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Object Instance<8cdb9561-3b40-44cc-abf7-2cbff7e60a17> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:57:41 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Rebasing disk image.
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG nova.objects.instance [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lazy-loading 'flavor' on Instance uuid 89038547-5416-4942-8070-dd5dd8e4b6c2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c10f1676-2b19-483d-8c81-8dea7efcf9f3 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.630s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.189s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 -F raw /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:42 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:57:42 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:57:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 09:57:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-f887241e-4628-4949-b11e-30e2c8a0e799 req-a8c0547a-dbfa-44ac-946b-1f9db0acc1f8 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received event network-changed-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-f887241e-4628-4949-b11e-30e2c8a0e799 req-a8c0547a-dbfa-44ac-946b-1f9db0acc1f8 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Refreshing instance network info cache due to event network-changed-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:57:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f887241e-4628-4949-b11e-30e2c8a0e799 req-a8c0547a-dbfa-44ac-946b-1f9db0acc1f8 service nova] Acquiring lock "refresh_cache-1958dc22-14f4-42ca-966d-f489e402e001" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:57:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f887241e-4628-4949-b11e-30e2c8a0e799 req-a8c0547a-dbfa-44ac-946b-1f9db0acc1f8 service nova] Acquired lock "refresh_cache-1958dc22-14f4-42ca-966d-f489e402e001" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:57:43 user nova-compute[74611]: DEBUG nova.network.neutron [req-f887241e-4628-4949-b11e-30e2c8a0e799 req-a8c0547a-dbfa-44ac-946b-1f9db0acc1f8 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Refreshing network info cache for port 28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "1958dc22-14f4-42ca-966d-f489e402e001" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "1958dc22-14f4-42ca-966d-f489e402e001" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "1958dc22-14f4-42ca-966d-f489e402e001-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:44 user nova-compute[74611]: INFO nova.compute.manager [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Terminating instance
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 -F raw /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk" returned: 0 in 2.757s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Ensure instance console log exists: /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Start _get_guest_xml network_info=[{"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='09e4faee8552969816c73aa02cab877b',container_format='bare',created_at=2023-11-13T09:55:40Z,direct_url=<?>,disk_format='qcow2',id=688f36ff-2206-4352-bb90-d874d5e39c9d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-610781-shelved',owner='d5a6f570a7e7404680bd5809be8b0378',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-13T09:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': '3c3ad5af-2710-425f-afe7-09f0b7f6da09', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKZbWlas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '8cdb9561-3b40-44cc-abf7-2cbff7e60a17', 'attached_at': '', 'detached_at': '', 'volume_id': '119a6505-bb82-4b80-b5ed-d3f7e5f53963', 'serial': '119a6505-bb82-4b80-b5ed-d3f7e5f53963'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:57:44 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:57:44 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='09e4faee8552969816c73aa02cab877b',container_format='bare',created_at=2023-11-13T09:55:40Z,direct_url=<?>,disk_format='qcow2',id=688f36ff-2206-4352-bb90-d874d5e39c9d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-610781-shelved',owner='d5a6f570a7e7404680bd5809be8b0378',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-13T09:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.objects.instance [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.objects.base [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Object Instance<8cdb9561-3b40-44cc-abf7-2cbff7e60a17> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKZbWlas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:57:44 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:57:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:57:44 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:57:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:57:44 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.network.neutron [req-f887241e-4628-4949-b11e-30e2c8a0e799 req-a8c0547a-dbfa-44ac-946b-1f9db0acc1f8 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Updated VIF entry in instance network info cache for port 28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.network.neutron [req-f887241e-4628-4949-b11e-30e2c8a0e799 req-a8c0547a-dbfa-44ac-946b-1f9db0acc1f8 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Updating instance_info_cache with network_info: [{"id": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "address": "fa:16:3e:79:69:46", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28279eb1-ec", "ovs_interfaceid": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.compute.manager [req-2928eb5f-4b45-4c95-8968-06ebf555934c req-15adb9c7-b427-4308-b859-05a7e9128a6b service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received event network-vif-unplugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2928eb5f-4b45-4c95-8968-06ebf555934c req-15adb9c7-b427-4308-b859-05a7e9128a6b service nova] Acquiring lock "1958dc22-14f4-42ca-966d-f489e402e001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2928eb5f-4b45-4c95-8968-06ebf555934c req-15adb9c7-b427-4308-b859-05a7e9128a6b service nova] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2928eb5f-4b45-4c95-8968-06ebf555934c req-15adb9c7-b427-4308-b859-05a7e9128a6b service nova] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.compute.manager [req-2928eb5f-4b45-4c95-8968-06ebf555934c req-15adb9c7-b427-4308-b859-05a7e9128a6b service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] No waiting events found dispatching network-vif-unplugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.compute.manager [req-2928eb5f-4b45-4c95-8968-06ebf555934c req-15adb9c7-b427-4308-b859-05a7e9128a6b service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received event network-vif-unplugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f887241e-4628-4949-b11e-30e2c8a0e799 req-a8c0547a-dbfa-44ac-946b-1f9db0acc1f8 service nova] Releasing lock "refresh_cache-1958dc22-14f4-42ca-966d-f489e402e001" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[df809e83-5a95-487c-8c8c-a4019a6ff1b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:57:44 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[969be7e0-eb35-437e-9ae5-b819044d5153]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963] added
Nov 13 09:57:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[579fea62-d961-4099-9387-24c223a1b169]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 09:57:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43032b5-918c-4ed0-ba4b-a745cbbf64c7]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKZbWlas {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKZbWlas" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edbd284-d659-4304-8b23-93dd3b817ad7]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cKZbWlas'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[215f3220-f452-471d-ac16-e8a7f3c45f19]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[070eeb6d-597c-46cf-a27e-69a8eec8235a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:57:45 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:57:45 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:57:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:57:45 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:57:45 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:57:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:45 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Instance destroyed successfully.
Nov 13 09:57:45 user nova-compute[74611]: DEBUG nova.objects.instance [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'resources' on Instance uuid 1958dc22-14f4-42ca-966d-f489e402e001 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d1cf5c-ed69-46c9-b023-088ab60d7cdd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963, portal: 172.16.0.220,3260]
Nov 13 09:57:45 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963, portal: 172.16.0.220,3260] successful.
Nov 13 09:57:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1381269941',display_name='tempest-AttachVolumeNegativeTest-server-1381269941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1381269941',id=15,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrURP6TXHDGNB+iZoZZZ66Q0u7n8pTVWjq+b9f48lGwpkduz6Ojy0hs+prwvK6XaOhk/mhKBYx3MvE4fe04c+/1JMDgOh72Pg3utusKs9ApV2X1XDNnwrzgMOgE+CdG+A==',key_name='tempest-keypair-1486712828',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1384599c1e484e54ae29b024377dbd04',ramdisk_id='',reservation_id='r-a0euq472',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1307038303',owner_user_name='tempest-AttachVolumeNegativeTest-1307038303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d93cfc3fb54b41ceb9f9657de0059043',uuid=1958dc22-14f4-42ca-966d-f489e402e001,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "address": "fa:16:3e:79:69:46", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28279eb1-ec", "ovs_interfaceid": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converting VIF {"id": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "address": "fa:16:3e:79:69:46", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28279eb1-ec", "ovs_interfaceid": "28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:69:46,bridge_name='br-int',has_traffic_filtering=True,id=28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28279eb1-ec') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG os_vif [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:69:46,bridge_name='br-int',has_traffic_filtering=True,id=28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28279eb1-ec') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28279eb1-ec, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f595a53-34fd-47e1-95ae-f00cd0d35fa7]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1108faee-7bc7-4ee6-a607-bbca1f91a988) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:45 user nova-compute[74611]: INFO os_vif [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:69:46,bridge_name='br-int',has_traffic_filtering=True,id=28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28279eb1-ec')
Nov 13 09:57:45 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Deleting instance files /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001_del
Nov 13 09:57:45 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Deletion of /opt/stack/data/nova/instances/1958dc22-14f4-42ca-966d-f489e402e001_del complete
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7958fe11-8eaa-4446-b9d6-b4a3cd8fb7d7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:57:45 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:57:45 user nova-compute[74611]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)
Nov 13 09:57:45 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:57:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:57:45 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:57:45 user nova-compute[74611]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)
Nov 13 09:57:45 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:57:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.504s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.031s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b46ca6-3a3f-4917-91d4-5305ce8c2221]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKZbWlas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.384s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:45 user nova-compute[74611]: INFO nova.compute.manager [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.575s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] <== connect_volume: return (1579ms) {'type': 'block', 'scsi_wwn': '23131376464663264', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131376464663264', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T09:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-610781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-610781',id=5,image_ref='688f36ff-2206-4352-bb90-d874d5e39c9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1489015223',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d5a6f570a7e7404680bd5809be8b0378',ramdisk_id='',reservation_id='r-yu0u8g36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-55203260',owner_user_name='tempest-AttachVolumeShelveTestJSON-55203260-project-member',shelved_at='2023-11-13T09:55:45.430928',shelved_host='user',shelved_image_id='688f36ff-2206-4352-bb90-d874d5e39c9d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:57:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008616dff48b4bdeb2ea0f2be72a2934',uuid=8cdb9561-3b40-44cc-abf7-2cbff7e60a17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converting VIF {"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:96:5e,bridge_name='br-int',has_traffic_filtering=True,id=e730080f-c599-449b-b366-a642be4f9ac7,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape730080f-c5') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG nova.objects.instance [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG nova.objects.base [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Object Instance<8cdb9561-3b40-44cc-abf7-2cbff7e60a17> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:57:46 user nova-compute[74611]:   <uuid>8cdb9561-3b40-44cc-abf7-2cbff7e60a17</uuid>
Nov 13 09:57:46 user nova-compute[74611]:   <name>instance-00000005</name>
Nov 13 09:57:46 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:57:46 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:57:46 user nova-compute[74611]:   <metadata>
Nov 13 09:57:46 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:57:46 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:57:46 user nova-compute[74611]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-610781</nova:name>
Nov 13 09:57:46 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:57:44</nova:creationTime>
Nov 13 09:57:46 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:57:46 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:57:46 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:57:46 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:57:46 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:57:46 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:57:46 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:57:46 user nova-compute[74611]:       <nova:owner>
Nov 13 09:57:46 user nova-compute[74611]:         <nova:user uuid="008616dff48b4bdeb2ea0f2be72a2934">tempest-AttachVolumeShelveTestJSON-55203260-project-member</nova:user>
Nov 13 09:57:46 user nova-compute[74611]:         <nova:project uuid="d5a6f570a7e7404680bd5809be8b0378">tempest-AttachVolumeShelveTestJSON-55203260</nova:project>
Nov 13 09:57:46 user nova-compute[74611]:       </nova:owner>
Nov 13 09:57:46 user nova-compute[74611]:       <nova:root type="image" uuid="688f36ff-2206-4352-bb90-d874d5e39c9d"/>
Nov 13 09:57:46 user nova-compute[74611]:       <nova:ports>
Nov 13 09:57:46 user nova-compute[74611]:         <nova:port uuid="e730080f-c599-449b-b366-a642be4f9ac7">
Nov 13 09:57:46 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 09:57:46 user nova-compute[74611]:         </nova:port>
Nov 13 09:57:46 user nova-compute[74611]:       </nova:ports>
Nov 13 09:57:46 user nova-compute[74611]:     </nova:instance>
Nov 13 09:57:46 user nova-compute[74611]:   </metadata>
Nov 13 09:57:46 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:57:46 user nova-compute[74611]:     <system>
Nov 13 09:57:46 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:57:46 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:57:46 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:57:46 user nova-compute[74611]:       <entry name="serial">8cdb9561-3b40-44cc-abf7-2cbff7e60a17</entry>
Nov 13 09:57:46 user nova-compute[74611]:       <entry name="uuid">8cdb9561-3b40-44cc-abf7-2cbff7e60a17</entry>
Nov 13 09:57:46 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:57:46 user nova-compute[74611]:     </system>
Nov 13 09:57:46 user nova-compute[74611]:   </sysinfo>
Nov 13 09:57:46 user nova-compute[74611]:   <os>
Nov 13 09:57:46 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:57:46 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:57:46 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:57:46 user nova-compute[74611]:   </os>
Nov 13 09:57:46 user nova-compute[74611]:   <features>
Nov 13 09:57:46 user nova-compute[74611]:     <acpi/>
Nov 13 09:57:46 user nova-compute[74611]:     <apic/>
Nov 13 09:57:46 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:57:46 user nova-compute[74611]:   </features>
Nov 13 09:57:46 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:57:46 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:57:46 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:57:46 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:57:46 user nova-compute[74611]:   </clock>
Nov 13 09:57:46 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:57:46 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:57:46 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:57:46 user nova-compute[74611]:   </cpu>
Nov 13 09:57:46 user nova-compute[74611]:   <devices>
Nov 13 09:57:46 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:57:46 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:57:46 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk"/>
Nov 13 09:57:46 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:57:46 user nova-compute[74611]:     </disk>
Nov 13 09:57:46 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 09:57:46 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:57:46 user nova-compute[74611]:       <source dev="/dev/sdb"/>
Nov 13 09:57:46 user nova-compute[74611]:       <target dev="vdc" bus="virtio"/>
Nov 13 09:57:46 user nova-compute[74611]:       <serial>119a6505-bb82-4b80-b5ed-d3f7e5f53963</serial>
Nov 13 09:57:46 user nova-compute[74611]:     </disk>
Nov 13 09:57:46 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:57:46 user nova-compute[74611]:       <mac address="fa:16:3e:c0:96:5e"/>
Nov 13 09:57:46 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:57:46 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:57:46 user nova-compute[74611]:       <target dev="tape730080f-c5"/>
Nov 13 09:57:46 user nova-compute[74611]:     </interface>
Nov 13 09:57:46 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:57:46 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/console.log" append="off"/>
Nov 13 09:57:46 user nova-compute[74611]:     </serial>
Nov 13 09:57:46 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:57:46 user nova-compute[74611]:     <video>
Nov 13 09:57:46 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:57:46 user nova-compute[74611]:     </video>
Nov 13 09:57:46 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:57:46 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:57:46 user nova-compute[74611]:     </rng>
Nov 13 09:57:46 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:57:46 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:57:46 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:57:46 user nova-compute[74611]:     </memballoon>
Nov 13 09:57:46 user nova-compute[74611]:   </devices>
Nov 13 09:57:46 user nova-compute[74611]: </domain>
Nov 13 09:57:46 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T09:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-610781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-610781',id=5,image_ref='688f36ff-2206-4352-bb90-d874d5e39c9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1489015223',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d5a6f570a7e7404680bd5809be8b0378',ramdisk_id='',reservation_id='r-yu0u8g36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-55203260',owner_user_name='tempest-AttachVolumeShelveTestJSON-55203260-project-member',shelved_at='2023-11-13T09:55:45.430928',shelved_host='user',shelved_image_id='688f36ff-2206-4352-bb90-d874d5e39c9d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:57:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008616dff48b4bdeb2ea0f2be72a2934',uuid=8cdb9561-3b40-44cc-abf7-2cbff7e60a17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converting VIF {"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:96:5e,bridge_name='br-int',has_traffic_filtering=True,id=e730080f-c599-449b-b366-a642be4f9ac7,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape730080f-c5') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG os_vif [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:96:5e,bridge_name='br-int',has_traffic_filtering=True,id=e730080f-c599-449b-b366-a642be4f9ac7,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape730080f-c5') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '449d04c7-7a10-501d-9d11-d021d57d17fd', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape730080f-c5, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape730080f-c5, col_values=(('qos', UUID('7cf1be04-45e9-411b-87a5-8e58d04efd9c')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape730080f-c5, col_values=(('external_ids', {'iface-id': 'e730080f-c599-449b-b366-a642be4f9ac7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:96:5e', 'vm-uuid': '8cdb9561-3b40-44cc-abf7-2cbff7e60a17'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:46 user nova-compute[74611]: INFO os_vif [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:96:5e,bridge_name='br-int',has_traffic_filtering=True,id=e730080f-c599-449b-b366-a642be4f9ac7,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape730080f-c5')
Nov 13 09:57:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:57:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] No VIF found with MAC fa:16:3e:c0:96:5e, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-a96fe107-b424-4d08-b620-af1832241121 req-ad8a798f-f3de-4234-a689-032126119f5f service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received event network-vif-deleted-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:50 user nova-compute[74611]: INFO nova.compute.manager [req-a96fe107-b424-4d08-b620-af1832241121 req-ad8a798f-f3de-4234-a689-032126119f5f service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Neutron deleted interface 28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a; detaching it from the instance and deleting it from the info cache
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.network.neutron [req-a96fe107-b424-4d08-b620-af1832241121 req-ad8a798f-f3de-4234-a689-032126119f5f service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received event network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] Acquiring lock "1958dc22-14f4-42ca-966d-f489e402e001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] No waiting events found dispatching network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:50 user nova-compute[74611]: WARNING nova.compute.manager [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received unexpected event network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a for instance with vm_state active and task_state deleting.
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received event network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] Acquiring lock "1958dc22-14f4-42ca-966d-f489e402e001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] No waiting events found dispatching network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:50 user nova-compute[74611]: WARNING nova.compute.manager [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received unexpected event network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a for instance with vm_state active and task_state deleting.
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received event network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] Acquiring lock "1958dc22-14f4-42ca-966d-f489e402e001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] No waiting events found dispatching network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:50 user nova-compute[74611]: WARNING nova.compute.manager [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received unexpected event network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a for instance with vm_state active and task_state deleting.
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received event network-vif-unplugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] Acquiring lock "1958dc22-14f4-42ca-966d-f489e402e001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] No waiting events found dispatching network-vif-unplugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received event network-vif-unplugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received event network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] Acquiring lock "1958dc22-14f4-42ca-966d-f489e402e001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] Lock "1958dc22-14f4-42ca-966d-f489e402e001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] No waiting events found dispatching network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:50 user nova-compute[74611]: WARNING nova.compute.manager [req-7b9add10-bd8d-4b92-a8bb-48003b19f3c6 req-58049678-947e-433b-a78a-1d85b2c4adf3 service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Received unexpected event network-vif-plugged-28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a for instance with vm_state active and task_state deleting.
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-b25576a4-e6cc-4479-acb9-cc46f99f4c48 req-8dd9a26b-21df-4493-b70c-5c50bcc5d6c3 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received event network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b25576a4-e6cc-4479-acb9-cc46f99f4c48 req-8dd9a26b-21df-4493-b70c-5c50bcc5d6c3 service nova] Acquiring lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b25576a4-e6cc-4479-acb9-cc46f99f4c48 req-8dd9a26b-21df-4493-b70c-5c50bcc5d6c3 service nova] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b25576a4-e6cc-4479-acb9-cc46f99f4c48 req-8dd9a26b-21df-4493-b70c-5c50bcc5d6c3 service nova] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-b25576a4-e6cc-4479-acb9-cc46f99f4c48 req-8dd9a26b-21df-4493-b70c-5c50bcc5d6c3 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] No waiting events found dispatching network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:50 user nova-compute[74611]: WARNING nova.compute.manager [req-b25576a4-e6cc-4479-acb9-cc46f99f4c48 req-8dd9a26b-21df-4493-b70c-5c50bcc5d6c3 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received unexpected event network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-a96fe107-b424-4d08-b620-af1832241121 req-ad8a798f-f3de-4234-a689-032126119f5f service nova] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Detach interface failed, port_id=28279eb1-ec2b-46b6-a5de-1bb6c2c1ed7a, reason: Instance 1958dc22-14f4-42ca-966d-f489e402e001 could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 09:57:50 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 1958dc22-14f4-42ca-966d-f489e402e001] Took 4.62 seconds to deallocate network for instance.
Nov 13 09:57:50 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:57:50 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=7781MB free_disk=25.48940658569336GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:50 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Instance spawned successfully.
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 85cb3adb-b2b3-49ec-92ab-c2b7a028241a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 1c66c8a8-abb5-4f60-8464-074627c213d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance fe53a1a8-de5b-4679-bddb-1da5204dbab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 89038547-5416-4942-8070-dd5dd8e4b6c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 1958dc22-14f4-42ca-966d-f489e402e001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4dca8fcf-5fed-4cd1-b8db-61f271b93d20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.manager [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-83772dee-1802-4b85-b153-b13daf923d9c tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.226s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:50 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:57:51 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:57:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 09:57:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.750s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.675s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:57:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:51 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:57:51 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:57:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.183s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:51 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:57:51 user nova-compute[74611]: INFO nova.compute.claims [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Claim successful on node user
Nov 13 09:57:51 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Deleted allocations for instance 1958dc22-14f4-42ca-966d-f489e402e001
Nov 13 09:57:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a3c35bfc-45ed-40a0-9476-82f5c10a1933 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "1958dc22-14f4-42ca-966d-f489e402e001" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.446s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG nova.network.neutron [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:57:52 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:57:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-65ccd32e-2f48-4570-9765-c955fe588610 req-6eff9da1-afad-4145-97ec-f7f4a94163e4 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received event network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-65ccd32e-2f48-4570-9765-c955fe588610 req-6eff9da1-afad-4145-97ec-f7f4a94163e4 service nova] Acquiring lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-65ccd32e-2f48-4570-9765-c955fe588610 req-6eff9da1-afad-4145-97ec-f7f4a94163e4 service nova] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-65ccd32e-2f48-4570-9765-c955fe588610 req-6eff9da1-afad-4145-97ec-f7f4a94163e4 service nova] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-65ccd32e-2f48-4570-9765-c955fe588610 req-6eff9da1-afad-4145-97ec-f7f4a94163e4 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] No waiting events found dispatching network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:52 user nova-compute[74611]: WARNING nova.compute.manager [req-65ccd32e-2f48-4570-9765-c955fe588610 req-6eff9da1-afad-4145-97ec-f7f4a94163e4 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received unexpected event network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 for instance with vm_state active and task_state None.
Nov 13 09:57:52 user nova-compute[74611]: DEBUG nova.policy [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0428809075cd41f0a6eb84c21e9abfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0d3282d547249997fdad18cefc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:57:52 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Creating image(s)
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "/opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "/opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "/opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.189s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.198s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk 1073741824" returned: 0 in 0.053s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG nova.network.neutron [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Successfully created port: 16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.224s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Cannot resize image /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Ensure instance console log exists: /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG nova.network.neutron [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Successfully updated port: 16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquired lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG nova.network.neutron [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG nova.compute.manager [req-0be919b6-e858-42e3-8627-9e7bea00ff2a req-7de7fb3d-78cf-43b2-9ea2-caaf6592fb05 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received event network-changed-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG nova.compute.manager [req-0be919b6-e858-42e3-8627-9e7bea00ff2a req-7de7fb3d-78cf-43b2-9ea2-caaf6592fb05 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Refreshing instance network info cache due to event network-changed-16c3fba0-6005-4fd4-a1b9-005df1f6771b. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0be919b6-e858-42e3-8627-9e7bea00ff2a req-7de7fb3d-78cf-43b2-9ea2-caaf6592fb05 service nova] Acquiring lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG nova.network.neutron [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:57:53 user nova-compute[74611]: DEBUG nova.network.neutron [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Updating instance_info_cache with network_info: [{"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Releasing lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Instance network_info: |[{"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0be919b6-e858-42e3-8627-9e7bea00ff2a req-7de7fb3d-78cf-43b2-9ea2-caaf6592fb05 service nova] Acquired lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.network.neutron [req-0be919b6-e858-42e3-8627-9e7bea00ff2a req-7de7fb3d-78cf-43b2-9ea2-caaf6592fb05 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Refreshing network info cache for port 16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Start _get_guest_xml network_info=[{"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:57:54 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:57:54 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1508598088',display_name='tempest-AttachVolumeTestJSON-server-1508598088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1508598088',id=18,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgN2fOxghmivj853mZ2ksKDLn8tdFXuOHZwAmmMU0voEMAFBi/R/0d3RmLKBvhLUKwr6VaNoAX27Qgtk/V6TuVskjG8QOa9sC9yhByta66dRmM6E1ACXtMK3U+5xSdm5g==',key_name='tempest-keypair-977132060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce3f0d3282d547249997fdad18cefc9c',ramdisk_id='',reservation_id='r-tmd58a9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-658018398',owner_user_name='tempest-AttachVolumeTestJSON-658018398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:57:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0428809075cd41f0a6eb84c21e9abfed',uuid=e99e1557-500f-407e-aefc-3b5cde9ceba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converting VIF {"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.objects.instance [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'pci_devices' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:57:54 user nova-compute[74611]:   <uuid>e99e1557-500f-407e-aefc-3b5cde9ceba0</uuid>
Nov 13 09:57:54 user nova-compute[74611]:   <name>instance-00000012</name>
Nov 13 09:57:54 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:57:54 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:57:54 user nova-compute[74611]:   <metadata>
Nov 13 09:57:54 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:57:54 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:57:54 user nova-compute[74611]:       <nova:name>tempest-AttachVolumeTestJSON-server-1508598088</nova:name>
Nov 13 09:57:54 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:57:54</nova:creationTime>
Nov 13 09:57:54 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:57:54 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:57:54 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:57:54 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:57:54 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:57:54 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:57:54 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:57:54 user nova-compute[74611]:       <nova:owner>
Nov 13 09:57:54 user nova-compute[74611]:         <nova:user uuid="0428809075cd41f0a6eb84c21e9abfed">tempest-AttachVolumeTestJSON-658018398-project-member</nova:user>
Nov 13 09:57:54 user nova-compute[74611]:         <nova:project uuid="ce3f0d3282d547249997fdad18cefc9c">tempest-AttachVolumeTestJSON-658018398</nova:project>
Nov 13 09:57:54 user nova-compute[74611]:       </nova:owner>
Nov 13 09:57:54 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:57:54 user nova-compute[74611]:       <nova:ports>
Nov 13 09:57:54 user nova-compute[74611]:         <nova:port uuid="16c3fba0-6005-4fd4-a1b9-005df1f6771b">
Nov 13 09:57:54 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 09:57:54 user nova-compute[74611]:         </nova:port>
Nov 13 09:57:54 user nova-compute[74611]:       </nova:ports>
Nov 13 09:57:54 user nova-compute[74611]:     </nova:instance>
Nov 13 09:57:54 user nova-compute[74611]:   </metadata>
Nov 13 09:57:54 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:57:54 user nova-compute[74611]:     <system>
Nov 13 09:57:54 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:57:54 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:57:54 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:57:54 user nova-compute[74611]:       <entry name="serial">e99e1557-500f-407e-aefc-3b5cde9ceba0</entry>
Nov 13 09:57:54 user nova-compute[74611]:       <entry name="uuid">e99e1557-500f-407e-aefc-3b5cde9ceba0</entry>
Nov 13 09:57:54 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:57:54 user nova-compute[74611]:     </system>
Nov 13 09:57:54 user nova-compute[74611]:   </sysinfo>
Nov 13 09:57:54 user nova-compute[74611]:   <os>
Nov 13 09:57:54 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:57:54 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:57:54 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:57:54 user nova-compute[74611]:   </os>
Nov 13 09:57:54 user nova-compute[74611]:   <features>
Nov 13 09:57:54 user nova-compute[74611]:     <acpi/>
Nov 13 09:57:54 user nova-compute[74611]:     <apic/>
Nov 13 09:57:54 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:57:54 user nova-compute[74611]:   </features>
Nov 13 09:57:54 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:57:54 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:57:54 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:57:54 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:57:54 user nova-compute[74611]:   </clock>
Nov 13 09:57:54 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:57:54 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:57:54 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:57:54 user nova-compute[74611]:   </cpu>
Nov 13 09:57:54 user nova-compute[74611]:   <devices>
Nov 13 09:57:54 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:57:54 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:57:54 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk"/>
Nov 13 09:57:54 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:57:54 user nova-compute[74611]:     </disk>
Nov 13 09:57:54 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:57:54 user nova-compute[74611]:       <mac address="fa:16:3e:e0:90:1a"/>
Nov 13 09:57:54 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:57:54 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:57:54 user nova-compute[74611]:       <target dev="tap16c3fba0-60"/>
Nov 13 09:57:54 user nova-compute[74611]:     </interface>
Nov 13 09:57:54 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:57:54 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/console.log" append="off"/>
Nov 13 09:57:54 user nova-compute[74611]:     </serial>
Nov 13 09:57:54 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:57:54 user nova-compute[74611]:     <video>
Nov 13 09:57:54 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:57:54 user nova-compute[74611]:     </video>
Nov 13 09:57:54 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:57:54 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:57:54 user nova-compute[74611]:     </rng>
Nov 13 09:57:54 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:57:54 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:57:54 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:57:54 user nova-compute[74611]:     </memballoon>
Nov 13 09:57:54 user nova-compute[74611]:   </devices>
Nov 13 09:57:54 user nova-compute[74611]: </domain>
Nov 13 09:57:54 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1508598088',display_name='tempest-AttachVolumeTestJSON-server-1508598088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1508598088',id=18,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgN2fOxghmivj853mZ2ksKDLn8tdFXuOHZwAmmMU0voEMAFBi/R/0d3RmLKBvhLUKwr6VaNoAX27Qgtk/V6TuVskjG8QOa9sC9yhByta66dRmM6E1ACXtMK3U+5xSdm5g==',key_name='tempest-keypair-977132060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce3f0d3282d547249997fdad18cefc9c',ramdisk_id='',reservation_id='r-tmd58a9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-658018398',owner_user_name='tempest-AttachVolumeTestJSON-658018398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:57:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0428809075cd41f0a6eb84c21e9abfed',uuid=e99e1557-500f-407e-aefc-3b5cde9ceba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converting VIF {"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG os_vif [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e82700cd-979d-5172-915f-24ee4909c24d', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16c3fba0-60, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16c3fba0-60, col_values=(('qos', UUID('816dfdcc-2564-4b05-b662-90d058304ac9')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16c3fba0-60, col_values=(('external_ids', {'iface-id': '16c3fba0-6005-4fd4-a1b9-005df1f6771b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:90:1a', 'vm-uuid': 'e99e1557-500f-407e-aefc-3b5cde9ceba0'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:54 user nova-compute[74611]: INFO os_vif [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60')
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] No VIF found with MAC fa:16:3e:e0:90:1a, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.network.neutron [req-0be919b6-e858-42e3-8627-9e7bea00ff2a req-7de7fb3d-78cf-43b2-9ea2-caaf6592fb05 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Updated VIF entry in instance network info cache for port 16c3fba0-6005-4fd4-a1b9-005df1f6771b. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG nova.network.neutron [req-0be919b6-e858-42e3-8627-9e7bea00ff2a req-7de7fb3d-78cf-43b2-9ea2-caaf6592fb05 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Updating instance_info_cache with network_info: [{"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0be919b6-e858-42e3-8627-9e7bea00ff2a req-7de7fb3d-78cf-43b2-9ea2-caaf6592fb05 service nova] Releasing lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG nova.compute.manager [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:57:55 user nova-compute[74611]: INFO nova.compute.claims [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Claim successful on node user
Nov 13 09:57:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG nova.compute.manager [req-672aea68-654b-4e82-bb96-356f415683ac req-d2000bca-7e36-493a-add0-9b90e7225d87 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-672aea68-654b-4e82-bb96-356f415683ac req-d2000bca-7e36-493a-add0-9b90e7225d87 service nova] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-672aea68-654b-4e82-bb96-356f415683ac req-d2000bca-7e36-493a-add0-9b90e7225d87 service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-672aea68-654b-4e82-bb96-356f415683ac req-d2000bca-7e36-493a-add0-9b90e7225d87 service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG nova.compute.manager [req-672aea68-654b-4e82-bb96-356f415683ac req-d2000bca-7e36-493a-add0-9b90e7225d87 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] No waiting events found dispatching network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:55 user nova-compute[74611]: WARNING nova.compute.manager [req-672aea68-654b-4e82-bb96-356f415683ac req-d2000bca-7e36-493a-add0-9b90e7225d87 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received unexpected event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b for instance with vm_state building and task_state spawning.
Nov 13 09:57:55 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.613s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG nova.compute.manager [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG nova.compute.manager [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:57:55 user nova-compute[74611]: DEBUG nova.network.neutron [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:57:56 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:57:56 user nova-compute[74611]: DEBUG nova.compute.manager [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG nova.policy [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3227fb32ab644865880e5354d1306941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca1b2857119419e8d4cd65f6d77d9ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG nova.compute.manager [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:57:56 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Creating image(s)
Nov 13 09:57:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "/opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "/opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "/opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.200s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk 1073741824" returned: 0 in 0.061s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG nova.network.neutron [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Successfully created port: c33be124-9528-4fb1-8fbe-9fc2d55395b8 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.167s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:57:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Cannot resize image /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Ensure instance console log exists: /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.network.neutron [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Successfully updated port: c33be124-9528-4fb1-8fbe-9fc2d55395b8 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "refresh_cache-4970bd6b-69a6-479c-9f5f-bc5fc6021407" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquired lock "refresh_cache-4970bd6b-69a6-479c-9f5f-bc5fc6021407" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.network.neutron [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.compute.manager [req-2bc82e32-8a96-47ce-b815-8134f35441cd req-25421a21-1d8c-451e-ac02-b08eb25d90c3 service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Received event network-changed-c33be124-9528-4fb1-8fbe-9fc2d55395b8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.compute.manager [req-2bc82e32-8a96-47ce-b815-8134f35441cd req-25421a21-1d8c-451e-ac02-b08eb25d90c3 service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Refreshing instance network info cache due to event network-changed-c33be124-9528-4fb1-8fbe-9fc2d55395b8. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2bc82e32-8a96-47ce-b815-8134f35441cd req-25421a21-1d8c-451e-ac02-b08eb25d90c3 service nova] Acquiring lock "refresh_cache-4970bd6b-69a6-479c-9f5f-bc5fc6021407" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.network.neutron [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.compute.manager [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:57:57 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Instance spawned successfully.
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.compute.manager [req-6a9030c4-a35e-46f2-b9cd-cfa8d5b1c5d4 req-0b0804e8-3c09-45b3-8439-c3e0daf82ea1 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6a9030c4-a35e-46f2-b9cd-cfa8d5b1c5d4 req-0b0804e8-3c09-45b3-8439-c3e0daf82ea1 service nova] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6a9030c4-a35e-46f2-b9cd-cfa8d5b1c5d4 req-0b0804e8-3c09-45b3-8439-c3e0daf82ea1 service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6a9030c4-a35e-46f2-b9cd-cfa8d5b1c5d4 req-0b0804e8-3c09-45b3-8439-c3e0daf82ea1 service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.compute.manager [req-6a9030c4-a35e-46f2-b9cd-cfa8d5b1c5d4 req-0b0804e8-3c09-45b3-8439-c3e0daf82ea1 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] No waiting events found dispatching network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:57:57 user nova-compute[74611]: WARNING nova.compute.manager [req-6a9030c4-a35e-46f2-b9cd-cfa8d5b1c5d4 req-0b0804e8-3c09-45b3-8439-c3e0daf82ea1 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received unexpected event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b for instance with vm_state building and task_state spawning.
Nov 13 09:57:57 user nova-compute[74611]: INFO nova.compute.manager [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 13 09:57:57 user nova-compute[74611]: DEBUG nova.compute.manager [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:57:57 user nova-compute[74611]: INFO nova.compute.manager [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Took 6.58 seconds to build instance.
Nov 13 09:57:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d6dec3e9-6bf4-412d-994e-fa7562dfe620 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.689s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.network.neutron [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Updating instance_info_cache with network_info: [{"id": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "address": "fa:16:3e:29:ae:2e", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33be124-95", "ovs_interfaceid": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Releasing lock "refresh_cache-4970bd6b-69a6-479c-9f5f-bc5fc6021407" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.compute.manager [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Instance network_info: |[{"id": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "address": "fa:16:3e:29:ae:2e", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33be124-95", "ovs_interfaceid": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2bc82e32-8a96-47ce-b815-8134f35441cd req-25421a21-1d8c-451e-ac02-b08eb25d90c3 service nova] Acquired lock "refresh_cache-4970bd6b-69a6-479c-9f5f-bc5fc6021407" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.network.neutron [req-2bc82e32-8a96-47ce-b815-8134f35441cd req-25421a21-1d8c-451e-ac02-b08eb25d90c3 service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Refreshing network info cache for port c33be124-9528-4fb1-8fbe-9fc2d55395b8 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Start _get_guest_xml network_info=[{"id": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "address": "fa:16:3e:29:ae:2e", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33be124-95", "ovs_interfaceid": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:57:58 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:57:58 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1064435824',display_name='tempest-VolumesAdminNegativeTest-server-1064435824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1064435824',id=19,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERbTG75IHOHsbkK8+ChCk3hnM5YeJ4mAge3LhNvqiP5N4F0Yom72WbhHksKeP+/lM+Ukru81fapV4keR2CmUiUewqe2hZCEgMrEcgj/8zjvCJCQzpyJtPULGpGauMkehg==',key_name='tempest-keypair-279808170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ca1b2857119419e8d4cd65f6d77d9ba',ramdisk_id='',reservation_id='r-x110vuf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1382146762',owner_user_name='tempest-VolumesAdminNegativeTest-1382146762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:57:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3227fb32ab644865880e5354d1306941',uuid=4970bd6b-69a6-479c-9f5f-bc5fc6021407,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "address": "fa:16:3e:29:ae:2e", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33be124-95", "ovs_interfaceid": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Converting VIF {"id": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "address": "fa:16:3e:29:ae:2e", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33be124-95", "ovs_interfaceid": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:ae:2e,bridge_name='br-int',has_traffic_filtering=True,id=c33be124-9528-4fb1-8fbe-9fc2d55395b8,network=Network(ca1cd594-c2c0-41e4-92dc-f828ce2b5423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33be124-95') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.objects.instance [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lazy-loading 'pci_devices' on Instance uuid 4970bd6b-69a6-479c-9f5f-bc5fc6021407 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:57:58 user nova-compute[74611]:   <uuid>4970bd6b-69a6-479c-9f5f-bc5fc6021407</uuid>
Nov 13 09:57:58 user nova-compute[74611]:   <name>instance-00000013</name>
Nov 13 09:57:58 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:57:58 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:57:58 user nova-compute[74611]:   <metadata>
Nov 13 09:57:58 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:57:58 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:57:58 user nova-compute[74611]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1064435824</nova:name>
Nov 13 09:57:58 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:57:58</nova:creationTime>
Nov 13 09:57:58 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:57:58 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:57:58 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:57:58 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:57:58 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:57:58 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:57:58 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:57:58 user nova-compute[74611]:       <nova:owner>
Nov 13 09:57:58 user nova-compute[74611]:         <nova:user uuid="3227fb32ab644865880e5354d1306941">tempest-VolumesAdminNegativeTest-1382146762-project-member</nova:user>
Nov 13 09:57:58 user nova-compute[74611]:         <nova:project uuid="0ca1b2857119419e8d4cd65f6d77d9ba">tempest-VolumesAdminNegativeTest-1382146762</nova:project>
Nov 13 09:57:58 user nova-compute[74611]:       </nova:owner>
Nov 13 09:57:58 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:57:58 user nova-compute[74611]:       <nova:ports>
Nov 13 09:57:58 user nova-compute[74611]:         <nova:port uuid="c33be124-9528-4fb1-8fbe-9fc2d55395b8">
Nov 13 09:57:58 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 09:57:58 user nova-compute[74611]:         </nova:port>
Nov 13 09:57:58 user nova-compute[74611]:       </nova:ports>
Nov 13 09:57:58 user nova-compute[74611]:     </nova:instance>
Nov 13 09:57:58 user nova-compute[74611]:   </metadata>
Nov 13 09:57:58 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:57:58 user nova-compute[74611]:     <system>
Nov 13 09:57:58 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:57:58 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:57:58 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:57:58 user nova-compute[74611]:       <entry name="serial">4970bd6b-69a6-479c-9f5f-bc5fc6021407</entry>
Nov 13 09:57:58 user nova-compute[74611]:       <entry name="uuid">4970bd6b-69a6-479c-9f5f-bc5fc6021407</entry>
Nov 13 09:57:58 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:57:58 user nova-compute[74611]:     </system>
Nov 13 09:57:58 user nova-compute[74611]:   </sysinfo>
Nov 13 09:57:58 user nova-compute[74611]:   <os>
Nov 13 09:57:58 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:57:58 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:57:58 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:57:58 user nova-compute[74611]:   </os>
Nov 13 09:57:58 user nova-compute[74611]:   <features>
Nov 13 09:57:58 user nova-compute[74611]:     <acpi/>
Nov 13 09:57:58 user nova-compute[74611]:     <apic/>
Nov 13 09:57:58 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:57:58 user nova-compute[74611]:   </features>
Nov 13 09:57:58 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:57:58 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:57:58 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:57:58 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:57:58 user nova-compute[74611]:   </clock>
Nov 13 09:57:58 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:57:58 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:57:58 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:57:58 user nova-compute[74611]:   </cpu>
Nov 13 09:57:58 user nova-compute[74611]:   <devices>
Nov 13 09:57:58 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:57:58 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:57:58 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk"/>
Nov 13 09:57:58 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:57:58 user nova-compute[74611]:     </disk>
Nov 13 09:57:58 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:57:58 user nova-compute[74611]:       <mac address="fa:16:3e:29:ae:2e"/>
Nov 13 09:57:58 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:57:58 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:57:58 user nova-compute[74611]:       <target dev="tapc33be124-95"/>
Nov 13 09:57:58 user nova-compute[74611]:     </interface>
Nov 13 09:57:58 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:57:58 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/console.log" append="off"/>
Nov 13 09:57:58 user nova-compute[74611]:     </serial>
Nov 13 09:57:58 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:57:58 user nova-compute[74611]:     <video>
Nov 13 09:57:58 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:57:58 user nova-compute[74611]:     </video>
Nov 13 09:57:58 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:57:58 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:57:58 user nova-compute[74611]:     </rng>
Nov 13 09:57:58 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:57:58 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:57:58 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:57:58 user nova-compute[74611]:     </memballoon>
Nov 13 09:57:58 user nova-compute[74611]:   </devices>
Nov 13 09:57:58 user nova-compute[74611]: </domain>
Nov 13 09:57:58 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1064435824',display_name='tempest-VolumesAdminNegativeTest-server-1064435824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1064435824',id=19,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERbTG75IHOHsbkK8+ChCk3hnM5YeJ4mAge3LhNvqiP5N4F0Yom72WbhHksKeP+/lM+Ukru81fapV4keR2CmUiUewqe2hZCEgMrEcgj/8zjvCJCQzpyJtPULGpGauMkehg==',key_name='tempest-keypair-279808170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ca1b2857119419e8d4cd65f6d77d9ba',ramdisk_id='',reservation_id='r-x110vuf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1382146762',owner_user_name='tempest-VolumesAdminNegativeTest-1382146762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:57:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3227fb32ab644865880e5354d1306941',uuid=4970bd6b-69a6-479c-9f5f-bc5fc6021407,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "address": "fa:16:3e:29:ae:2e", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33be124-95", "ovs_interfaceid": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Converting VIF {"id": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "address": "fa:16:3e:29:ae:2e", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33be124-95", "ovs_interfaceid": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:ae:2e,bridge_name='br-int',has_traffic_filtering=True,id=c33be124-9528-4fb1-8fbe-9fc2d55395b8,network=Network(ca1cd594-c2c0-41e4-92dc-f828ce2b5423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33be124-95') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG os_vif [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:ae:2e,bridge_name='br-int',has_traffic_filtering=True,id=c33be124-9528-4fb1-8fbe-9fc2d55395b8,network=Network(ca1cd594-c2c0-41e4-92dc-f828ce2b5423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33be124-95') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47bd830e-f5de-5c7f-bf77-6a2688e9e9a0', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc33be124-95, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc33be124-95, col_values=(('qos', UUID('ec12e01a-da46-4ad6-a87a-c223851c8ffa')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc33be124-95, col_values=(('external_ids', {'iface-id': 'c33be124-9528-4fb1-8fbe-9fc2d55395b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:ae:2e', 'vm-uuid': '4970bd6b-69a6-479c-9f5f-bc5fc6021407'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:58 user nova-compute[74611]: INFO os_vif [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:ae:2e,bridge_name='br-int',has_traffic_filtering=True,id=c33be124-9528-4fb1-8fbe-9fc2d55395b8,network=Network(ca1cd594-c2c0-41e4-92dc-f828ce2b5423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33be124-95')
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] No VIF found with MAC fa:16:3e:29:ae:2e, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.network.neutron [req-2bc82e32-8a96-47ce-b815-8134f35441cd req-25421a21-1d8c-451e-ac02-b08eb25d90c3 service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Updated VIF entry in instance network info cache for port c33be124-9528-4fb1-8fbe-9fc2d55395b8. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG nova.network.neutron [req-2bc82e32-8a96-47ce-b815-8134f35441cd req-25421a21-1d8c-451e-ac02-b08eb25d90c3 service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Updating instance_info_cache with network_info: [{"id": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "address": "fa:16:3e:29:ae:2e", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33be124-95", "ovs_interfaceid": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2bc82e32-8a96-47ce-b815-8134f35441cd req-25421a21-1d8c-451e-ac02-b08eb25d90c3 service nova] Releasing lock "refresh_cache-4970bd6b-69a6-479c-9f5f-bc5fc6021407" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:57:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:57:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:00 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:00 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:00 user nova-compute[74611]: DEBUG nova.compute.manager [req-3d3ea446-3d9a-4a1f-b169-f91f46a4d035 req-6a3a36de-7eed-4563-b099-f3a39f6b3f78 service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Received event network-vif-plugged-c33be124-9528-4fb1-8fbe-9fc2d55395b8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3d3ea446-3d9a-4a1f-b169-f91f46a4d035 req-6a3a36de-7eed-4563-b099-f3a39f6b3f78 service nova] Acquiring lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3d3ea446-3d9a-4a1f-b169-f91f46a4d035 req-6a3a36de-7eed-4563-b099-f3a39f6b3f78 service nova] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3d3ea446-3d9a-4a1f-b169-f91f46a4d035 req-6a3a36de-7eed-4563-b099-f3a39f6b3f78 service nova] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:00 user nova-compute[74611]: DEBUG nova.compute.manager [req-3d3ea446-3d9a-4a1f-b169-f91f46a4d035 req-6a3a36de-7eed-4563-b099-f3a39f6b3f78 service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] No waiting events found dispatching network-vif-plugged-c33be124-9528-4fb1-8fbe-9fc2d55395b8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:00 user nova-compute[74611]: WARNING nova.compute.manager [req-3d3ea446-3d9a-4a1f-b169-f91f46a4d035 req-6a3a36de-7eed-4563-b099-f3a39f6b3f78 service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Received unexpected event network-vif-plugged-c33be124-9528-4fb1-8fbe-9fc2d55395b8 for instance with vm_state building and task_state spawning.
Nov 13 09:58:01 user nova-compute[74611]: DEBUG nova.compute.manager [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:58:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:58:01 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Instance spawned successfully.
Nov 13 09:58:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:58:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:02 user nova-compute[74611]: INFO nova.compute.manager [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Took 5.84 seconds to spawn the instance on the hypervisor.
Nov 13 09:58:02 user nova-compute[74611]: DEBUG nova.compute.manager [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:58:02 user nova-compute[74611]: INFO nova.compute.manager [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Took 6.90 seconds to build instance.
Nov 13 09:58:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-950dd237-bdaa-4ae2-90f5-6d40ee7fc05f tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.030s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-a04bac1f-e3da-4622-ab1e-8877799093f6 req-0a22506e-32ac-4bcf-9d5a-03ebc536e25a service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Received event network-vif-plugged-c33be124-9528-4fb1-8fbe-9fc2d55395b8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a04bac1f-e3da-4622-ab1e-8877799093f6 req-0a22506e-32ac-4bcf-9d5a-03ebc536e25a service nova] Acquiring lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a04bac1f-e3da-4622-ab1e-8877799093f6 req-0a22506e-32ac-4bcf-9d5a-03ebc536e25a service nova] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a04bac1f-e3da-4622-ab1e-8877799093f6 req-0a22506e-32ac-4bcf-9d5a-03ebc536e25a service nova] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-a04bac1f-e3da-4622-ab1e-8877799093f6 req-0a22506e-32ac-4bcf-9d5a-03ebc536e25a service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] No waiting events found dispatching network-vif-plugged-c33be124-9528-4fb1-8fbe-9fc2d55395b8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:02 user nova-compute[74611]: WARNING nova.compute.manager [req-a04bac1f-e3da-4622-ab1e-8877799093f6 req-0a22506e-32ac-4bcf-9d5a-03ebc536e25a service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Received unexpected event network-vif-plugged-c33be124-9528-4fb1-8fbe-9fc2d55395b8 for instance with vm_state active and task_state None.
Nov 13 09:58:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:11 user nova-compute[74611]: DEBUG nova.compute.manager [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:58:11 user nova-compute[74611]: INFO nova.compute.manager [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] instance snapshotting
Nov 13 09:58:12 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Beginning live snapshot process
Nov 13 09:58:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json -f qcow2 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json -f qcow2 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json -f qcow2" returned: 0 in 0.243s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpahv7beak/72d946efc4194706864e4b941564f7eb.delta 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpahv7beak/72d946efc4194706864e4b941564f7eb.delta 1073741824" returned: 0 in 0.070s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:12 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 09:58:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:58:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 09:58:14 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 09:58:14 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 09:58:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpahv7beak/72d946efc4194706864e4b941564f7eb.delta /opt/stack/data/nova/instances/snapshots/tmpahv7beak/72d946efc4194706864e4b941564f7eb {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpahv7beak/72d946efc4194706864e4b941564f7eb.delta /opt/stack/data/nova/instances/snapshots/tmpahv7beak/72d946efc4194706864e4b941564f7eb" returned: 0 in 0.319s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:14 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Snapshot extracted, beginning image upload
Nov 13 09:58:17 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Snapshot image upload complete
Nov 13 09:58:17 user nova-compute[74611]: INFO nova.compute.manager [None req-1ab4e420-4fb8-4b32-8696-8097edde0920 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Took 5.75 seconds to snapshot the instance on the hypervisor.
Nov 13 09:58:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "b1913235-682f-486a-8b35-f917c3664eec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "b1913235-682f-486a-8b35-f917c3664eec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:20 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:58:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:20 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:58:20 user nova-compute[74611]: INFO nova.compute.claims [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Claim successful on node user
Nov 13 09:58:20 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:58:20 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:58:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:20 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:58:20 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:58:20 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:58:20 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:58:20 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:58:20 user nova-compute[74611]: DEBUG nova.policy [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43cba8f20865492e8f1c169e2b2b706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff71e8694b6414d9df6bc665eb0a9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:58:21 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:58:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:58:21 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Creating image(s)
Nov 13 09:58:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "/opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "/opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "7d46eeeb2175a8865dd9c8bd9424e94d123922e4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "7d46eeeb2175a8865dd9c8bd9424e94d123922e4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4.part --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:22 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Successfully created port: c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:58:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4.part --force-share --output=json" returned: 0 in 0.214s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:23 user nova-compute[74611]: DEBUG nova.virt.images [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] 6f2d558b-5f8a-4846-aed9-98fd66fd83ca was qcow2, converting to raw {{(pid=74611) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 09:58:23 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 09:58:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4.part /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4.converted {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4.part /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4.converted" returned: 0 in 0.802s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4.converted --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Successfully updated port: c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "refresh_cache-b1913235-682f-486a-8b35-f917c3664eec" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquired lock "refresh_cache-b1913235-682f-486a-8b35-f917c3664eec" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.compute.manager [req-bb762e2c-0a3f-41eb-8176-379796bf882c req-57d2ac77-f8c6-4e19-b91b-5cb8dce7b69a service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Received event network-changed-c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.compute.manager [req-bb762e2c-0a3f-41eb-8176-379796bf882c req-57d2ac77-f8c6-4e19-b91b-5cb8dce7b69a service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Refreshing instance network info cache due to event network-changed-c2603a51-b07e-4040-b759-d8748ebd5fdc. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bb762e2c-0a3f-41eb-8176-379796bf882c req-57d2ac77-f8c6-4e19-b91b-5cb8dce7b69a service nova] Acquiring lock "refresh_cache-b1913235-682f-486a-8b35-f917c3664eec" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "7d46eeeb2175a8865dd9c8bd9424e94d123922e4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.055s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:58:24 user nova-compute[74611]: INFO nova.compute.manager [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Rescuing
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquired lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.network.neutron [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4 --force-share --output=json" returned: 0 in 0.194s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "7d46eeeb2175a8865dd9c8bd9424e94d123922e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "7d46eeeb2175a8865dd9c8bd9424e94d123922e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4 --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4,backing_fmt=raw /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4,backing_fmt=raw /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk 1073741824" returned: 0 in 0.055s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "7d46eeeb2175a8865dd9c8bd9424e94d123922e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Updating instance_info_cache with network_info: [{"id": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "address": "fa:16:3e:14:c0:79", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2603a51-b0", "ovs_interfaceid": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Releasing lock "refresh_cache-b1913235-682f-486a-8b35-f917c3664eec" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Instance network_info: |[{"id": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "address": "fa:16:3e:14:c0:79", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2603a51-b0", "ovs_interfaceid": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bb762e2c-0a3f-41eb-8176-379796bf882c req-57d2ac77-f8c6-4e19-b91b-5cb8dce7b69a service nova] Acquired lock "refresh_cache-b1913235-682f-486a-8b35-f917c3664eec" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.network.neutron [req-bb762e2c-0a3f-41eb-8176-379796bf882c req-57d2ac77-f8c6-4e19-b91b-5cb8dce7b69a service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Refreshing network info cache for port c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4 --force-share --output=json" returned: 0 in 0.193s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Ensure instance console log exists: /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Start _get_guest_xml network_info=[{"id": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "address": "fa:16:3e:14:c0:79", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2603a51-b0", "ovs_interfaceid": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d91f680363dfb08c73d3f43cd3d3a069',container_format='bare',created_at=2023-11-13T09:58:12Z,direct_url=<?>,disk_format='qcow2',id=6f2d558b-5f8a-4846-aed9-98fd66fd83ca,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1912215369',owner='3ff71e8694b6414d9df6bc665eb0a9b9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-13T09:58:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '6f2d558b-5f8a-4846-aed9-98fd66fd83ca'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:58:24 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:58:24 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d91f680363dfb08c73d3f43cd3d3a069',container_format='bare',created_at=2023-11-13T09:58:12Z,direct_url=<?>,disk_format='qcow2',id=6f2d558b-5f8a-4846-aed9-98fd66fd83ca,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1912215369',owner='3ff71e8694b6414d9df6bc665eb0a9b9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-13T09:58:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1541398196',display_name='tempest-TestStampPattern-server-1541398196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1541398196',id=20,image_ref='6f2d558b-5f8a-4846-aed9-98fd66fd83ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7yEcTGCYgYQQ15n06GslTPAn66P3BsID6l5qVrR50yqGTIakIpEEZW+YrSNkhKYZHWTi4IFmCBW3J1HXYI+Mzp3JImjkhJzXOkCMzv7+aS8nhc5OnaYd9h98IBbTgI6g==',key_name='tempest-TestStampPattern-296911042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ff71e8694b6414d9df6bc665eb0a9b9',ramdisk_id='',reservation_id='r-1sf2eqes',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='89038547-5416-4942-8070-dd5dd8e4b6c2',image_min_disk='1',image_min_ram='0',image_owner_id='3ff71e8694b6414d9df6bc665eb0a9b9',image_owner_project_name='tempest-TestStampPattern-833358871',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-833358871-project-member',image_user_id='43cba8f20865492e8f1c169e2b2b706c',network_allocated='True',owner_project_name='tempest-TestStampPattern-833358871',owner_user_name='tempest-TestStampPattern-833358871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:58:21Z,user_data=None,user_id='43cba8f20865492e8f1c169e2b2b706c',uuid=b1913235-682f-486a-8b35-f917c3664eec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "address": "fa:16:3e:14:c0:79", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2603a51-b0", "ovs_interfaceid": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Converting VIF {"id": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "address": "fa:16:3e:14:c0:79", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2603a51-b0", "ovs_interfaceid": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:c0:79,bridge_name='br-int',has_traffic_filtering=True,id=c2603a51-b07e-4040-b759-d8748ebd5fdc,network=Network(b8196669-7bef-4c06-b6bb-a32fabaec23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2603a51-b0') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.objects.instance [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lazy-loading 'pci_devices' on Instance uuid b1913235-682f-486a-8b35-f917c3664eec {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:58:24 user nova-compute[74611]:   <uuid>b1913235-682f-486a-8b35-f917c3664eec</uuid>
Nov 13 09:58:24 user nova-compute[74611]:   <name>instance-00000014</name>
Nov 13 09:58:24 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:58:24 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:58:24 user nova-compute[74611]:   <metadata>
Nov 13 09:58:24 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:58:24 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:58:24 user nova-compute[74611]:       <nova:name>tempest-TestStampPattern-server-1541398196</nova:name>
Nov 13 09:58:24 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:58:24</nova:creationTime>
Nov 13 09:58:24 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:58:24 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:58:24 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:58:24 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:58:24 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:58:24 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:58:24 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:58:24 user nova-compute[74611]:       <nova:owner>
Nov 13 09:58:24 user nova-compute[74611]:         <nova:user uuid="43cba8f20865492e8f1c169e2b2b706c">tempest-TestStampPattern-833358871-project-member</nova:user>
Nov 13 09:58:24 user nova-compute[74611]:         <nova:project uuid="3ff71e8694b6414d9df6bc665eb0a9b9">tempest-TestStampPattern-833358871</nova:project>
Nov 13 09:58:24 user nova-compute[74611]:       </nova:owner>
Nov 13 09:58:24 user nova-compute[74611]:       <nova:root type="image" uuid="6f2d558b-5f8a-4846-aed9-98fd66fd83ca"/>
Nov 13 09:58:24 user nova-compute[74611]:       <nova:ports>
Nov 13 09:58:24 user nova-compute[74611]:         <nova:port uuid="c2603a51-b07e-4040-b759-d8748ebd5fdc">
Nov 13 09:58:24 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 09:58:24 user nova-compute[74611]:         </nova:port>
Nov 13 09:58:24 user nova-compute[74611]:       </nova:ports>
Nov 13 09:58:24 user nova-compute[74611]:     </nova:instance>
Nov 13 09:58:24 user nova-compute[74611]:   </metadata>
Nov 13 09:58:24 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:58:24 user nova-compute[74611]:     <system>
Nov 13 09:58:24 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:58:24 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:58:24 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:58:24 user nova-compute[74611]:       <entry name="serial">b1913235-682f-486a-8b35-f917c3664eec</entry>
Nov 13 09:58:24 user nova-compute[74611]:       <entry name="uuid">b1913235-682f-486a-8b35-f917c3664eec</entry>
Nov 13 09:58:24 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:58:24 user nova-compute[74611]:     </system>
Nov 13 09:58:24 user nova-compute[74611]:   </sysinfo>
Nov 13 09:58:24 user nova-compute[74611]:   <os>
Nov 13 09:58:24 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:58:24 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:58:24 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:58:24 user nova-compute[74611]:   </os>
Nov 13 09:58:24 user nova-compute[74611]:   <features>
Nov 13 09:58:24 user nova-compute[74611]:     <acpi/>
Nov 13 09:58:24 user nova-compute[74611]:     <apic/>
Nov 13 09:58:24 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:58:24 user nova-compute[74611]:   </features>
Nov 13 09:58:24 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:58:24 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:58:24 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:58:24 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:58:24 user nova-compute[74611]:   </clock>
Nov 13 09:58:24 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:58:24 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:58:24 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:58:24 user nova-compute[74611]:   </cpu>
Nov 13 09:58:24 user nova-compute[74611]:   <devices>
Nov 13 09:58:24 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:58:24 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:58:24 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk"/>
Nov 13 09:58:24 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:58:24 user nova-compute[74611]:     </disk>
Nov 13 09:58:24 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:58:24 user nova-compute[74611]:       <mac address="fa:16:3e:14:c0:79"/>
Nov 13 09:58:24 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:58:24 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:58:24 user nova-compute[74611]:       <target dev="tapc2603a51-b0"/>
Nov 13 09:58:24 user nova-compute[74611]:     </interface>
Nov 13 09:58:24 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:58:24 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/console.log" append="off"/>
Nov 13 09:58:24 user nova-compute[74611]:     </serial>
Nov 13 09:58:24 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:58:24 user nova-compute[74611]:     <video>
Nov 13 09:58:24 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:58:24 user nova-compute[74611]:     </video>
Nov 13 09:58:24 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:58:24 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:58:24 user nova-compute[74611]:     </rng>
Nov 13 09:58:24 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:58:24 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:58:24 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:58:24 user nova-compute[74611]:     </memballoon>
Nov 13 09:58:24 user nova-compute[74611]:   </devices>
Nov 13 09:58:24 user nova-compute[74611]: </domain>
Nov 13 09:58:24 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1541398196',display_name='tempest-TestStampPattern-server-1541398196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1541398196',id=20,image_ref='6f2d558b-5f8a-4846-aed9-98fd66fd83ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7yEcTGCYgYQQ15n06GslTPAn66P3BsID6l5qVrR50yqGTIakIpEEZW+YrSNkhKYZHWTi4IFmCBW3J1HXYI+Mzp3JImjkhJzXOkCMzv7+aS8nhc5OnaYd9h98IBbTgI6g==',key_name='tempest-TestStampPattern-296911042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ff71e8694b6414d9df6bc665eb0a9b9',ramdisk_id='',reservation_id='r-1sf2eqes',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='89038547-5416-4942-8070-dd5dd8e4b6c2',image_min_disk='1',image_min_ram='0',image_owner_id='3ff71e8694b6414d9df6bc665eb0a9b9',image_owner_project_name='tempest-TestStampPattern-833358871',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-833358871-project-member',image_user_id='43cba8f20865492e8f1c169e2b2b706c',network_allocated='True',owner_project_name='tempest-TestStampPattern-833358871',owner_user_name='tempest-TestStampPattern-833358871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:58:21Z,user_data=None,user_id='43cba8f20865492e8f1c169e2b2b706c',uuid=b1913235-682f-486a-8b35-f917c3664eec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "address": "fa:16:3e:14:c0:79", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2603a51-b0", "ovs_interfaceid": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Converting VIF {"id": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "address": "fa:16:3e:14:c0:79", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2603a51-b0", "ovs_interfaceid": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:c0:79,bridge_name='br-int',has_traffic_filtering=True,id=c2603a51-b07e-4040-b759-d8748ebd5fdc,network=Network(b8196669-7bef-4c06-b6bb-a32fabaec23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2603a51-b0') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG os_vif [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:c0:79,bridge_name='br-int',has_traffic_filtering=True,id=c2603a51-b07e-4040-b759-d8748ebd5fdc,network=Network(b8196669-7bef-4c06-b6bb-a32fabaec23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2603a51-b0') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '926cee66-8c0f-55e3-8372-8a809df16d6a', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2603a51-b0, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2603a51-b0, col_values=(('qos', UUID('4dd5eb59-c33f-42fc-bb59-b347fbaeb59a')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2603a51-b0, col_values=(('external_ids', {'iface-id': 'c2603a51-b07e-4040-b759-d8748ebd5fdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:c0:79', 'vm-uuid': 'b1913235-682f-486a-8b35-f917c3664eec'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:24 user nova-compute[74611]: INFO os_vif [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:c0:79,bridge_name='br-int',has_traffic_filtering=True,id=c2603a51-b07e-4040-b759-d8748ebd5fdc,network=Network(b8196669-7bef-4c06-b6bb-a32fabaec23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2603a51-b0')
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:58:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] No VIF found with MAC fa:16:3e:14:c0:79, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:58:25 user nova-compute[74611]: DEBUG nova.network.neutron [req-bb762e2c-0a3f-41eb-8176-379796bf882c req-57d2ac77-f8c6-4e19-b91b-5cb8dce7b69a service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Updated VIF entry in instance network info cache for port c2603a51-b07e-4040-b759-d8748ebd5fdc. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:58:25 user nova-compute[74611]: DEBUG nova.network.neutron [req-bb762e2c-0a3f-41eb-8176-379796bf882c req-57d2ac77-f8c6-4e19-b91b-5cb8dce7b69a service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Updating instance_info_cache with network_info: [{"id": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "address": "fa:16:3e:14:c0:79", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2603a51-b0", "ovs_interfaceid": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:58:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bb762e2c-0a3f-41eb-8176-379796bf882c req-57d2ac77-f8c6-4e19-b91b-5cb8dce7b69a service nova] Releasing lock "refresh_cache-b1913235-682f-486a-8b35-f917c3664eec" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:58:25 user nova-compute[74611]: DEBUG nova.network.neutron [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Updating instance_info_cache with network_info: [{"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:58:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Releasing lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-b0aa6480-902a-4d99-aa0b-d10fe6cfbabd req-81c6e394-dabf-4917-b07d-0c041027f89b service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received event network-vif-unplugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b0aa6480-902a-4d99-aa0b-d10fe6cfbabd req-81c6e394-dabf-4917-b07d-0c041027f89b service nova] Acquiring lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b0aa6480-902a-4d99-aa0b-d10fe6cfbabd req-81c6e394-dabf-4917-b07d-0c041027f89b service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b0aa6480-902a-4d99-aa0b-d10fe6cfbabd req-81c6e394-dabf-4917-b07d-0c041027f89b service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-b0aa6480-902a-4d99-aa0b-d10fe6cfbabd req-81c6e394-dabf-4917-b07d-0c041027f89b service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] No waiting events found dispatching network-vif-unplugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:26 user nova-compute[74611]: WARNING nova.compute.manager [req-b0aa6480-902a-4d99-aa0b-d10fe6cfbabd req-81c6e394-dabf-4917-b07d-0c041027f89b service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received unexpected event network-vif-unplugged-18262a82-8847-4594-98ce-2ad50387fbf2 for instance with vm_state active and task_state rescuing.
Nov 13 09:58:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:26 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Instance destroyed successfully.
Nov 13 09:58:26 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Attempting rescue
Nov 13 09:58:26 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74611) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Instance directory exists: not creating {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 09:58:26 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Creating image(s)
Nov 13 09:58:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "/opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "/opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "/opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:26 user nova-compute[74611]: DEBUG nova.objects.instance [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'trusted_certs' on Instance uuid ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.rescue {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.rescue" returned: 0 in 0.218s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.404s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.objects.instance [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'migration_context' on Instance uuid ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.objects.base [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Object Instance<ccd219ab-ccdc-4eee-a7d4-484e3cc597c6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Start _get_guest_xml network_info=[{"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "vif_mac": "fa:16:3e:47:7e:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.objects.instance [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'resources' on Instance uuid ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.objects.base [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Object Instance<ccd219ab-ccdc-4eee-a7d4-484e3cc597c6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.objects.instance [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'numa_topology' on Instance uuid ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.objects.base [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Object Instance<ccd219ab-ccdc-4eee-a7d4-484e3cc597c6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:58:27 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:58:27 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.objects.instance [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'vcpu_model' on Instance uuid ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.objects.base [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Object Instance<ccd219ab-ccdc-4eee-a7d4-484e3cc597c6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-263488679',display_name='tempest-ServerRescueNegativeTestJSON-server-263488679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-263488679',id=1,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:53:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae9ab18bb67e4db19e6c3366771ad218',ramdisk_id='',reservation_id='r-ldcvdrmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-961432289',owner_user_name='tempest-ServerRescueNegativeTestJSON-961432289-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:53:59Z,user_data=None,user_id='863471360be04ab5acb07ef3e99007c4',uuid=ccd219ab-ccdc-4eee-a7d4-484e3cc597c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "vif_mac": "fa:16:3e:47:7e:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converting VIF {"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "vif_mac": "fa:16:3e:47:7e:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:7e:57,bridge_name='br-int',has_traffic_filtering=True,id=18262a82-8847-4594-98ce-2ad50387fbf2,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18262a82-88') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.objects.instance [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'pci_devices' on Instance uuid ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.objects.base [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Object Instance<ccd219ab-ccdc-4eee-a7d4-484e3cc597c6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:58:27 user nova-compute[74611]:   <uuid>ccd219ab-ccdc-4eee-a7d4-484e3cc597c6</uuid>
Nov 13 09:58:27 user nova-compute[74611]:   <name>instance-00000001</name>
Nov 13 09:58:27 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:58:27 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:58:27 user nova-compute[74611]:   <metadata>
Nov 13 09:58:27 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:58:27 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:58:27 user nova-compute[74611]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-263488679</nova:name>
Nov 13 09:58:27 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:58:27</nova:creationTime>
Nov 13 09:58:27 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:58:27 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:58:27 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:58:27 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:58:27 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:58:27 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:58:27 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:58:27 user nova-compute[74611]:       <nova:owner>
Nov 13 09:58:27 user nova-compute[74611]:         <nova:user uuid="863471360be04ab5acb07ef3e99007c4">tempest-ServerRescueNegativeTestJSON-961432289-project-member</nova:user>
Nov 13 09:58:27 user nova-compute[74611]:         <nova:project uuid="ae9ab18bb67e4db19e6c3366771ad218">tempest-ServerRescueNegativeTestJSON-961432289</nova:project>
Nov 13 09:58:27 user nova-compute[74611]:       </nova:owner>
Nov 13 09:58:27 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:58:27 user nova-compute[74611]:       <nova:ports>
Nov 13 09:58:27 user nova-compute[74611]:         <nova:port uuid="18262a82-8847-4594-98ce-2ad50387fbf2">
Nov 13 09:58:27 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 09:58:27 user nova-compute[74611]:         </nova:port>
Nov 13 09:58:27 user nova-compute[74611]:       </nova:ports>
Nov 13 09:58:27 user nova-compute[74611]:     </nova:instance>
Nov 13 09:58:27 user nova-compute[74611]:   </metadata>
Nov 13 09:58:27 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:58:27 user nova-compute[74611]:     <system>
Nov 13 09:58:27 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:58:27 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:58:27 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:58:27 user nova-compute[74611]:       <entry name="serial">ccd219ab-ccdc-4eee-a7d4-484e3cc597c6</entry>
Nov 13 09:58:27 user nova-compute[74611]:       <entry name="uuid">ccd219ab-ccdc-4eee-a7d4-484e3cc597c6</entry>
Nov 13 09:58:27 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:58:27 user nova-compute[74611]:     </system>
Nov 13 09:58:27 user nova-compute[74611]:   </sysinfo>
Nov 13 09:58:27 user nova-compute[74611]:   <os>
Nov 13 09:58:27 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:58:27 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:58:27 user nova-compute[74611]:   </os>
Nov 13 09:58:27 user nova-compute[74611]:   <features>
Nov 13 09:58:27 user nova-compute[74611]:     <acpi/>
Nov 13 09:58:27 user nova-compute[74611]:     <apic/>
Nov 13 09:58:27 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:58:27 user nova-compute[74611]:   </features>
Nov 13 09:58:27 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:58:27 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:58:27 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:58:27 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:58:27 user nova-compute[74611]:   </clock>
Nov 13 09:58:27 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:58:27 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:58:27 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:58:27 user nova-compute[74611]:   </cpu>
Nov 13 09:58:27 user nova-compute[74611]:   <devices>
Nov 13 09:58:27 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:58:27 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:58:27 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.rescue"/>
Nov 13 09:58:27 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:58:27 user nova-compute[74611]:     </disk>
Nov 13 09:58:27 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:58:27 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:58:27 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk"/>
Nov 13 09:58:27 user nova-compute[74611]:       <target dev="vdb" bus="virtio"/>
Nov 13 09:58:27 user nova-compute[74611]:     </disk>
Nov 13 09:58:27 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:58:27 user nova-compute[74611]:       <mac address="fa:16:3e:47:7e:57"/>
Nov 13 09:58:27 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:58:27 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:58:27 user nova-compute[74611]:       <target dev="tap18262a82-88"/>
Nov 13 09:58:27 user nova-compute[74611]:     </interface>
Nov 13 09:58:27 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:58:27 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/console.log" append="off"/>
Nov 13 09:58:27 user nova-compute[74611]:     </serial>
Nov 13 09:58:27 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:58:27 user nova-compute[74611]:     <video>
Nov 13 09:58:27 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:58:27 user nova-compute[74611]:     </video>
Nov 13 09:58:27 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:58:27 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:58:27 user nova-compute[74611]:     </rng>
Nov 13 09:58:27 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:58:27 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:58:27 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:58:27 user nova-compute[74611]:     </memballoon>
Nov 13 09:58:27 user nova-compute[74611]:   </devices>
Nov 13 09:58:27 user nova-compute[74611]: </domain>
Nov 13 09:58:27 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:58:27 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Instance destroyed successfully.
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:58:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No VIF found with MAC fa:16:3e:47:7e:57, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:58:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] Acquiring lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] No waiting events found dispatching network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:28 user nova-compute[74611]: WARNING nova.compute.manager [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received unexpected event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 for instance with vm_state active and task_state rescuing.
Nov 13 09:58:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Received event network-vif-plugged-c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] Acquiring lock "b1913235-682f-486a-8b35-f917c3664eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] Lock "b1913235-682f-486a-8b35-f917c3664eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] Lock "b1913235-682f-486a-8b35-f917c3664eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] No waiting events found dispatching network-vif-plugged-c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:28 user nova-compute[74611]: WARNING nova.compute.manager [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Received unexpected event network-vif-plugged-c2603a51-b07e-4040-b759-d8748ebd5fdc for instance with vm_state building and task_state spawning.
Nov 13 09:58:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Received event network-vif-plugged-c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] Acquiring lock "b1913235-682f-486a-8b35-f917c3664eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] Lock "b1913235-682f-486a-8b35-f917c3664eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] Lock "b1913235-682f-486a-8b35-f917c3664eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] No waiting events found dispatching network-vif-plugged-c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:28 user nova-compute[74611]: WARNING nova.compute.manager [req-816f6edc-aa95-4c5f-9654-24659c327bc1 req-d0cbc813-9e8b-4330-bf98-614c4459ec6d service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Received unexpected event network-vif-plugged-c2603a51-b07e-4040-b759-d8748ebd5fdc for instance with vm_state building and task_state spawning.
Nov 13 09:58:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:29 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:58:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:58:29 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: b1913235-682f-486a-8b35-f917c3664eec] Instance spawned successfully.
Nov 13 09:58:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:58:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:29 user nova-compute[74611]: INFO nova.compute.manager [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Took 8.53 seconds to spawn the instance on the hypervisor.
Nov 13 09:58:29 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:58:29 user nova-compute[74611]: INFO nova.compute.manager [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Took 9.50 seconds to build instance.
Nov 13 09:58:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e10e539e-170d-436e-90ba-65b1bea3d656 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "b1913235-682f-486a-8b35-f917c3664eec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.606s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:30 user nova-compute[74611]: INFO nova.compute.manager [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Rescuing
Nov 13 09:58:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:58:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquired lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:58:30 user nova-compute[74611]: DEBUG nova.network.neutron [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:58:31 user nova-compute[74611]: DEBUG nova.compute.manager [None req-acb14a78-50c9-4fcd-b13b-ddf09a56acd5 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:58:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:31 user nova-compute[74611]: DEBUG nova.network.neutron [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Updating instance_info_cache with network_info: [{"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:58:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Releasing lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:58:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-de5edecb-42c6-439f-b51c-7bc5807e20aa req-ed3ae8e5-a5ec-45b2-9897-146d15590b2d service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received event network-vif-unplugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-de5edecb-42c6-439f-b51c-7bc5807e20aa req-ed3ae8e5-a5ec-45b2-9897-146d15590b2d service nova] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-de5edecb-42c6-439f-b51c-7bc5807e20aa req-ed3ae8e5-a5ec-45b2-9897-146d15590b2d service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-de5edecb-42c6-439f-b51c-7bc5807e20aa req-ed3ae8e5-a5ec-45b2-9897-146d15590b2d service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-de5edecb-42c6-439f-b51c-7bc5807e20aa req-ed3ae8e5-a5ec-45b2-9897-146d15590b2d service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] No waiting events found dispatching network-vif-unplugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:32 user nova-compute[74611]: WARNING nova.compute.manager [req-de5edecb-42c6-439f-b51c-7bc5807e20aa req-ed3ae8e5-a5ec-45b2-9897-146d15590b2d service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received unexpected event network-vif-unplugged-37c25482-a620-4013-9e9d-e14c53d87bc4 for instance with vm_state active and task_state rescuing.
Nov 13 09:58:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:58:32 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Instance destroyed successfully.
Nov 13 09:58:32 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Attempting a stable device rescue
Nov 13 09:58:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74611) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 09:58:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Instance directory exists: not creating {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 09:58:33 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Creating image(s)
Nov 13 09:58:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "/opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "/opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:33 user nova-compute[74611]: DEBUG nova.objects.instance [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:33 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:58:33 user nova-compute[74611]: INFO nova.compute.claims [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Claim successful on node user
Nov 13 09:58:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "2c8615f7764bcabff4370b636e29b1103134a23a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "2c8615f7764bcabff4370b636e29b1103134a23a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c8615f7764bcabff4370b636e29b1103134a23a.part --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c8615f7764bcabff4370b636e29b1103134a23a.part --force-share --output=json" returned: 0 in 0.268s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG nova.virt.images [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] ffb4992b-3f81-4c38-ba77-a825afadb145 was qcow2, converting to raw {{(pid=74611) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2c8615f7764bcabff4370b636e29b1103134a23a.part /opt/stack/data/nova/instances/_base/2c8615f7764bcabff4370b636e29b1103134a23a.converted {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-0bdebb23-cf2e-4bc4-bc4b-75a2b4534ca2 req-164bbfea-f857-4271-95a1-4c5d8ef44b65 service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0bdebb23-cf2e-4bc4-bc4b-75a2b4534ca2 req-164bbfea-f857-4271-95a1-4c5d8ef44b65 service nova] Acquiring lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0bdebb23-cf2e-4bc4-bc4b-75a2b4534ca2 req-164bbfea-f857-4271-95a1-4c5d8ef44b65 service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0bdebb23-cf2e-4bc4-bc4b-75a2b4534ca2 req-164bbfea-f857-4271-95a1-4c5d8ef44b65 service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-0bdebb23-cf2e-4bc4-bc4b-75a2b4534ca2 req-164bbfea-f857-4271-95a1-4c5d8ef44b65 service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] No waiting events found dispatching network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:34 user nova-compute[74611]: WARNING nova.compute.manager [req-0bdebb23-cf2e-4bc4-bc4b-75a2b4534ca2 req-164bbfea-f857-4271-95a1-4c5d8ef44b65 service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received unexpected event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 for instance with vm_state rescued and task_state None.
Nov 13 09:58:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2c8615f7764bcabff4370b636e29b1103134a23a.part /opt/stack/data/nova/instances/_base/2c8615f7764bcabff4370b636e29b1103134a23a.converted" returned: 0 in 0.413s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c8615f7764bcabff4370b636e29b1103134a23a.converted --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-3d2f2191-7006-499e-9fa7-c6fd083c3519 req-556a3b18-8d43-495e-bb93-7588a005d66d service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3d2f2191-7006-499e-9fa7-c6fd083c3519 req-556a3b18-8d43-495e-bb93-7588a005d66d service nova] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3d2f2191-7006-499e-9fa7-c6fd083c3519 req-556a3b18-8d43-495e-bb93-7588a005d66d service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3d2f2191-7006-499e-9fa7-c6fd083c3519 req-556a3b18-8d43-495e-bb93-7588a005d66d service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-3d2f2191-7006-499e-9fa7-c6fd083c3519 req-556a3b18-8d43-495e-bb93-7588a005d66d service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] No waiting events found dispatching network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:34 user nova-compute[74611]: WARNING nova.compute.manager [req-3d2f2191-7006-499e-9fa7-c6fd083c3519 req-556a3b18-8d43-495e-bb93-7588a005d66d service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received unexpected event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 for instance with vm_state active and task_state rescuing.
Nov 13 09:58:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c8615f7764bcabff4370b636e29b1103134a23a.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "2c8615f7764bcabff4370b636e29b1103134a23a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.977s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "2c8615f7764bcabff4370b636e29b1103134a23a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "2c8615f7764bcabff4370b636e29b1103134a23a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c8615f7764bcabff4370b636e29b1103134a23a --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.143s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c8615f7764bcabff4370b636e29b1103134a23a --force-share --output=json" returned: 0 in 0.231s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c8615f7764bcabff4370b636e29b1103134a23a,backing_fmt=raw /opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/disk.rescue {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:35 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c8615f7764bcabff4370b636e29b1103134a23a,backing_fmt=raw /opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/disk.rescue" returned: 0 in 0.070s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "2c8615f7764bcabff4370b636e29b1103134a23a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.objects.instance [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'migration_context' on Instance uuid 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.objects.base [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Object Instance<7c2479a4-1384-4845-86d8-b5fd26fa6ec4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Start _get_guest_xml network_info=[{"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "vif_mac": "fa:16:3e:6e:fe:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ffb4992b-3f81-4c38-ba77-a825afadb145', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'a66edeb7-683a-4173-ad85-8428d60c4caa', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItvJYDgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7c2479a4-1384-4845-86d8-b5fd26fa6ec4', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a', 'serial': 'ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.objects.instance [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'resources' on Instance uuid 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.objects.base [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Object Instance<7c2479a4-1384-4845-86d8-b5fd26fa6ec4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.objects.instance [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'numa_topology' on Instance uuid 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.objects.base [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Object Instance<7c2479a4-1384-4845-86d8-b5fd26fa6ec4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:58:35 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:58:35 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.policy [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '396adec28c0d44a0aefb1229090f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fb42835d7f49cbaad21eee295c7692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.objects.instance [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.objects.base [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Object Instance<7c2479a4-1384-4845-86d8-b5fd26fa6ec4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItvJYDgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:58:35 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:58:35 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:58:35 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:58:35 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Creating image(s)
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "/opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "/opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "/opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[090a2c54-6c6a-42e9-a500-c5d27afd41d1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ItvJYDgb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 13 09:58:35 user nova-compute[74611]: node.name = iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 09:58:35 user nova-compute[74611]: node.tpgt = -1
Nov 13 09:58:35 user nova-compute[74611]: node.startup = automatic
Nov 13 09:58:35 user nova-compute[74611]: node.leading_login = No
Nov 13 09:58:35 user nova-compute[74611]: iface.iscsi_ifacename = default
Nov 13 09:58:35 user nova-compute[74611]: iface.net_ifacename = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.ipaddress = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.prefix_len = 0
Nov 13 09:58:35 user nova-compute[74611]: iface.hwaddress = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.transport_name = tcp
Nov 13 09:58:35 user nova-compute[74611]: iface.initiatorname = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.state = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.vlan_id = 0
Nov 13 09:58:35 user nova-compute[74611]: iface.vlan_priority = 0
Nov 13 09:58:35 user nova-compute[74611]: iface.vlan_state = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.iface_num = 0
Nov 13 09:58:35 user nova-compute[74611]: iface.mtu = 0
Nov 13 09:58:35 user nova-compute[74611]: iface.port = 0
Nov 13 09:58:35 user nova-compute[74611]: iface.bootproto = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.subnet_mask = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.gateway = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.dhcp_alt_client_id_state = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.dhcp_alt_client_id = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.dhcp_dns = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.dhcp_learn_iqn = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.dhcp_req_vendor_id_state = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.dhcp_vendor_id_state = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.dhcp_vendor_id = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.dhcp_slp_da = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.fragmentation = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.gratuitous_arp = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.incoming_forwarding = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.tos_state = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.tos = 0
Nov 13 09:58:35 user nova-compute[74611]: iface.ttl = 0
Nov 13 09:58:35 user nova-compute[74611]: iface.delayed_ack = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.tcp_nagle = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.tcp_wsf_state = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.tcp_wsf = 0
Nov 13 09:58:35 user nova-compute[74611]: iface.tcp_timer_scale = 0
Nov 13 09:58:35 user nova-compute[74611]: iface.tcp_timestamp = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.redirect = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.def_task_mgmt_timeout = 0
Nov 13 09:58:35 user nova-compute[74611]: iface.header_digest = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.data_digest = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.immediate_data = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.initial_r2t = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.data_seq_inorder = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.data_pdu_inorder = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.erl = 0
Nov 13 09:58:35 user nova-compute[74611]: iface.max_receive_data_len = 0
Nov 13 09:58:35 user nova-compute[74611]: iface.first_burst_len = 0
Nov 13 09:58:35 user nova-compute[74611]: iface.max_outstanding_r2t = 0
Nov 13 09:58:35 user nova-compute[74611]: iface.max_burst_len = 0
Nov 13 09:58:35 user nova-compute[74611]: iface.chap_auth = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.bidi_chap = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.strict_login_compliance = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.discovery_auth = <empty>
Nov 13 09:58:35 user nova-compute[74611]: iface.discovery_logout = <empty>
Nov 13 09:58:35 user nova-compute[74611]: node.discovery_address = <empty>
Nov 13 09:58:35 user nova-compute[74611]: node.discovery_port = 0
Nov 13 09:58:35 user nova-compute[74611]: node.discovery_type = static
Nov 13 09:58:35 user nova-compute[74611]: node.session.initial_cmdsn = 0
Nov 13 09:58:35 user nova-compute[74611]: node.session.initial_login_retry_max = 8
Nov 13 09:58:35 user nova-compute[74611]: node.session.xmit_thread_priority = -20
Nov 13 09:58:35 user nova-compute[74611]: node.session.cmds_max = 128
Nov 13 09:58:35 user nova-compute[74611]: node.session.queue_depth = 32
Nov 13 09:58:35 user nova-compute[74611]: node.session.nr_sessions = 1
Nov 13 09:58:35 user nova-compute[74611]: node.session.auth.authmethod = CHAP
Nov 13 09:58:35 user nova-compute[74611]: node.session.auth.username = ItvJYDgb
Nov 13 09:58:35 user nova-compute[74611]: node.session.auth.password = ***
Nov 13 09:58:35 user nova-compute[74611]: node.session.auth.username_in = <empty>
Nov 13 09:58:35 user nova-compute[74611]: node.session.auth.password_in = <empty>
Nov 13 09:58:35 user nova-compute[74611]: node.session.auth.chap_algs = MD5
Nov 13 09:58:35 user nova-compute[74611]: node.session.timeo.replacement_timeout = 120
Nov 13 09:58:35 user nova-compute[74611]: node.session.err_timeo.abort_timeout = 15
Nov 13 09:58:35 user nova-compute[74611]: node.session.err_timeo.lu_reset_timeout = 30
Nov 13 09:58:35 user nova-compute[74611]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 13 09:58:35 user nova-compute[74611]: node.session.err_timeo.host_reset_timeout = 60
Nov 13 09:58:35 user nova-compute[74611]: node.session.iscsi.FastAbort = Yes
Nov 13 09:58:35 user nova-compute[74611]: node.session.iscsi.InitialR2T = No
Nov 13 09:58:35 user nova-compute[74611]: node.session.iscsi.ImmediateData = Yes
Nov 13 09:58:35 user nova-compute[74611]: node.session.iscsi.FirstBurstLength = 262144
Nov 13 09:58:35 user nova-compute[74611]: node.session.iscsi.MaxBurstLength = 16776192
Nov 13 09:58:35 user nova-compute[74611]: node.session.iscsi.DefaultTime2Retain = 0
Nov 13 09:58:35 user nova-compute[74611]: node.session.iscsi.DefaultTime2Wait = 2
Nov 13 09:58:35 user nova-compute[74611]: node.session.iscsi.MaxConnections = 1
Nov 13 09:58:35 user nova-compute[74611]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 13 09:58:35 user nova-compute[74611]: node.session.iscsi.ERL = 0
Nov 13 09:58:35 user nova-compute[74611]: node.session.scan = manual
Nov 13 09:58:35 user nova-compute[74611]: node.session.reopen_max = 0
Nov 13 09:58:35 user nova-compute[74611]: node.conn[0].address = 172.16.0.220
Nov 13 09:58:35 user nova-compute[74611]: node.conn[0].port = 3260
Nov 13 09:58:35 user nova-compute[74611]: node.conn[0].startup = manual
Nov 13 09:58:35 user nova-compute[74611]: node.conn[0].tcp.window_size = 524288
Nov 13 09:58:35 user nova-compute[74611]: node.conn[0].tcp.type_of_service = 0
Nov 13 09:58:35 user nova-compute[74611]: node.conn[0].timeo.logout_timeout = 15
Nov 13 09:58:35 user nova-compute[74611]: node.conn[0].timeo.login_timeout = 15
Nov 13 09:58:35 user nova-compute[74611]: node.conn[0].timeo.auth_timeout = 45
Nov 13 09:58:35 user nova-compute[74611]: node.conn[0].timeo.noop_out_interval = 5
Nov 13 09:58:35 user nova-compute[74611]: node.conn[0].timeo.noop_out_timeout = 5
Nov 13 09:58:35 user nova-compute[74611]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 13 09:58:35 user nova-compute[74611]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 13 09:58:35 user nova-compute[74611]: node.conn[0].iscsi.HeaderDigest = None
Nov 13 09:58:35 user nova-compute[74611]: node.conn[0].iscsi.DataDigest = None
Nov 13 09:58:35 user nova-compute[74611]: node.conn[0].iscsi.IFMarker = No
Nov 13 09:58:35 user nova-compute[74611]: node.conn[0].iscsi.OFMarker = No
Nov 13 09:58:35 user nova-compute[74611]: # END RECORD
Nov 13 09:58:35 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f7d232-6fb5-47df-b455-8a01f2c29616]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0422725b-b4bc-4846-a39f-d5b722d06e87]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItvJYDgb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItvJYDgb" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49328f3-8a43-42b3-8e6e-2432e7e19e86]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ItvJYDgb'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0754e2b0-a9c0-47cb-8cf8-0c4585284813]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[787fa230-cb32-41af-837f-5df9f6b9371b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:58:35 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:58:35 user nova-compute[74611]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)
Nov 13 09:58:35 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:58:35 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:58:35 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:58:35 user nova-compute[74611]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)
Nov 13 09:58:35 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:58:35 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] HCTL ('34', '0', '0', 0) found on session 13 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.246s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[10af6551-2f1e-443c-ae91-37428fa713fd]: (4, ('0 0 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching for a device in session 13 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItvJYDgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.365s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] <== connect_volume: return (367ms) {'type': 'block', 'scsi_wwn': '26431613863616236', 'path': '/dev/sdc'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431613863616236', 'path': '/dev/sdc'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:35 user nova-compute[74611]: INFO nova.compute.manager [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Detaching volume 173d8837-2595-459a-bc22-8465cfabdb5d
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:56:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-937478887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-937478887',id=16,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:56:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83e3b3233a5b43d682200d91f29a80b4',ramdisk_id='',reservation_id='r-qh3r9bur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-182847603',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:56:55Z,user_data=None,user_id='6bc911a5649643a6a3606d8b80e20eb0',uuid=7c2479a4-1384-4845-86d8-b5fd26fa6ec4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "vif_mac": "fa:16:3e:6e:fe:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converting VIF {"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "vif_mac": "fa:16:3e:6e:fe:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:58:35 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:fe:e6,bridge_name='br-int',has_traffic_filtering=True,id=37c25482-a620-4013-9e9d-e14c53d87bc4,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37c25482-a6') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.objects.instance [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.objects.base [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Object Instance<7c2479a4-1384-4845-86d8-b5fd26fa6ec4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:58:36 user nova-compute[74611]:   <uuid>7c2479a4-1384-4845-86d8-b5fd26fa6ec4</uuid>
Nov 13 09:58:36 user nova-compute[74611]:   <name>instance-00000010</name>
Nov 13 09:58:36 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:58:36 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:58:36 user nova-compute[74611]:   <metadata>
Nov 13 09:58:36 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:58:36 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:58:36 user nova-compute[74611]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-937478887</nova:name>
Nov 13 09:58:36 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:58:35</nova:creationTime>
Nov 13 09:58:36 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:58:36 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:58:36 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:58:36 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:58:36 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:58:36 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:58:36 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:58:36 user nova-compute[74611]:       <nova:owner>
Nov 13 09:58:36 user nova-compute[74611]:         <nova:user uuid="6bc911a5649643a6a3606d8b80e20eb0">tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member</nova:user>
Nov 13 09:58:36 user nova-compute[74611]:         <nova:project uuid="83e3b3233a5b43d682200d91f29a80b4">tempest-ServerBootFromVolumeStableRescueTest-182847603</nova:project>
Nov 13 09:58:36 user nova-compute[74611]:       </nova:owner>
Nov 13 09:58:36 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:58:36 user nova-compute[74611]:       <nova:ports>
Nov 13 09:58:36 user nova-compute[74611]:         <nova:port uuid="37c25482-a620-4013-9e9d-e14c53d87bc4">
Nov 13 09:58:36 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 09:58:36 user nova-compute[74611]:         </nova:port>
Nov 13 09:58:36 user nova-compute[74611]:       </nova:ports>
Nov 13 09:58:36 user nova-compute[74611]:     </nova:instance>
Nov 13 09:58:36 user nova-compute[74611]:   </metadata>
Nov 13 09:58:36 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:58:36 user nova-compute[74611]:     <system>
Nov 13 09:58:36 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:58:36 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:58:36 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:58:36 user nova-compute[74611]:       <entry name="serial">7c2479a4-1384-4845-86d8-b5fd26fa6ec4</entry>
Nov 13 09:58:36 user nova-compute[74611]:       <entry name="uuid">7c2479a4-1384-4845-86d8-b5fd26fa6ec4</entry>
Nov 13 09:58:36 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:58:36 user nova-compute[74611]:     </system>
Nov 13 09:58:36 user nova-compute[74611]:   </sysinfo>
Nov 13 09:58:36 user nova-compute[74611]:   <os>
Nov 13 09:58:36 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:58:36 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:58:36 user nova-compute[74611]:   </os>
Nov 13 09:58:36 user nova-compute[74611]:   <features>
Nov 13 09:58:36 user nova-compute[74611]:     <acpi/>
Nov 13 09:58:36 user nova-compute[74611]:     <apic/>
Nov 13 09:58:36 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:58:36 user nova-compute[74611]:   </features>
Nov 13 09:58:36 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:58:36 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:58:36 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:58:36 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:58:36 user nova-compute[74611]:   </clock>
Nov 13 09:58:36 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:58:36 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:58:36 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:58:36 user nova-compute[74611]:   </cpu>
Nov 13 09:58:36 user nova-compute[74611]:   <devices>
Nov 13 09:58:36 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 09:58:36 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:58:36 user nova-compute[74611]:       <source dev="/dev/sdc"/>
Nov 13 09:58:36 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:58:36 user nova-compute[74611]:       <serial>ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a</serial>
Nov 13 09:58:36 user nova-compute[74611]:     </disk>
Nov 13 09:58:36 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:58:36 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:58:36 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/disk.rescue"/>
Nov 13 09:58:36 user nova-compute[74611]:       <target dev="vdb" bus="virtio"/>
Nov 13 09:58:36 user nova-compute[74611]:       <boot order="1"/>
Nov 13 09:58:36 user nova-compute[74611]:     </disk>
Nov 13 09:58:36 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:58:36 user nova-compute[74611]:       <mac address="fa:16:3e:6e:fe:e6"/>
Nov 13 09:58:36 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:58:36 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:58:36 user nova-compute[74611]:       <target dev="tap37c25482-a6"/>
Nov 13 09:58:36 user nova-compute[74611]:     </interface>
Nov 13 09:58:36 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:58:36 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/console.log" append="off"/>
Nov 13 09:58:36 user nova-compute[74611]:     </serial>
Nov 13 09:58:36 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:58:36 user nova-compute[74611]:     <video>
Nov 13 09:58:36 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:58:36 user nova-compute[74611]:     </video>
Nov 13 09:58:36 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:58:36 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:58:36 user nova-compute[74611]:     </rng>
Nov 13 09:58:36 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:58:36 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:58:36 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:58:36 user nova-compute[74611]:     </memballoon>
Nov 13 09:58:36 user nova-compute[74611]:   </devices>
Nov 13 09:58:36 user nova-compute[74611]: </domain>
Nov 13 09:58:36 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:58:36 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Instance destroyed successfully.
Nov 13 09:58:36 user nova-compute[74611]: INFO nova.virt.block_device [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Attempting to driver detach volume 173d8837-2595-459a-bc22-8465cfabdb5d from mountpoint /dev/vdb
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.245s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk 1073741824" returned: 0 in 0.054s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] No VIF found with MAC fa:16:3e:6e:fe:e6, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Attempting to detach device vdb from instance fe53a1a8-de5b-4679-bddb-1da5204dbab8 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 09:58:36 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:58:36 user nova-compute[74611]:   <source dev="/dev/sdf"/>
Nov 13 09:58:36 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:58:36 user nova-compute[74611]:   <serial>173d8837-2595-459a-bc22-8465cfabdb5d</serial>
Nov 13 09:58:36 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 09:58:36 user nova-compute[74611]: </disk>
Nov 13 09:58:36 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:58:36 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Successfully detached device vdb from instance fe53a1a8-de5b-4679-bddb-1da5204dbab8 from the persistent domain config.
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe53a1a8-de5b-4679-bddb-1da5204dbab8 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 09:58:36 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:58:36 user nova-compute[74611]:   <source dev="/dev/sdf"/>
Nov 13 09:58:36 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:58:36 user nova-compute[74611]:   <serial>173d8837-2595-459a-bc22-8465cfabdb5d</serial>
Nov 13 09:58:36 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 09:58:36 user nova-compute[74611]: </disk>
Nov 13 09:58:36 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.224s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Checking if we can resize image /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Successfully created port: 9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-0e9afcc4-d2ea-4fe9-b97f-b8c911ed5a82 req-77b128d2-6764-4b0d-a39d-efc78e0a898f service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0e9afcc4-d2ea-4fe9-b97f-b8c911ed5a82 req-77b128d2-6764-4b0d-a39d-efc78e0a898f service nova] Acquiring lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0e9afcc4-d2ea-4fe9-b97f-b8c911ed5a82 req-77b128d2-6764-4b0d-a39d-efc78e0a898f service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0e9afcc4-d2ea-4fe9-b97f-b8c911ed5a82 req-77b128d2-6764-4b0d-a39d-efc78e0a898f service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-0e9afcc4-d2ea-4fe9-b97f-b8c911ed5a82 req-77b128d2-6764-4b0d-a39d-efc78e0a898f service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] No waiting events found dispatching network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:36 user nova-compute[74611]: WARNING nova.compute.manager [req-0e9afcc4-d2ea-4fe9-b97f-b8c911ed5a82 req-77b128d2-6764-4b0d-a39d-efc78e0a898f service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received unexpected event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 for instance with vm_state rescued and task_state None.
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Cannot resize image /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Ensure instance console log exists: /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updating instance_info_cache with network_info: [{"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-8cdb9561-3b40-44cc-abf7-2cbff7e60a17" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:58:36 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Successfully updated port: 9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquired lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe53a1a8-de5b-4679-bddb-1da5204dbab8 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updating instance_info_cache with network_info: [{"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Releasing lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Instance network_info: |[{"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Start _get_guest_xml network_info=[{"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:58:37 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:58:37 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:58:37 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1214168652',display_name='tempest-ServerActionsTestOtherB-server-1214168652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1214168652',id=21,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDWkg3C+Ons0/sduU7bCkNdUaQmui4Ar0pDJw7KSIbqtW1jWjrtKiyZ8w8dVwpvUbMKS1UF1ykPykLHc0hyTfyxEKKXaxiPgUkE/a0u6OsQxRK/HJgxNowuqXz8Zc+KMg==',key_name='tempest-keypair-1038082490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1fb42835d7f49cbaad21eee295c7692',ramdisk_id='',reservation_id='r-yeac67tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-840608963',owner_user_name='tempest-ServerActionsTestOtherB-840608963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='396adec28c0d44a0aefb1229090f90d5',uuid=635636ea-96a0-4fdb-85a1-ca7a87b762f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converting VIF {"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG nova.objects.instance [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lazy-loading 'pci_devices' on Instance uuid 635636ea-96a0-4fdb-85a1-ca7a87b762f0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:58:38 user nova-compute[74611]:   <uuid>635636ea-96a0-4fdb-85a1-ca7a87b762f0</uuid>
Nov 13 09:58:38 user nova-compute[74611]:   <name>instance-00000015</name>
Nov 13 09:58:38 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:58:38 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:58:38 user nova-compute[74611]:   <metadata>
Nov 13 09:58:38 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:58:38 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:58:38 user nova-compute[74611]:       <nova:name>tempest-ServerActionsTestOtherB-server-1214168652</nova:name>
Nov 13 09:58:38 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:58:37</nova:creationTime>
Nov 13 09:58:38 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:58:38 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:58:38 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:58:38 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:58:38 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:58:38 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:58:38 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:58:38 user nova-compute[74611]:       <nova:owner>
Nov 13 09:58:38 user nova-compute[74611]:         <nova:user uuid="396adec28c0d44a0aefb1229090f90d5">tempest-ServerActionsTestOtherB-840608963-project-member</nova:user>
Nov 13 09:58:38 user nova-compute[74611]:         <nova:project uuid="a1fb42835d7f49cbaad21eee295c7692">tempest-ServerActionsTestOtherB-840608963</nova:project>
Nov 13 09:58:38 user nova-compute[74611]:       </nova:owner>
Nov 13 09:58:38 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:58:38 user nova-compute[74611]:       <nova:ports>
Nov 13 09:58:38 user nova-compute[74611]:         <nova:port uuid="9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d">
Nov 13 09:58:38 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 09:58:38 user nova-compute[74611]:         </nova:port>
Nov 13 09:58:38 user nova-compute[74611]:       </nova:ports>
Nov 13 09:58:38 user nova-compute[74611]:     </nova:instance>
Nov 13 09:58:38 user nova-compute[74611]:   </metadata>
Nov 13 09:58:38 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:58:38 user nova-compute[74611]:     <system>
Nov 13 09:58:38 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:58:38 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:58:38 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:58:38 user nova-compute[74611]:       <entry name="serial">635636ea-96a0-4fdb-85a1-ca7a87b762f0</entry>
Nov 13 09:58:38 user nova-compute[74611]:       <entry name="uuid">635636ea-96a0-4fdb-85a1-ca7a87b762f0</entry>
Nov 13 09:58:38 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:58:38 user nova-compute[74611]:     </system>
Nov 13 09:58:38 user nova-compute[74611]:   </sysinfo>
Nov 13 09:58:38 user nova-compute[74611]:   <os>
Nov 13 09:58:38 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:58:38 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:58:38 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:58:38 user nova-compute[74611]:   </os>
Nov 13 09:58:38 user nova-compute[74611]:   <features>
Nov 13 09:58:38 user nova-compute[74611]:     <acpi/>
Nov 13 09:58:38 user nova-compute[74611]:     <apic/>
Nov 13 09:58:38 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:58:38 user nova-compute[74611]:   </features>
Nov 13 09:58:38 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:58:38 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:58:38 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:58:38 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:58:38 user nova-compute[74611]:   </clock>
Nov 13 09:58:38 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:58:38 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:58:38 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:58:38 user nova-compute[74611]:   </cpu>
Nov 13 09:58:38 user nova-compute[74611]:   <devices>
Nov 13 09:58:38 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:58:38 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:58:38 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk"/>
Nov 13 09:58:38 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:58:38 user nova-compute[74611]:     </disk>
Nov 13 09:58:38 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:58:38 user nova-compute[74611]:       <mac address="fa:16:3e:f5:e2:a3"/>
Nov 13 09:58:38 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:58:38 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:58:38 user nova-compute[74611]:       <target dev="tap9ff4d9c6-a2"/>
Nov 13 09:58:38 user nova-compute[74611]:     </interface>
Nov 13 09:58:38 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:58:38 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/console.log" append="off"/>
Nov 13 09:58:38 user nova-compute[74611]:     </serial>
Nov 13 09:58:38 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:58:38 user nova-compute[74611]:     <video>
Nov 13 09:58:38 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:58:38 user nova-compute[74611]:     </video>
Nov 13 09:58:38 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:58:38 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:58:38 user nova-compute[74611]:     </rng>
Nov 13 09:58:38 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:58:38 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:58:38 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:58:38 user nova-compute[74611]:     </memballoon>
Nov 13 09:58:38 user nova-compute[74611]:   </devices>
Nov 13 09:58:38 user nova-compute[74611]: </domain>
Nov 13 09:58:38 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1214168652',display_name='tempest-ServerActionsTestOtherB-server-1214168652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1214168652',id=21,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDWkg3C+Ons0/sduU7bCkNdUaQmui4Ar0pDJw7KSIbqtW1jWjrtKiyZ8w8dVwpvUbMKS1UF1ykPykLHc0hyTfyxEKKXaxiPgUkE/a0u6OsQxRK/HJgxNowuqXz8Zc+KMg==',key_name='tempest-keypair-1038082490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1fb42835d7f49cbaad21eee295c7692',ramdisk_id='',reservation_id='r-yeac67tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-840608963',owner_user_name='tempest-ServerActionsTestOtherB-840608963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='396adec28c0d44a0aefb1229090f90d5',uuid=635636ea-96a0-4fdb-85a1-ca7a87b762f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converting VIF {"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG os_vif [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab36b041-07a0-547b-b4c0-73d2ad864388', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ff4d9c6-a2, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ff4d9c6-a2, col_values=(('qos', UUID('084d89a2-9a65-4c07-88cf-a22c531ed9ff')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ff4d9c6-a2, col_values=(('external_ids', {'iface-id': '9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:e2:a3', 'vm-uuid': '635636ea-96a0-4fdb-85a1-ca7a87b762f0'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:38 user nova-compute[74611]: INFO os_vif [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2')
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] No VIF found with MAC fa:16:3e:f5:e2:a3, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-e2577460-c8fb-4981-b8f6-60fe3005d468 req-5a40ea3b-3fd9-49e4-954d-de08ce3ba52b service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e2577460-c8fb-4981-b8f6-60fe3005d468 req-5a40ea3b-3fd9-49e4-954d-de08ce3ba52b service nova] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e2577460-c8fb-4981-b8f6-60fe3005d468 req-5a40ea3b-3fd9-49e4-954d-de08ce3ba52b service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e2577460-c8fb-4981-b8f6-60fe3005d468 req-5a40ea3b-3fd9-49e4-954d-de08ce3ba52b service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-e2577460-c8fb-4981-b8f6-60fe3005d468 req-5a40ea3b-3fd9-49e4-954d-de08ce3ba52b service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] No waiting events found dispatching network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:38 user nova-compute[74611]: WARNING nova.compute.manager [req-e2577460-c8fb-4981-b8f6-60fe3005d468 req-5a40ea3b-3fd9-49e4-954d-de08ce3ba52b service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received unexpected event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 for instance with vm_state active and task_state rescuing.
Nov 13 09:58:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-790ff63d-401c-4027-a963-ccec51bbf611 req-9ca14731-fed6-4068-97c8-f5c4016bd7d3 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received event network-changed-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-790ff63d-401c-4027-a963-ccec51bbf611 req-9ca14731-fed6-4068-97c8-f5c4016bd7d3 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Refreshing instance network info cache due to event network-changed-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:58:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-790ff63d-401c-4027-a963-ccec51bbf611 req-9ca14731-fed6-4068-97c8-f5c4016bd7d3 service nova] Acquiring lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:58:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-790ff63d-401c-4027-a963-ccec51bbf611 req-9ca14731-fed6-4068-97c8-f5c4016bd7d3 service nova] Acquired lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:58:39 user nova-compute[74611]: DEBUG nova.network.neutron [req-790ff63d-401c-4027-a963-ccec51bbf611 req-9ca14731-fed6-4068-97c8-f5c4016bd7d3 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Refreshing network info cache for port 9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:58:39 user nova-compute[74611]: DEBUG nova.network.neutron [req-790ff63d-401c-4027-a963-ccec51bbf611 req-9ca14731-fed6-4068-97c8-f5c4016bd7d3 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updated VIF entry in instance network info cache for port 9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:58:39 user nova-compute[74611]: DEBUG nova.network.neutron [req-790ff63d-401c-4027-a963-ccec51bbf611 req-9ca14731-fed6-4068-97c8-f5c4016bd7d3 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updating instance_info_cache with network_info: [{"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:58:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-790ff63d-401c-4027-a963-ccec51bbf611 req-9ca14731-fed6-4068-97c8-f5c4016bd7d3 service nova] Releasing lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:58:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-f01e17d8-7d71-4c87-a33e-47250042511c req-3892b073-8de3-4df0-bc95-72aa9c79d214 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f01e17d8-7d71-4c87-a33e-47250042511c req-3892b073-8de3-4df0-bc95-72aa9c79d214 service nova] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f01e17d8-7d71-4c87-a33e-47250042511c req-3892b073-8de3-4df0-bc95-72aa9c79d214 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f01e17d8-7d71-4c87-a33e-47250042511c req-3892b073-8de3-4df0-bc95-72aa9c79d214 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-f01e17d8-7d71-4c87-a33e-47250042511c req-3892b073-8de3-4df0-bc95-72aa9c79d214 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] No waiting events found dispatching network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:40 user nova-compute[74611]: WARNING nova.compute.manager [req-f01e17d8-7d71-4c87-a33e-47250042511c req-3892b073-8de3-4df0-bc95-72aa9c79d214 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received unexpected event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d for instance with vm_state building and task_state spawning.
Nov 13 09:58:40 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:58:40 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 09:58:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-b7e0da56-0a47-4de3-b70c-6203714e1df5 req-1bc6afa8-be79-46e5-b755-bf76277ff217 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b7e0da56-0a47-4de3-b70c-6203714e1df5 req-1bc6afa8-be79-46e5-b755-bf76277ff217 service nova] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b7e0da56-0a47-4de3-b70c-6203714e1df5 req-1bc6afa8-be79-46e5-b755-bf76277ff217 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b7e0da56-0a47-4de3-b70c-6203714e1df5 req-1bc6afa8-be79-46e5-b755-bf76277ff217 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-b7e0da56-0a47-4de3-b70c-6203714e1df5 req-1bc6afa8-be79-46e5-b755-bf76277ff217 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] No waiting events found dispatching network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:40 user nova-compute[74611]: WARNING nova.compute.manager [req-b7e0da56-0a47-4de3-b70c-6203714e1df5 req-1bc6afa8-be79-46e5-b755-bf76277ff217 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received unexpected event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 for instance with vm_state active and task_state rescuing.
Nov 13 09:58:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:41 user nova-compute[74611]: DEBUG nova.compute.manager [None req-d664c66b-082a-41b6-9046-a6523770c43f tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 09:58:42 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Instance spawned successfully.
Nov 13 09:58:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG nova.compute.manager [req-f6a3454a-e4b4-45f0-b31f-f33068dcb911 req-4ff5905c-207f-4569-a4bd-a006ca308cb8 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f6a3454a-e4b4-45f0-b31f-f33068dcb911 req-4ff5905c-207f-4569-a4bd-a006ca308cb8 service nova] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f6a3454a-e4b4-45f0-b31f-f33068dcb911 req-4ff5905c-207f-4569-a4bd-a006ca308cb8 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f6a3454a-e4b4-45f0-b31f-f33068dcb911 req-4ff5905c-207f-4569-a4bd-a006ca308cb8 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG nova.compute.manager [req-f6a3454a-e4b4-45f0-b31f-f33068dcb911 req-4ff5905c-207f-4569-a4bd-a006ca308cb8 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] No waiting events found dispatching network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:42 user nova-compute[74611]: WARNING nova.compute.manager [req-f6a3454a-e4b4-45f0-b31f-f33068dcb911 req-4ff5905c-207f-4569-a4bd-a006ca308cb8 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received unexpected event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d for instance with vm_state building and task_state spawning.
Nov 13 09:58:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:42 user nova-compute[74611]: INFO nova.compute.manager [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Took 6.87 seconds to spawn the instance on the hypervisor.
Nov 13 09:58:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:58:42 user nova-compute[74611]: INFO nova.compute.manager [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Took 9.59 seconds to build instance.
Nov 13 09:58:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f3ed4711-8677-4973-8fa0-74f033db1462 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.835s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:43 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 09:58:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.rescue --force-share --output=json" returned: 0 in 0.279s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.rescue --force-share --output=json" returned: 0 in 0.264s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 09:58:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/disk.rescue --force-share --output=json" returned: 0 in 0.301s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "822a3afe-eae1-4960-b347-89c58fb10c4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:46 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:58:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:58:47 user nova-compute[74611]: INFO nova.compute.claims [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Claim successful on node user
Nov 13 09:58:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.024s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:58:48 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:58:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:58:48 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Creating image(s)
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "/opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "/opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "/opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG nova.policy [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f22322be2dd04410b6cd53c31e639b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a0b0a078bd44908cd7cd4593914eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.210s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.206s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk 1073741824" returned: 0 in 0.128s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Successfully created port: a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.596s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.manager [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:58:49 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:58:49 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=7217MB free_disk=25.284252166748047GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Cannot resize image /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Ensure instance console log exists: /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 85cb3adb-b2b3-49ec-92ab-c2b7a028241a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 1c66c8a8-abb5-4f60-8464-074627c213d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance fe53a1a8-de5b-4679-bddb-1da5204dbab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 89038547-5416-4942-8070-dd5dd8e4b6c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4dca8fcf-5fed-4cd1-b8db-61f271b93d20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance e99e1557-500f-407e-aefc-3b5cde9ceba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4970bd6b-69a6-479c-9f5f-bc5fc6021407 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance b1913235-682f-486a-8b35-f917c3664eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 635636ea-96a0-4fdb-85a1-ca7a87b762f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f5cb6cf5-f915-4f50-bfc3-0112875dcfcc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 09:58:49 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Successfully updated port: a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquired lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-da4627b9-8a81-4b7a-a725-11bdd969ef6e req-c1810b4e-9873-47b7-81e1-8a6f62dbfdf6 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Received event network-changed-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-da4627b9-8a81-4b7a-a725-11bdd969ef6e req-c1810b4e-9873-47b7-81e1-8a6f62dbfdf6 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Refreshing instance network info cache due to event network-changed-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-da4627b9-8a81-4b7a-a725-11bdd969ef6e req-c1810b4e-9873-47b7-81e1-8a6f62dbfdf6 service nova] Acquiring lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.663s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.594s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:58:50 user nova-compute[74611]: INFO nova.compute.claims [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Claim successful on node user
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.network.neutron [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Updating instance_info_cache with network_info: [{"id": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "address": "fa:16:3e:b7:e1:19", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ef27e1-e7", "ovs_interfaceid": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Releasing lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Instance network_info: |[{"id": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "address": "fa:16:3e:b7:e1:19", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ef27e1-e7", "ovs_interfaceid": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-da4627b9-8a81-4b7a-a725-11bdd969ef6e req-c1810b4e-9873-47b7-81e1-8a6f62dbfdf6 service nova] Acquired lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.network.neutron [req-da4627b9-8a81-4b7a-a725-11bdd969ef6e req-c1810b4e-9873-47b7-81e1-8a6f62dbfdf6 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Refreshing network info cache for port a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Start _get_guest_xml network_info=[{"id": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "address": "fa:16:3e:b7:e1:19", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ef27e1-e7", "ovs_interfaceid": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:58:50 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:58:50 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-395312671',display_name='tempest-ServerActionsTestOtherA-server-395312671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-395312671',id=22,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyvkPZ/C5Pk5XOFxP5rMcYJVq0nGL8MEwZ1COcFqCFBcO7G74gr+o/bZOILVW3PDzyd5NY9xtWs0kgCNTm8xNQIJrW9d3YRiHEICGlxrvJ1iCAAc7YEKxcFMW7SpPA0Dw==',key_name='tempest-keypair-2093749558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a0b0a078bd44908cd7cd4593914eef',ramdisk_id='',reservation_id='r-uxg6tzfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2135577355',owner_user_name='tempest-ServerActionsTestOtherA-2135577355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:58:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22322be2dd04410b6cd53c31e639b3b',uuid=822a3afe-eae1-4960-b347-89c58fb10c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "address": "fa:16:3e:b7:e1:19", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ef27e1-e7", "ovs_interfaceid": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converting VIF {"id": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "address": "fa:16:3e:b7:e1:19", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ef27e1-e7", "ovs_interfaceid": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e1:19,bridge_name='br-int',has_traffic_filtering=True,id=a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ef27e1-e7') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.objects.instance [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lazy-loading 'pci_devices' on Instance uuid 822a3afe-eae1-4960-b347-89c58fb10c4c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:58:50 user nova-compute[74611]:   <uuid>822a3afe-eae1-4960-b347-89c58fb10c4c</uuid>
Nov 13 09:58:50 user nova-compute[74611]:   <name>instance-00000016</name>
Nov 13 09:58:50 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:58:50 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:58:50 user nova-compute[74611]:   <metadata>
Nov 13 09:58:50 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:58:50 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:58:50 user nova-compute[74611]:       <nova:name>tempest-ServerActionsTestOtherA-server-395312671</nova:name>
Nov 13 09:58:50 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:58:50</nova:creationTime>
Nov 13 09:58:50 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:58:50 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:58:50 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:58:50 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:58:50 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:58:50 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:58:50 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:58:50 user nova-compute[74611]:       <nova:owner>
Nov 13 09:58:50 user nova-compute[74611]:         <nova:user uuid="f22322be2dd04410b6cd53c31e639b3b">tempest-ServerActionsTestOtherA-2135577355-project-member</nova:user>
Nov 13 09:58:50 user nova-compute[74611]:         <nova:project uuid="e6a0b0a078bd44908cd7cd4593914eef">tempest-ServerActionsTestOtherA-2135577355</nova:project>
Nov 13 09:58:50 user nova-compute[74611]:       </nova:owner>
Nov 13 09:58:50 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 09:58:50 user nova-compute[74611]:       <nova:ports>
Nov 13 09:58:50 user nova-compute[74611]:         <nova:port uuid="a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0">
Nov 13 09:58:50 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 09:58:50 user nova-compute[74611]:         </nova:port>
Nov 13 09:58:50 user nova-compute[74611]:       </nova:ports>
Nov 13 09:58:50 user nova-compute[74611]:     </nova:instance>
Nov 13 09:58:50 user nova-compute[74611]:   </metadata>
Nov 13 09:58:50 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:58:50 user nova-compute[74611]:     <system>
Nov 13 09:58:50 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:58:50 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:58:50 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:58:50 user nova-compute[74611]:       <entry name="serial">822a3afe-eae1-4960-b347-89c58fb10c4c</entry>
Nov 13 09:58:50 user nova-compute[74611]:       <entry name="uuid">822a3afe-eae1-4960-b347-89c58fb10c4c</entry>
Nov 13 09:58:50 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:58:50 user nova-compute[74611]:     </system>
Nov 13 09:58:50 user nova-compute[74611]:   </sysinfo>
Nov 13 09:58:50 user nova-compute[74611]:   <os>
Nov 13 09:58:50 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:58:50 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:58:50 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:58:50 user nova-compute[74611]:   </os>
Nov 13 09:58:50 user nova-compute[74611]:   <features>
Nov 13 09:58:50 user nova-compute[74611]:     <acpi/>
Nov 13 09:58:50 user nova-compute[74611]:     <apic/>
Nov 13 09:58:50 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:58:50 user nova-compute[74611]:   </features>
Nov 13 09:58:50 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:58:50 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:58:50 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:58:50 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:58:50 user nova-compute[74611]:   </clock>
Nov 13 09:58:50 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:58:50 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:58:50 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:58:50 user nova-compute[74611]:   </cpu>
Nov 13 09:58:50 user nova-compute[74611]:   <devices>
Nov 13 09:58:50 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 09:58:50 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 09:58:50 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk"/>
Nov 13 09:58:50 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:58:50 user nova-compute[74611]:     </disk>
Nov 13 09:58:50 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:58:50 user nova-compute[74611]:       <mac address="fa:16:3e:b7:e1:19"/>
Nov 13 09:58:50 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:58:50 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:58:50 user nova-compute[74611]:       <target dev="tapa1ef27e1-e7"/>
Nov 13 09:58:50 user nova-compute[74611]:     </interface>
Nov 13 09:58:50 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:58:50 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/console.log" append="off"/>
Nov 13 09:58:50 user nova-compute[74611]:     </serial>
Nov 13 09:58:50 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:58:50 user nova-compute[74611]:     <video>
Nov 13 09:58:50 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:58:50 user nova-compute[74611]:     </video>
Nov 13 09:58:50 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:58:50 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:58:50 user nova-compute[74611]:     </rng>
Nov 13 09:58:50 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:58:50 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:58:50 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:58:50 user nova-compute[74611]:     </memballoon>
Nov 13 09:58:50 user nova-compute[74611]:   </devices>
Nov 13 09:58:50 user nova-compute[74611]: </domain>
Nov 13 09:58:50 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-395312671',display_name='tempest-ServerActionsTestOtherA-server-395312671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-395312671',id=22,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyvkPZ/C5Pk5XOFxP5rMcYJVq0nGL8MEwZ1COcFqCFBcO7G74gr+o/bZOILVW3PDzyd5NY9xtWs0kgCNTm8xNQIJrW9d3YRiHEICGlxrvJ1iCAAc7YEKxcFMW7SpPA0Dw==',key_name='tempest-keypair-2093749558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a0b0a078bd44908cd7cd4593914eef',ramdisk_id='',reservation_id='r-uxg6tzfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2135577355',owner_user_name='tempest-ServerActionsTestOtherA-2135577355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:58:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22322be2dd04410b6cd53c31e639b3b',uuid=822a3afe-eae1-4960-b347-89c58fb10c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "address": "fa:16:3e:b7:e1:19", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ef27e1-e7", "ovs_interfaceid": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converting VIF {"id": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "address": "fa:16:3e:b7:e1:19", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ef27e1-e7", "ovs_interfaceid": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e1:19,bridge_name='br-int',has_traffic_filtering=True,id=a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ef27e1-e7') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG os_vif [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e1:19,bridge_name='br-int',has_traffic_filtering=True,id=a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ef27e1-e7') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8dba2890-e8b2-51e6-9634-86854b308196', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1ef27e1-e7, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1ef27e1-e7, col_values=(('qos', UUID('8e38a3fa-cb6a-4589-8cf5-a5dfb371125c')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1ef27e1-e7, col_values=(('external_ids', {'iface-id': 'a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:e1:19', 'vm-uuid': '822a3afe-eae1-4960-b347-89c58fb10c4c'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:58:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:50 user nova-compute[74611]: INFO os_vif [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e1:19,bridge_name='br-int',has_traffic_filtering=True,id=a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ef27e1-e7')
Nov 13 09:58:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] No VIF found with MAC fa:16:3e:b7:e1:19, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.909s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG nova.network.neutron [req-da4627b9-8a81-4b7a-a725-11bdd969ef6e req-c1810b4e-9873-47b7-81e1-8a6f62dbfdf6 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Updated VIF entry in instance network info cache for port a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG nova.network.neutron [req-da4627b9-8a81-4b7a-a725-11bdd969ef6e req-c1810b4e-9873-47b7-81e1-8a6f62dbfdf6 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Updating instance_info_cache with network_info: [{"id": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "address": "fa:16:3e:b7:e1:19", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ef27e1-e7", "ovs_interfaceid": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-da4627b9-8a81-4b7a-a725-11bdd969ef6e req-c1810b4e-9873-47b7-81e1-8a6f62dbfdf6 service nova] Releasing lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG nova.network.neutron [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:58:51 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG nova.policy [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aee5968a8214444f83974d536878aaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08875af299864cd9ac2d14fb5a9913fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:58:51 user nova-compute[74611]: INFO nova.virt.block_device [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Booting with volume a7437275-7b26-48c4-8727-b354462437e5 at /dev/vda
Nov 13 09:58:51 user nova-compute[74611]: DEBUG os_brick.utils [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfd67a4-9093-4381-aa93-607d222bd663]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6942e7ee-2ae8-4a00-a4b5-48643cb039ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.037s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dcd8b4-b1a7-4b5e-b277-385ee7581868]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b24e7d1-16f5-44b2-ac20-ab26de0ce281]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:58:51 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:58:51 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[615bff4c-c66a-43b3-a7af-5f62504ac060]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG os_brick.utils [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:58:51 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Updating existing volume attachment record: 1fb19a2a-b1b5-4ce8-a0b3-46c2b7d41bb5 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG nova.network.neutron [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Successfully created port: 4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG nova.network.neutron [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Successfully updated port: 4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "refresh_cache-f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquired lock "refresh_cache-f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG nova.network.neutron [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-fc38f16d-b6bc-4daa-9cbc-1f3d1a2eee8c req-fc495cc2-8b92-477b-88b0-0e514bb8d5af service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received event network-changed-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-fc38f16d-b6bc-4daa-9cbc-1f3d1a2eee8c req-fc495cc2-8b92-477b-88b0-0e514bb8d5af service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Refreshing instance network info cache due to event network-changed-4e7f5a25-370f-4d77-a8e9-b29f90a337bc. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fc38f16d-b6bc-4daa-9cbc-1f3d1a2eee8c req-fc495cc2-8b92-477b-88b0-0e514bb8d5af service nova] Acquiring lock "refresh_cache-f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-71e9c42f-ee97-43e0-8a11-12a2503089a1 req-fb846c23-5026-4bd1-9dc5-b10cef88dbdb service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Received event network-vif-plugged-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-71e9c42f-ee97-43e0-8a11-12a2503089a1 req-fb846c23-5026-4bd1-9dc5-b10cef88dbdb service nova] Acquiring lock "822a3afe-eae1-4960-b347-89c58fb10c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-71e9c42f-ee97-43e0-8a11-12a2503089a1 req-fb846c23-5026-4bd1-9dc5-b10cef88dbdb service nova] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-71e9c42f-ee97-43e0-8a11-12a2503089a1 req-fb846c23-5026-4bd1-9dc5-b10cef88dbdb service nova] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-71e9c42f-ee97-43e0-8a11-12a2503089a1 req-fb846c23-5026-4bd1-9dc5-b10cef88dbdb service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] No waiting events found dispatching network-vif-plugged-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:52 user nova-compute[74611]: WARNING nova.compute.manager [req-71e9c42f-ee97-43e0-8a11-12a2503089a1 req-fb846c23-5026-4bd1-9dc5-b10cef88dbdb service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Received unexpected event network-vif-plugged-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 for instance with vm_state building and task_state spawning.
Nov 13 09:58:52 user nova-compute[74611]: DEBUG nova.network.neutron [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:58:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:53 user nova-compute[74611]: DEBUG nova.network.neutron [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Updating instance_info_cache with network_info: [{"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:58:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Releasing lock "refresh_cache-f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:58:53 user nova-compute[74611]: DEBUG nova.compute.manager [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Instance network_info: |[{"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:58:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fc38f16d-b6bc-4daa-9cbc-1f3d1a2eee8c req-fc495cc2-8b92-477b-88b0-0e514bb8d5af service nova] Acquired lock "refresh_cache-f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:58:53 user nova-compute[74611]: DEBUG nova.network.neutron [req-fc38f16d-b6bc-4daa-9cbc-1f3d1a2eee8c req-fc495cc2-8b92-477b-88b0-0e514bb8d5af service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Refreshing network info cache for port 4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:58:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:53 user nova-compute[74611]: DEBUG nova.network.neutron [req-fc38f16d-b6bc-4daa-9cbc-1f3d1a2eee8c req-fc495cc2-8b92-477b-88b0-0e514bb8d5af service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Updated VIF entry in instance network info cache for port 4e7f5a25-370f-4d77-a8e9-b29f90a337bc. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:58:53 user nova-compute[74611]: DEBUG nova.network.neutron [req-fc38f16d-b6bc-4daa-9cbc-1f3d1a2eee8c req-fc495cc2-8b92-477b-88b0-0e514bb8d5af service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Updating instance_info_cache with network_info: [{"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:58:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fc38f16d-b6bc-4daa-9cbc-1f3d1a2eee8c req-fc495cc2-8b92-477b-88b0-0e514bb8d5af service nova] Releasing lock "refresh_cache-f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:58:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:58:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:58:54 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Instance spawned successfully.
Nov 13 09:58:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:58:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:58:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-1330d703-0382-4b5b-b447-a3e7f4ab070f req-14fc962e-e123-4c0c-9e80-0bfa10fdc703 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Received event network-vif-plugged-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1330d703-0382-4b5b-b447-a3e7f4ab070f req-14fc962e-e123-4c0c-9e80-0bfa10fdc703 service nova] Acquiring lock "822a3afe-eae1-4960-b347-89c58fb10c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1330d703-0382-4b5b-b447-a3e7f4ab070f req-14fc962e-e123-4c0c-9e80-0bfa10fdc703 service nova] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1330d703-0382-4b5b-b447-a3e7f4ab070f req-14fc962e-e123-4c0c-9e80-0bfa10fdc703 service nova] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-1330d703-0382-4b5b-b447-a3e7f4ab070f req-14fc962e-e123-4c0c-9e80-0bfa10fdc703 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] No waiting events found dispatching network-vif-plugged-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:54 user nova-compute[74611]: WARNING nova.compute.manager [req-1330d703-0382-4b5b-b447-a3e7f4ab070f req-14fc962e-e123-4c0c-9e80-0bfa10fdc703 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Received unexpected event network-vif-plugged-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 for instance with vm_state building and task_state spawning.
Nov 13 09:58:54 user nova-compute[74611]: INFO nova.compute.manager [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Took 6.58 seconds to spawn the instance on the hypervisor.
Nov 13 09:58:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:58:55 user nova-compute[74611]: INFO nova.compute.manager [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Took 8.01 seconds to build instance.
Nov 13 09:58:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5e3ceb74-2a1a-498c-af84-6e9861537fe5 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.159s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.compute.manager [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:58:56 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Creating image(s)
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Ensure instance console log exists: /opt/stack/data/nova/instances/f5cb6cf5-f915-4f50-bfc3-0112875dcfcc/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Start _get_guest_xml network_info=[{"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '1fb19a2a-b1b5-4ce8-a0b3-46c2b7d41bb5', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnbdaUNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f5cb6cf5-f915-4f50-bfc3-0112875dcfcc', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7437275-7b26-48c4-8727-b354462437e5', 'serial': 'a7437275-7b26-48c4-8727-b354462437e5'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:58:56 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:58:56 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnbdaUNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:58:56 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:58:56 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:58:56 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f14e18-6560-4f00-a67d-b216ea5faea8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:58:56 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[950667f0-5029-4070-9093-1fb78d84049a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5] added
Nov 13 09:58:56 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9a4b05-666f-4b55-8713-b699d7e19269]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eae680-26b1-4d6a-8874-8bfa6dac13dd]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnbdaUNJ {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnbdaUNJ" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[883ab309-c13c-4624-857b-5efb33af99ea]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MnbdaUNJ'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed7a190-54b0-40d9-accd-450f1b78d2f9]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4010d061-798e-40a2-8eda-3a7c1e27f71c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:58:56 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:58:56 user nova-compute[74611]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)
Nov 13 09:58:56 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:58:56 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:58:56 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:58:56 user nova-compute[74611]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)
Nov 13 09:58:56 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:58:56 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c30e78f-f586-4a19-b969-91797b6c4974]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5, portal: 172.16.0.220,3260]
Nov 13 09:58:56 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5, portal: 172.16.0.220,3260] successful.
Nov 13 09:58:56 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5849b9-4869-4d91-90f2-f540a932e95b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfffc9c-ed4c-4a2a-852b-934303906490]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:58:56 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:58:56 user nova-compute[74611]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)
Nov 13 09:58:56 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:58:56 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:58:56 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:58:56 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:58:56 user nova-compute[74611]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)
Nov 13 09:58:56 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:58:56 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:58:56 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd3aec1-2947-44b6-82a0-bda3f8b737d2]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:58:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnbdaUNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23037383163343738', 'path': '/dev/sde'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037383163343738', 'path': '/dev/sde'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-465100190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-465100190',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrNP72z9qjgl53p8K4Bq3orZH32b25sB2UyTgN3g4YZuL8kyeCNBH2NEmQXzAxuUQN/0PlafPwvEzbRPMpZH1ceGTQGF5og7k+5PrFKOPlIKNIvC13wL7dsDh6vUOEajw==',key_name='tempest-keypair-152512823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08875af299864cd9ac2d14fb5a9913fa',ramdisk_id='',reservation_id='r-i56vqppx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1007705503',owner_user_name='tempest-ServerActionsV293TestJSON-1007705503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:58:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aee5968a8214444f83974d536878aaa3',uuid=f5cb6cf5-f915-4f50-bfc3-0112875dcfcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Converting VIF {"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=4e7f5a25-370f-4d77-a8e9-b29f90a337bc,network=Network(0c40801f-e2b5-4b56-acc2-1e6d7cf133ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7f5a25-37') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG nova.objects.instance [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lazy-loading 'pci_devices' on Instance uuid f5cb6cf5-f915-4f50-bfc3-0112875dcfcc {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:58:57 user nova-compute[74611]:   <uuid>f5cb6cf5-f915-4f50-bfc3-0112875dcfcc</uuid>
Nov 13 09:58:57 user nova-compute[74611]:   <name>instance-00000017</name>
Nov 13 09:58:57 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:58:57 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:58:57 user nova-compute[74611]:   <metadata>
Nov 13 09:58:57 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:58:57 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:58:57 user nova-compute[74611]:       <nova:name>tempest-ServerActionsV293TestJSON-server-465100190</nova:name>
Nov 13 09:58:57 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:58:56</nova:creationTime>
Nov 13 09:58:57 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:58:57 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:58:57 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:58:57 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:58:57 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:58:57 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:58:57 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:58:57 user nova-compute[74611]:       <nova:owner>
Nov 13 09:58:57 user nova-compute[74611]:         <nova:user uuid="aee5968a8214444f83974d536878aaa3">tempest-ServerActionsV293TestJSON-1007705503-project-member</nova:user>
Nov 13 09:58:57 user nova-compute[74611]:         <nova:project uuid="08875af299864cd9ac2d14fb5a9913fa">tempest-ServerActionsV293TestJSON-1007705503</nova:project>
Nov 13 09:58:57 user nova-compute[74611]:       </nova:owner>
Nov 13 09:58:57 user nova-compute[74611]:       <nova:ports>
Nov 13 09:58:57 user nova-compute[74611]:         <nova:port uuid="4e7f5a25-370f-4d77-a8e9-b29f90a337bc">
Nov 13 09:58:57 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 09:58:57 user nova-compute[74611]:         </nova:port>
Nov 13 09:58:57 user nova-compute[74611]:       </nova:ports>
Nov 13 09:58:57 user nova-compute[74611]:     </nova:instance>
Nov 13 09:58:57 user nova-compute[74611]:   </metadata>
Nov 13 09:58:57 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:58:57 user nova-compute[74611]:     <system>
Nov 13 09:58:57 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:58:57 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:58:57 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:58:57 user nova-compute[74611]:       <entry name="serial">f5cb6cf5-f915-4f50-bfc3-0112875dcfcc</entry>
Nov 13 09:58:57 user nova-compute[74611]:       <entry name="uuid">f5cb6cf5-f915-4f50-bfc3-0112875dcfcc</entry>
Nov 13 09:58:57 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:58:57 user nova-compute[74611]:     </system>
Nov 13 09:58:57 user nova-compute[74611]:   </sysinfo>
Nov 13 09:58:57 user nova-compute[74611]:   <os>
Nov 13 09:58:57 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:58:57 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:58:57 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:58:57 user nova-compute[74611]:   </os>
Nov 13 09:58:57 user nova-compute[74611]:   <features>
Nov 13 09:58:57 user nova-compute[74611]:     <acpi/>
Nov 13 09:58:57 user nova-compute[74611]:     <apic/>
Nov 13 09:58:57 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:58:57 user nova-compute[74611]:   </features>
Nov 13 09:58:57 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:58:57 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:58:57 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:58:57 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:58:57 user nova-compute[74611]:   </clock>
Nov 13 09:58:57 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:58:57 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:58:57 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:58:57 user nova-compute[74611]:   </cpu>
Nov 13 09:58:57 user nova-compute[74611]:   <devices>
Nov 13 09:58:57 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 09:58:57 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:58:57 user nova-compute[74611]:       <source dev="/dev/sde"/>
Nov 13 09:58:57 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:58:57 user nova-compute[74611]:       <serial>a7437275-7b26-48c4-8727-b354462437e5</serial>
Nov 13 09:58:57 user nova-compute[74611]:     </disk>
Nov 13 09:58:57 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:58:57 user nova-compute[74611]:       <mac address="fa:16:3e:43:32:2b"/>
Nov 13 09:58:57 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:58:57 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:58:57 user nova-compute[74611]:       <target dev="tap4e7f5a25-37"/>
Nov 13 09:58:57 user nova-compute[74611]:     </interface>
Nov 13 09:58:57 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:58:57 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/f5cb6cf5-f915-4f50-bfc3-0112875dcfcc/console.log" append="off"/>
Nov 13 09:58:57 user nova-compute[74611]:     </serial>
Nov 13 09:58:57 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:58:57 user nova-compute[74611]:     <video>
Nov 13 09:58:57 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:58:57 user nova-compute[74611]:     </video>
Nov 13 09:58:57 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:58:57 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:58:57 user nova-compute[74611]:     </rng>
Nov 13 09:58:57 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:58:57 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:58:57 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:58:57 user nova-compute[74611]:     </memballoon>
Nov 13 09:58:57 user nova-compute[74611]:   </devices>
Nov 13 09:58:57 user nova-compute[74611]: </domain>
Nov 13 09:58:57 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-465100190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-465100190',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrNP72z9qjgl53p8K4Bq3orZH32b25sB2UyTgN3g4YZuL8kyeCNBH2NEmQXzAxuUQN/0PlafPwvEzbRPMpZH1ceGTQGF5og7k+5PrFKOPlIKNIvC13wL7dsDh6vUOEajw==',key_name='tempest-keypair-152512823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08875af299864cd9ac2d14fb5a9913fa',ramdisk_id='',reservation_id='r-i56vqppx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1007705503',owner_user_name='tempest-ServerActionsV293TestJSON-1007705503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:58:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aee5968a8214444f83974d536878aaa3',uuid=f5cb6cf5-f915-4f50-bfc3-0112875dcfcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Converting VIF {"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=4e7f5a25-370f-4d77-a8e9-b29f90a337bc,network=Network(0c40801f-e2b5-4b56-acc2-1e6d7cf133ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7f5a25-37') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_vif [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=4e7f5a25-370f-4d77-a8e9-b29f90a337bc,network=Network(0c40801f-e2b5-4b56-acc2-1e6d7cf133ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7f5a25-37') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92127587-c1bc-50fa-adc5-5444cfdc5fcc', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e7f5a25-37, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e7f5a25-37, col_values=(('qos', UUID('cac1d6f3-bff0-4412-9dcd-bf46bfbd4808')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e7f5a25-37, col_values=(('external_ids', {'iface-id': '4e7f5a25-370f-4d77-a8e9-b29f90a337bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:32:2b', 'vm-uuid': 'f5cb6cf5-f915-4f50-bfc3-0112875dcfcc'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:57 user nova-compute[74611]: INFO os_vif [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=4e7f5a25-370f-4d77-a8e9-b29f90a337bc,network=Network(0c40801f-e2b5-4b56-acc2-1e6d7cf133ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7f5a25-37')
Nov 13 09:58:57 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe53a1a8-de5b-4679-bddb-1da5204dbab8 is timed out.
Nov 13 09:58:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] No VIF found with MAC fa:16:3e:43:32:2b, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:58:57 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Successfully detached device vdb from instance fe53a1a8-de5b-4679-bddb-1da5204dbab8 from the live domain config.
Nov 13 09:58:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vZdiCgSt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:58:57 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[550fc6dc-954b-4e38-b069-ca3c8f732e5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 09:58:57 user nova-compute[74611]: No targets found.
Nov 13 09:58:57 user nova-compute[74611]: iSNS:
Nov 13 09:58:57 user nova-compute[74611]: No targets found.
Nov 13 09:58:57 user nova-compute[74611]: STATIC:
Nov 13 09:58:57 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963
Nov 13 09:58:57 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:58:57 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:58:57 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373
Nov 13 09:58:57 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:58:57 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:58:57 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5
Nov 13 09:58:57 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:58:57 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:58:57 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d
Nov 13 09:58:57 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:58:57 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:58:57 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 09:58:57 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:58:57 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:58:57 user nova-compute[74611]: FIRMWARE:
Nov 13 09:58:57 user nova-compute[74611]: No targets found.
Nov 13 09:58:57 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 09:58:57 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 09:58:57 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd735bca-6955-4137-9ee3-c834812f7cf3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[66308231-50e5-4573-9f0b-cb6f88d60fe5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:58:57 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:58:57 user nova-compute[74611]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)
Nov 13 09:58:57 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:58:57 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:58:57 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:58:57 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:58:57 user nova-compute[74611]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)
Nov 13 09:58:57 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:58:57 user nova-compute[74611]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d (non-flash)
Nov 13 09:58:57 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7c2b56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d'): ({'sdf'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Removing single pathed devices sdf {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.044s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1cc704-39a4-4f6e-8d63-d1e936518c9c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[48604c6f-64db-497c-9071-54945cbe139d]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Flushing IO for device /dev/sdf {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d41952a-f369-46fa-bb39-473239f69fbd]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef099f2-9d35-421b-90fa-2b4984a2f187]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] SCSI volumes sdf have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 09:58:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecccebfb-40ec-4294-a0da-1fa9277a345e]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:58:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3468d7-a7f9-46db-95c2-ae48f1607727]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d, portal: 172.16.0.220,3260]
Nov 13 09:58:58 user nova-compute[74611]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d, portal: 172.16.0.220,3260] successful.
Nov 13 09:58:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:58:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:58:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173d8837-2595-459a-bc22-8465cfabdb5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:58:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[13724bd1-145c-47d0-b322-b9ad257baf73]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:58:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:58:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:58:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] <== disconnect_volume: return (375ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:58:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 09:58:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:58:59 user nova-compute[74611]: DEBUG nova.objects.instance [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'flavor' on Instance uuid fe53a1a8-de5b-4679-bddb-1da5204dbab8 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:58:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73da41ed-eb4c-4c34-8665-61ce4b896a61 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.386s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-4221cc34-81d2-4dec-9415-a1edeecd9650 req-23acf85e-eea8-4987-a98c-d687e846255f service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received event network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:58:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4221cc34-81d2-4dec-9415-a1edeecd9650 req-23acf85e-eea8-4987-a98c-d687e846255f service nova] Acquiring lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:58:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4221cc34-81d2-4dec-9415-a1edeecd9650 req-23acf85e-eea8-4987-a98c-d687e846255f service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:58:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4221cc34-81d2-4dec-9415-a1edeecd9650 req-23acf85e-eea8-4987-a98c-d687e846255f service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:58:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-4221cc34-81d2-4dec-9415-a1edeecd9650 req-23acf85e-eea8-4987-a98c-d687e846255f service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] No waiting events found dispatching network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:58:59 user nova-compute[74611]: WARNING nova.compute.manager [req-4221cc34-81d2-4dec-9415-a1edeecd9650 req-23acf85e-eea8-4987-a98c-d687e846255f service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received unexpected event network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc for instance with vm_state building and task_state spawning.
Nov 13 09:59:00 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:00 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:00 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:01 user nova-compute[74611]: DEBUG nova.compute.manager [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:59:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:59:01 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Instance spawned successfully.
Nov 13 09:59:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:59:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:59:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:59:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:59:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:59:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:59:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:59:01 user nova-compute[74611]: INFO nova.compute.manager [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 13 09:59:01 user nova-compute[74611]: DEBUG nova.compute.manager [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:59:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-c0b574c2-44a6-4257-b504-ecd31251a8fe req-92eea7e5-788f-4606-9d90-0a584f8792a3 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received event network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:59:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c0b574c2-44a6-4257-b504-ecd31251a8fe req-92eea7e5-788f-4606-9d90-0a584f8792a3 service nova] Acquiring lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c0b574c2-44a6-4257-b504-ecd31251a8fe req-92eea7e5-788f-4606-9d90-0a584f8792a3 service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c0b574c2-44a6-4257-b504-ecd31251a8fe req-92eea7e5-788f-4606-9d90-0a584f8792a3 service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-c0b574c2-44a6-4257-b504-ecd31251a8fe req-92eea7e5-788f-4606-9d90-0a584f8792a3 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] No waiting events found dispatching network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:59:01 user nova-compute[74611]: WARNING nova.compute.manager [req-c0b574c2-44a6-4257-b504-ecd31251a8fe req-92eea7e5-788f-4606-9d90-0a584f8792a3 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received unexpected event network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc for instance with vm_state active and task_state None.
Nov 13 09:59:01 user nova-compute[74611]: INFO nova.compute.manager [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Took 11.88 seconds to build instance.
Nov 13 09:59:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8d3cde15-6f15-43ec-8911-6f85a609a4a1 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.012s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-6062e5e2-a6be-4c96-9f68-f57aec834388 req-a6e114e0-5c4f-4d34-937f-eae937fd7deb service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Received event network-changed-a49d8a46-5910-496b-a366-dbf873e81748 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:59:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-6062e5e2-a6be-4c96-9f68-f57aec834388 req-a6e114e0-5c4f-4d34-937f-eae937fd7deb service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Refreshing instance network info cache due to event network-changed-a49d8a46-5910-496b-a366-dbf873e81748. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:59:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6062e5e2-a6be-4c96-9f68-f57aec834388 req-a6e114e0-5c4f-4d34-937f-eae937fd7deb service nova] Acquiring lock "refresh_cache-4dca8fcf-5fed-4cd1-b8db-61f271b93d20" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:59:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6062e5e2-a6be-4c96-9f68-f57aec834388 req-a6e114e0-5c4f-4d34-937f-eae937fd7deb service nova] Acquired lock "refresh_cache-4dca8fcf-5fed-4cd1-b8db-61f271b93d20" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:59:12 user nova-compute[74611]: DEBUG nova.network.neutron [req-6062e5e2-a6be-4c96-9f68-f57aec834388 req-a6e114e0-5c4f-4d34-937f-eae937fd7deb service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Refreshing network info cache for port a49d8a46-5910-496b-a366-dbf873e81748 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:59:13 user nova-compute[74611]: DEBUG nova.network.neutron [req-6062e5e2-a6be-4c96-9f68-f57aec834388 req-a6e114e0-5c4f-4d34-937f-eae937fd7deb service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Updated VIF entry in instance network info cache for port a49d8a46-5910-496b-a366-dbf873e81748. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:59:13 user nova-compute[74611]: DEBUG nova.network.neutron [req-6062e5e2-a6be-4c96-9f68-f57aec834388 req-a6e114e0-5c4f-4d34-937f-eae937fd7deb service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Updating instance_info_cache with network_info: [{"id": "a49d8a46-5910-496b-a366-dbf873e81748", "address": "fa:16:3e:4f:94:ae", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49d8a46-59", "ovs_interfaceid": "a49d8a46-5910-496b-a366-dbf873e81748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:59:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6062e5e2-a6be-4c96-9f68-f57aec834388 req-a6e114e0-5c4f-4d34-937f-eae937fd7deb service nova] Releasing lock "refresh_cache-4dca8fcf-5fed-4cd1-b8db-61f271b93d20" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:59:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "bedd770b-692e-4402-8724-2b9a8434a8fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "bedd770b-692e-4402-8724-2b9a8434a8fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:18 user nova-compute[74611]: DEBUG nova.compute.manager [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 09:59:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:19 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 09:59:19 user nova-compute[74611]: INFO nova.compute.claims [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Claim successful on node user
Nov 13 09:59:19 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:59:19 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:59:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:19 user nova-compute[74611]: DEBUG nova.compute.manager [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 09:59:19 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 09:59:19 user nova-compute[74611]: DEBUG nova.compute.manager [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 09:59:19 user nova-compute[74611]: DEBUG nova.network.neutron [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 09:59:19 user nova-compute[74611]: DEBUG nova.compute.manager [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 09:59:19 user nova-compute[74611]: INFO nova.virt.block_device [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Booting with volume snapshot b94ea35f-2b81-4023-9de2-3426166a4401 at /dev/vda
Nov 13 09:59:19 user nova-compute[74611]: DEBUG nova.policy [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91e7d88000c1476abfb0df6bfca4e0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12e0c04622143f2a0c24258ab90e153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 09:59:20 user nova-compute[74611]: DEBUG nova.network.neutron [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Successfully created port: 89decc1b-05fe-40df-8378-4a68d1395b17 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 09:59:20 user nova-compute[74611]: DEBUG nova.network.neutron [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Successfully updated port: 89decc1b-05fe-40df-8378-4a68d1395b17 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 09:59:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "refresh_cache-bedd770b-692e-4402-8724-2b9a8434a8fb" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:59:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquired lock "refresh_cache-bedd770b-692e-4402-8724-2b9a8434a8fb" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:59:21 user nova-compute[74611]: DEBUG nova.network.neutron [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 09:59:21 user nova-compute[74611]: DEBUG nova.compute.manager [req-04723b00-f494-4c61-bfb0-1837d3c01552 req-6c57af9b-dc7e-4ba6-b967-5d51c9addb03 service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Received event network-changed-89decc1b-05fe-40df-8378-4a68d1395b17 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:59:21 user nova-compute[74611]: DEBUG nova.compute.manager [req-04723b00-f494-4c61-bfb0-1837d3c01552 req-6c57af9b-dc7e-4ba6-b967-5d51c9addb03 service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Refreshing instance network info cache due to event network-changed-89decc1b-05fe-40df-8378-4a68d1395b17. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:59:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-04723b00-f494-4c61-bfb0-1837d3c01552 req-6c57af9b-dc7e-4ba6-b967-5d51c9addb03 service nova] Acquiring lock "refresh_cache-bedd770b-692e-4402-8724-2b9a8434a8fb" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:59:21 user nova-compute[74611]: DEBUG nova.network.neutron [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 09:59:21 user nova-compute[74611]: DEBUG nova.network.neutron [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Updating instance_info_cache with network_info: [{"id": "89decc1b-05fe-40df-8378-4a68d1395b17", "address": "fa:16:3e:57:08:63", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89decc1b-05", "ovs_interfaceid": "89decc1b-05fe-40df-8378-4a68d1395b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:59:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Releasing lock "refresh_cache-bedd770b-692e-4402-8724-2b9a8434a8fb" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:59:21 user nova-compute[74611]: DEBUG nova.compute.manager [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Instance network_info: |[{"id": "89decc1b-05fe-40df-8378-4a68d1395b17", "address": "fa:16:3e:57:08:63", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89decc1b-05", "ovs_interfaceid": "89decc1b-05fe-40df-8378-4a68d1395b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 09:59:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-04723b00-f494-4c61-bfb0-1837d3c01552 req-6c57af9b-dc7e-4ba6-b967-5d51c9addb03 service nova] Acquired lock "refresh_cache-bedd770b-692e-4402-8724-2b9a8434a8fb" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:59:21 user nova-compute[74611]: DEBUG nova.network.neutron [req-04723b00-f494-4c61-bfb0-1837d3c01552 req-6c57af9b-dc7e-4ba6-b967-5d51c9addb03 service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Refreshing network info cache for port 89decc1b-05fe-40df-8378-4a68d1395b17 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:59:21 user nova-compute[74611]: DEBUG nova.network.neutron [req-04723b00-f494-4c61-bfb0-1837d3c01552 req-6c57af9b-dc7e-4ba6-b967-5d51c9addb03 service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Updated VIF entry in instance network info cache for port 89decc1b-05fe-40df-8378-4a68d1395b17. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:59:21 user nova-compute[74611]: DEBUG nova.network.neutron [req-04723b00-f494-4c61-bfb0-1837d3c01552 req-6c57af9b-dc7e-4ba6-b967-5d51c9addb03 service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Updating instance_info_cache with network_info: [{"id": "89decc1b-05fe-40df-8378-4a68d1395b17", "address": "fa:16:3e:57:08:63", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89decc1b-05", "ovs_interfaceid": "89decc1b-05fe-40df-8378-4a68d1395b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:59:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-04723b00-f494-4c61-bfb0-1837d3c01552 req-6c57af9b-dc7e-4ba6-b967-5d51c9addb03 service nova] Releasing lock "refresh_cache-bedd770b-692e-4402-8724-2b9a8434a8fb" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:59:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:23 user nova-compute[74611]: INFO nova.compute.manager [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Detaching volume 119a6505-bb82-4b80-b5ed-d3f7e5f53963
Nov 13 09:59:23 user nova-compute[74611]: INFO nova.virt.block_device [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Attempting to driver detach volume 119a6505-bb82-4b80-b5ed-d3f7e5f53963 from mountpoint /dev/vdc
Nov 13 09:59:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Attempting to detach device vdc from instance 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 09:59:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 09:59:23 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:59:23 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 09:59:23 user nova-compute[74611]:   <target dev="vdc" bus="virtio"/>
Nov 13 09:59:23 user nova-compute[74611]:   <serial>119a6505-bb82-4b80-b5ed-d3f7e5f53963</serial>
Nov 13 09:59:23 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 09:59:23 user nova-compute[74611]: </disk>
Nov 13 09:59:23 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:59:23 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Successfully detached device vdc from instance 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 from the persistent domain config.
Nov 13 09:59:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 09:59:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 09:59:23 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:59:23 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 09:59:23 user nova-compute[74611]:   <target dev="vdc" bus="virtio"/>
Nov 13 09:59:23 user nova-compute[74611]:   <serial>119a6505-bb82-4b80-b5ed-d3f7e5f53963</serial>
Nov 13 09:59:23 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 09:59:23 user nova-compute[74611]: </disk>
Nov 13 09:59:23 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:59:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG os_brick.utils [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[17effd72-70d6-4493-97e8-2fe45974024c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[618ff76d-d5b7-4a54-9191-975599dbf34b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f1b67b-03df-4b5a-bdf9-bc816d369829]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4fdded-99ee-44df-aea0-872967fd9778]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:59:25 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:59:25 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b4fb2d-e19b-4ea3-a7ab-01905b05d048]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG os_brick.utils [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:59:25 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Updating existing volume attachment record: e4ed658e-9362-4972-9522-a7a4e1bfdda3 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:59:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:26 user nova-compute[74611]: INFO nova.compute.manager [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Terminating instance
Nov 13 09:59:26 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 09:59:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-e8b75b48-2008-4a48-b3b2-dab4d5e53feb req-fa8292ce-6e8c-4994-b26f-b063a00301ca service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Received event network-vif-unplugged-443f1230-01cb-4e7e-8ce7-bc254e125fff {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:59:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e8b75b48-2008-4a48-b3b2-dab4d5e53feb req-fa8292ce-6e8c-4994-b26f-b063a00301ca service nova] Acquiring lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e8b75b48-2008-4a48-b3b2-dab4d5e53feb req-fa8292ce-6e8c-4994-b26f-b063a00301ca service nova] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e8b75b48-2008-4a48-b3b2-dab4d5e53feb req-fa8292ce-6e8c-4994-b26f-b063a00301ca service nova] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-e8b75b48-2008-4a48-b3b2-dab4d5e53feb req-fa8292ce-6e8c-4994-b26f-b063a00301ca service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] No waiting events found dispatching network-vif-unplugged-443f1230-01cb-4e7e-8ce7-bc254e125fff {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:59:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-e8b75b48-2008-4a48-b3b2-dab4d5e53feb req-fa8292ce-6e8c-4994-b26f-b063a00301ca service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Received event network-vif-unplugged-443f1230-01cb-4e7e-8ce7-bc254e125fff for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 09:59:27 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Instance destroyed successfully.
Nov 13 09:59:27 user nova-compute[74611]: DEBUG nova.objects.instance [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'resources' on Instance uuid fe53a1a8-de5b-4679-bddb-1da5204dbab8 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:59:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1448705948',display_name='tempest-AttachVolumeNegativeTest-server-1448705948',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1448705948',id=6,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGW9OU854oBQK0ROYe3KE2gcm4kHgQGrTKE0dXsaLlu+wZxF8g9fFfjK971IoLjoM38zWAzX1pw8eMP/ejBzam7om+EuYqwAe6KTDLJdW+eS48xv5863cBvX5WRI5dMEEg==',key_name='tempest-keypair-537423740',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:54:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1384599c1e484e54ae29b024377dbd04',ramdisk_id='',reservation_id='r-i8g823lz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1307038303',owner_user_name='tempest-AttachVolumeNegativeTest-1307038303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:54:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d93cfc3fb54b41ceb9f9657de0059043',uuid=fe53a1a8-de5b-4679-bddb-1da5204dbab8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "address": "fa:16:3e:47:f4:bd", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443f1230-01", "ovs_interfaceid": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 09:59:27 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converting VIF {"id": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "address": "fa:16:3e:47:f4:bd", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443f1230-01", "ovs_interfaceid": "443f1230-01cb-4e7e-8ce7-bc254e125fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:59:27 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:f4:bd,bridge_name='br-int',has_traffic_filtering=True,id=443f1230-01cb-4e7e-8ce7-bc254e125fff,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443f1230-01') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:59:27 user nova-compute[74611]: DEBUG os_vif [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:f4:bd,bridge_name='br-int',has_traffic_filtering=True,id=443f1230-01cb-4e7e-8ce7-bc254e125fff,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443f1230-01') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 09:59:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap443f1230-01, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:59:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de487bc8-2751-454d-864b-1a3b88430f79) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:59:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:27 user nova-compute[74611]: INFO os_vif [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:f4:bd,bridge_name='br-int',has_traffic_filtering=True,id=443f1230-01cb-4e7e-8ce7-bc254e125fff,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443f1230-01')
Nov 13 09:59:27 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Deleting instance files /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8_del
Nov 13 09:59:27 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Deletion of /opt/stack/data/nova/instances/fe53a1a8-de5b-4679-bddb-1da5204dbab8_del complete
Nov 13 09:59:27 user nova-compute[74611]: INFO nova.compute.manager [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 13 09:59:27 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 09:59:27 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 09:59:27 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 09:59:27 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:59:27 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Took 0.70 seconds to deallocate network for instance.
Nov 13 09:59:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:28 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:59:28 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:59:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:28 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Deleted allocations for instance fe53a1a8-de5b-4679-bddb-1da5204dbab8
Nov 13 09:59:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b357099c-d6c8-4eb7-af87-89a4119aa564 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.199s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-ed07f19d-d2ba-4836-aa06-ef1f174dcaaa req-b88e6983-b98c-4b2e-9749-f3ffe84947b4 service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Received event network-vif-plugged-443f1230-01cb-4e7e-8ce7-bc254e125fff {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:59:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ed07f19d-d2ba-4836-aa06-ef1f174dcaaa req-b88e6983-b98c-4b2e-9749-f3ffe84947b4 service nova] Acquiring lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ed07f19d-d2ba-4836-aa06-ef1f174dcaaa req-b88e6983-b98c-4b2e-9749-f3ffe84947b4 service nova] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ed07f19d-d2ba-4836-aa06-ef1f174dcaaa req-b88e6983-b98c-4b2e-9749-f3ffe84947b4 service nova] Lock "fe53a1a8-de5b-4679-bddb-1da5204dbab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-ed07f19d-d2ba-4836-aa06-ef1f174dcaaa req-b88e6983-b98c-4b2e-9749-f3ffe84947b4 service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] No waiting events found dispatching network-vif-plugged-443f1230-01cb-4e7e-8ce7-bc254e125fff {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:59:28 user nova-compute[74611]: WARNING nova.compute.manager [req-ed07f19d-d2ba-4836-aa06-ef1f174dcaaa req-b88e6983-b98c-4b2e-9749-f3ffe84947b4 service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Received unexpected event network-vif-plugged-443f1230-01cb-4e7e-8ce7-bc254e125fff for instance with vm_state deleted and task_state None.
Nov 13 09:59:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-ed07f19d-d2ba-4836-aa06-ef1f174dcaaa req-b88e6983-b98c-4b2e-9749-f3ffe84947b4 service nova] [instance: fe53a1a8-de5b-4679-bddb-1da5204dbab8] Received event network-vif-deleted-443f1230-01cb-4e7e-8ce7-bc254e125fff {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:59:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.compute.manager [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 09:59:29 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Creating image(s)
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Ensure instance console log exists: /opt/stack/data/nova/instances/bedd770b-692e-4402-8724-2b9a8434a8fb/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Start _get_guest_xml network_info=[{"id": "89decc1b-05fe-40df-8378-4a68d1395b17", "address": "fa:16:3e:57:08:63", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89decc1b-05", "ovs_interfaceid": "89decc1b-05fe-40df-8378-4a68d1395b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-13T09:59:14Z,direct_url=<?>,disk_format='qcow2',id=d47bcf64-bf67-4536-aa6d-5efb3b5156c9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2034533631',owner='f12e0c04622143f2a0c24258ab90e153',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-13T09:59:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'e4ed658e-9362-4972-9522-a7a4e1bfdda3', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JNbILBCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bedd770b-692e-4402-8724-2b9a8434a8fb', 'attached_at': '', 'detached_at': '', 'volume_id': '44df8ee2-15f9-450d-8616-a95f7a8a0d1c', 'serial': '44df8ee2-15f9-450d-8616-a95f7a8a0d1c'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 09:59:29 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:59:29 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-13T09:59:14Z,direct_url=<?>,disk_format='qcow2',id=d47bcf64-bf67-4536-aa6d-5efb3b5156c9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2034533631',owner='f12e0c04622143f2a0c24258ab90e153',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-13T09:59:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 09:59:29 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JNbILBCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:59:30 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:59:30 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:59:30 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6dcdd2-a3b1-4637-987c-08302a1a9b13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:59:30 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4046c14f-ad83-43fd-ba08-44d9293a7505]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c] added
Nov 13 09:59:30 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d831dc45-664d-4db6-902b-bc1495d90f10]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96dab0d-ffeb-40ce-bf13-53367b567a8f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JNbILBCv {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JNbILBCv" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad4862f-791f-424a-8134-56fcbd085d3f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JNbILBCv'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[15912c93-2195-45a9-b3a0-515d8f3f4e32]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac8b6e3-83f3-4412-94a5-03d20a359304]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:59:30 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:59:30 user nova-compute[74611]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)
Nov 13 09:59:30 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:59:30 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:59:30 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:59:30 user nova-compute[74611]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)
Nov 13 09:59:30 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:59:30 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1205c4cc-f9a9-4ee9-9cf1-96598b7e39c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c, portal: 172.16.0.220,3260]
Nov 13 09:59:30 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c, portal: 172.16.0.220,3260] successful.
Nov 13 09:59:30 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e1d242-049c-46cf-a6b1-b16afa932382]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc7a9a3-4af0-4daf-99d8-4a29cb0a777d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:59:30 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:59:30 user nova-compute[74611]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)
Nov 13 09:59:30 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:59:30 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 09:59:30 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:59:30 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:59:30 user nova-compute[74611]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)
Nov 13 09:59:30 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:59:30 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 09:59:30 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e00462c-9216-4ecd-a275-f688db352528]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:30 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: None {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JNbILBCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26263333033363062', 'path': '/dev/sdf'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263333033363062', 'path': '/dev/sdf'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1748558320',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1748558320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1748558320',id=24,image_ref='d47bcf64-bf67-4536-aa6d-5efb3b5156c9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/aqtwtX1z9yl0fbQizXkJtQY2tbnetOBwm9QbxIzeK4FmVBt21BJ9buua8rkCnRzMDQjFdwKC8xoEyj9HTdEbCdug0o6w6a1wtysTATuwR4P3EUYnHmZG+RlL5kK1F/A==',key_name='tempest-keypair-1099154900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-jh3l2zow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-633061604',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:59:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=bedd770b-692e-4402-8724-2b9a8434a8fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89decc1b-05fe-40df-8378-4a68d1395b17", "address": "fa:16:3e:57:08:63", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89decc1b-05", "ovs_interfaceid": "89decc1b-05fe-40df-8378-4a68d1395b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "89decc1b-05fe-40df-8378-4a68d1395b17", "address": "fa:16:3e:57:08:63", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89decc1b-05", "ovs_interfaceid": "89decc1b-05fe-40df-8378-4a68d1395b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:08:63,bridge_name='br-int',has_traffic_filtering=True,id=89decc1b-05fe-40df-8378-4a68d1395b17,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89decc1b-05') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG nova.objects.instance [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lazy-loading 'pci_devices' on Instance uuid bedd770b-692e-4402-8724-2b9a8434a8fb {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] End _get_guest_xml xml=<domain type="kvm">
Nov 13 09:59:31 user nova-compute[74611]:   <uuid>bedd770b-692e-4402-8724-2b9a8434a8fb</uuid>
Nov 13 09:59:31 user nova-compute[74611]:   <name>instance-00000018</name>
Nov 13 09:59:31 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 09:59:31 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 09:59:31 user nova-compute[74611]:   <metadata>
Nov 13 09:59:31 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 09:59:31 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 09:59:31 user nova-compute[74611]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1748558320</nova:name>
Nov 13 09:59:31 user nova-compute[74611]:       <nova:creationTime>2023-11-13 09:59:29</nova:creationTime>
Nov 13 09:59:31 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 09:59:31 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 09:59:31 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 09:59:31 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 09:59:31 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 09:59:31 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 09:59:31 user nova-compute[74611]:       </nova:flavor>
Nov 13 09:59:31 user nova-compute[74611]:       <nova:owner>
Nov 13 09:59:31 user nova-compute[74611]:         <nova:user uuid="91e7d88000c1476abfb0df6bfca4e0fb">tempest-TestVolumeBootPattern-633061604-project-member</nova:user>
Nov 13 09:59:31 user nova-compute[74611]:         <nova:project uuid="f12e0c04622143f2a0c24258ab90e153">tempest-TestVolumeBootPattern-633061604</nova:project>
Nov 13 09:59:31 user nova-compute[74611]:       </nova:owner>
Nov 13 09:59:31 user nova-compute[74611]:       <nova:root type="image" uuid="d47bcf64-bf67-4536-aa6d-5efb3b5156c9"/>
Nov 13 09:59:31 user nova-compute[74611]:       <nova:ports>
Nov 13 09:59:31 user nova-compute[74611]:         <nova:port uuid="89decc1b-05fe-40df-8378-4a68d1395b17">
Nov 13 09:59:31 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 09:59:31 user nova-compute[74611]:         </nova:port>
Nov 13 09:59:31 user nova-compute[74611]:       </nova:ports>
Nov 13 09:59:31 user nova-compute[74611]:     </nova:instance>
Nov 13 09:59:31 user nova-compute[74611]:   </metadata>
Nov 13 09:59:31 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 09:59:31 user nova-compute[74611]:     <system>
Nov 13 09:59:31 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 09:59:31 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 09:59:31 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 09:59:31 user nova-compute[74611]:       <entry name="serial">bedd770b-692e-4402-8724-2b9a8434a8fb</entry>
Nov 13 09:59:31 user nova-compute[74611]:       <entry name="uuid">bedd770b-692e-4402-8724-2b9a8434a8fb</entry>
Nov 13 09:59:31 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 09:59:31 user nova-compute[74611]:     </system>
Nov 13 09:59:31 user nova-compute[74611]:   </sysinfo>
Nov 13 09:59:31 user nova-compute[74611]:   <os>
Nov 13 09:59:31 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 09:59:31 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 09:59:31 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 09:59:31 user nova-compute[74611]:   </os>
Nov 13 09:59:31 user nova-compute[74611]:   <features>
Nov 13 09:59:31 user nova-compute[74611]:     <acpi/>
Nov 13 09:59:31 user nova-compute[74611]:     <apic/>
Nov 13 09:59:31 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 09:59:31 user nova-compute[74611]:   </features>
Nov 13 09:59:31 user nova-compute[74611]:   <clock offset="utc">
Nov 13 09:59:31 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 09:59:31 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 09:59:31 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 09:59:31 user nova-compute[74611]:   </clock>
Nov 13 09:59:31 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 09:59:31 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 09:59:31 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 09:59:31 user nova-compute[74611]:   </cpu>
Nov 13 09:59:31 user nova-compute[74611]:   <devices>
Nov 13 09:59:31 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 09:59:31 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:59:31 user nova-compute[74611]:       <source dev="/dev/sdf"/>
Nov 13 09:59:31 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 09:59:31 user nova-compute[74611]:       <serial>44df8ee2-15f9-450d-8616-a95f7a8a0d1c</serial>
Nov 13 09:59:31 user nova-compute[74611]:     </disk>
Nov 13 09:59:31 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 09:59:31 user nova-compute[74611]:       <mac address="fa:16:3e:57:08:63"/>
Nov 13 09:59:31 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:59:31 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 09:59:31 user nova-compute[74611]:       <target dev="tap89decc1b-05"/>
Nov 13 09:59:31 user nova-compute[74611]:     </interface>
Nov 13 09:59:31 user nova-compute[74611]:     <serial type="pty">
Nov 13 09:59:31 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/bedd770b-692e-4402-8724-2b9a8434a8fb/console.log" append="off"/>
Nov 13 09:59:31 user nova-compute[74611]:     </serial>
Nov 13 09:59:31 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 09:59:31 user nova-compute[74611]:     <video>
Nov 13 09:59:31 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 09:59:31 user nova-compute[74611]:     </video>
Nov 13 09:59:31 user nova-compute[74611]:     <rng model="virtio">
Nov 13 09:59:31 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 09:59:31 user nova-compute[74611]:     </rng>
Nov 13 09:59:31 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 09:59:31 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 09:59:31 user nova-compute[74611]:       <stats period="10"/>
Nov 13 09:59:31 user nova-compute[74611]:     </memballoon>
Nov 13 09:59:31 user nova-compute[74611]:   </devices>
Nov 13 09:59:31 user nova-compute[74611]: </domain>
Nov 13 09:59:31 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1748558320',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1748558320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1748558320',id=24,image_ref='d47bcf64-bf67-4536-aa6d-5efb3b5156c9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/aqtwtX1z9yl0fbQizXkJtQY2tbnetOBwm9QbxIzeK4FmVBt21BJ9buua8rkCnRzMDQjFdwKC8xoEyj9HTdEbCdug0o6w6a1wtysTATuwR4P3EUYnHmZG+RlL5kK1F/A==',key_name='tempest-keypair-1099154900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-jh3l2zow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-633061604',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:59:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=bedd770b-692e-4402-8724-2b9a8434a8fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89decc1b-05fe-40df-8378-4a68d1395b17", "address": "fa:16:3e:57:08:63", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89decc1b-05", "ovs_interfaceid": "89decc1b-05fe-40df-8378-4a68d1395b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "89decc1b-05fe-40df-8378-4a68d1395b17", "address": "fa:16:3e:57:08:63", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89decc1b-05", "ovs_interfaceid": "89decc1b-05fe-40df-8378-4a68d1395b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:08:63,bridge_name='br-int',has_traffic_filtering=True,id=89decc1b-05fe-40df-8378-4a68d1395b17,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89decc1b-05') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG os_vif [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:08:63,bridge_name='br-int',has_traffic_filtering=True,id=89decc1b-05fe-40df-8378-4a68d1395b17,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89decc1b-05') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a474465-ed31-5d46-9567-78cf378c9d05', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89decc1b-05, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89decc1b-05, col_values=(('qos', UUID('b670ee81-0c5e-4761-9434-8ddfdbae333f')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89decc1b-05, col_values=(('external_ids', {'iface-id': '89decc1b-05fe-40df-8378-4a68d1395b17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:08:63', 'vm-uuid': 'bedd770b-692e-4402-8724-2b9a8434a8fb'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:31 user nova-compute[74611]: INFO os_vif [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:08:63,bridge_name='br-int',has_traffic_filtering=True,id=89decc1b-05fe-40df-8378-4a68d1395b17,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89decc1b-05')
Nov 13 09:59:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:59:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] No VIF found with MAC fa:16:3e:57:08:63, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:59:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-4ca834c6-a498-4ec2-98bf-daa8c5e833ef req-46f15a26-ecb6-4a78-ac3d-0a444726c79a service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Received event network-vif-plugged-89decc1b-05fe-40df-8378-4a68d1395b17 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:59:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4ca834c6-a498-4ec2-98bf-daa8c5e833ef req-46f15a26-ecb6-4a78-ac3d-0a444726c79a service nova] Acquiring lock "bedd770b-692e-4402-8724-2b9a8434a8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4ca834c6-a498-4ec2-98bf-daa8c5e833ef req-46f15a26-ecb6-4a78-ac3d-0a444726c79a service nova] Lock "bedd770b-692e-4402-8724-2b9a8434a8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4ca834c6-a498-4ec2-98bf-daa8c5e833ef req-46f15a26-ecb6-4a78-ac3d-0a444726c79a service nova] Lock "bedd770b-692e-4402-8724-2b9a8434a8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-4ca834c6-a498-4ec2-98bf-daa8c5e833ef req-46f15a26-ecb6-4a78-ac3d-0a444726c79a service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] No waiting events found dispatching network-vif-plugged-89decc1b-05fe-40df-8378-4a68d1395b17 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:59:32 user nova-compute[74611]: WARNING nova.compute.manager [req-4ca834c6-a498-4ec2-98bf-daa8c5e833ef req-46f15a26-ecb6-4a78-ac3d-0a444726c79a service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Received unexpected event network-vif-plugged-89decc1b-05fe-40df-8378-4a68d1395b17 for instance with vm_state building and task_state spawning.
Nov 13 09:59:33 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:59:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 09:59:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] There are 0 instances to clean {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 09:59:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 09:59:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 09:59:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Instance spawned successfully.
Nov 13 09:59:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 09:59:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:59:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 09:59:34 user nova-compute[74611]: INFO nova.compute.manager [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 13 09:59:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:59:35 user nova-compute[74611]: INFO nova.compute.manager [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Took 16.01 seconds to build instance.
Nov 13 09:59:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-85696ab7-6b4a-4d7f-a41f-4ea43744fccf req-a0639de1-a8e4-4626-8268-9699611769bd service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Received event network-vif-plugged-89decc1b-05fe-40df-8378-4a68d1395b17 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:59:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-85696ab7-6b4a-4d7f-a41f-4ea43744fccf req-a0639de1-a8e4-4626-8268-9699611769bd service nova] Acquiring lock "bedd770b-692e-4402-8724-2b9a8434a8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-85696ab7-6b4a-4d7f-a41f-4ea43744fccf req-a0639de1-a8e4-4626-8268-9699611769bd service nova] Lock "bedd770b-692e-4402-8724-2b9a8434a8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-85696ab7-6b4a-4d7f-a41f-4ea43744fccf req-a0639de1-a8e4-4626-8268-9699611769bd service nova] Lock "bedd770b-692e-4402-8724-2b9a8434a8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-85696ab7-6b4a-4d7f-a41f-4ea43744fccf req-a0639de1-a8e4-4626-8268-9699611769bd service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] No waiting events found dispatching network-vif-plugged-89decc1b-05fe-40df-8378-4a68d1395b17 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:59:35 user nova-compute[74611]: WARNING nova.compute.manager [req-85696ab7-6b4a-4d7f-a41f-4ea43744fccf req-a0639de1-a8e4-4626-8268-9699611769bd service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Received unexpected event network-vif-plugged-89decc1b-05fe-40df-8378-4a68d1395b17 for instance with vm_state active and task_state None.
Nov 13 09:59:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05d86417-5050-4129-9c3d-e5eb6de54d20 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "bedd770b-692e-4402-8724-2b9a8434a8fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.114s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:36 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:59:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:37 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:59:37 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 09:59:37 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Didn't find any instances for network info cache update. {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 09:59:38 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:59:39 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:59:41 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:59:41 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 09:59:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:42 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:59:42 user nova-compute[74611]: DEBUG nova.compute.manager [req-2021ca3b-adf3-4fef-9473-95ead4704a1c req-0e2793b1-b22c-4606-9a95-f71ad3d20f16 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received event network-changed-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:59:42 user nova-compute[74611]: DEBUG nova.compute.manager [req-2021ca3b-adf3-4fef-9473-95ead4704a1c req-0e2793b1-b22c-4606-9a95-f71ad3d20f16 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Refreshing instance network info cache due to event network-changed-16c3fba0-6005-4fd4-a1b9-005df1f6771b. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:59:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2021ca3b-adf3-4fef-9473-95ead4704a1c req-0e2793b1-b22c-4606-9a95-f71ad3d20f16 service nova] Acquiring lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:59:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2021ca3b-adf3-4fef-9473-95ead4704a1c req-0e2793b1-b22c-4606-9a95-f71ad3d20f16 service nova] Acquired lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:59:42 user nova-compute[74611]: DEBUG nova.network.neutron [req-2021ca3b-adf3-4fef-9473-95ead4704a1c req-0e2793b1-b22c-4606-9a95-f71ad3d20f16 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Refreshing network info cache for port 16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:59:42 user nova-compute[74611]: DEBUG nova.network.neutron [req-2021ca3b-adf3-4fef-9473-95ead4704a1c req-0e2793b1-b22c-4606-9a95-f71ad3d20f16 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Updated VIF entry in instance network info cache for port 16c3fba0-6005-4fd4-a1b9-005df1f6771b. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:59:42 user nova-compute[74611]: DEBUG nova.network.neutron [req-2021ca3b-adf3-4fef-9473-95ead4704a1c req-0e2793b1-b22c-4606-9a95-f71ad3d20f16 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Updating instance_info_cache with network_info: [{"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:59:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2021ca3b-adf3-4fef-9473-95ead4704a1c req-0e2793b1-b22c-4606-9a95-f71ad3d20f16 service nova] Releasing lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:59:43 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:59:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:44 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 is timed out.
Nov 13 09:59:44 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Successfully detached device vdc from instance 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 from the live domain config.
Nov 13 09:59:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKZbWlas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:59:44 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc82183-39f9-4f65-9212-34f55caac703]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 09:59:44 user nova-compute[74611]: No targets found.
Nov 13 09:59:44 user nova-compute[74611]: iSNS:
Nov 13 09:59:44 user nova-compute[74611]: No targets found.
Nov 13 09:59:44 user nova-compute[74611]: STATIC:
Nov 13 09:59:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963
Nov 13 09:59:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:59:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:59:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373
Nov 13 09:59:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:59:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:59:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5
Nov 13 09:59:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:59:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:59:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c
Nov 13 09:59:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:59:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:59:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 09:59:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 09:59:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 09:59:44 user nova-compute[74611]: FIRMWARE:
Nov 13 09:59:44 user nova-compute[74611]: No targets found.
Nov 13 09:59:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 09:59:44 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 09:59:44 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[61796b08-3538-41a1-a89b-1f4b0ffe886f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[da881df1-ae18-4667-92d6-e276d1301d4a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:59:44 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:59:44 user nova-compute[74611]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)
Nov 13 09:59:44 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:59:44 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 09:59:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:59:44 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:59:44 user nova-compute[74611]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 (non-flash)
Nov 13 09:59:44 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:59:44 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 09:59:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb84193be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d61f55-935e-46b2-9f90-cb0bdaa1757d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4527932-f337-4d01-9eff-1c971ae86914]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec247c2-903e-4817-a111-263d5d097bd9]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8879290-420c-42bb-9d26-0ab7ed9d347e]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfe654f-7659-4970-a930-0cc0388bf98f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0c0d15-15ec-4e6f-87c4-1015879ef511]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963, portal: 172.16.0.220,3260]
Nov 13 09:59:44 user nova-compute[74611]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963, portal: 172.16.0.220,3260] successful.
Nov 13 09:59:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6505-bb82-4b80-b5ed-d3f7e5f53963 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[224bdecb-e5f2-485d-b1d9-0f712061776c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] <== disconnect_volume: return (379ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG nova.objects.instance [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'flavor' on Instance uuid 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG nova.objects.instance [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'flavor' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b7128a8f-41c7-4c59-8007-6b24075042d8 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.764s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:45 user nova-compute[74611]: INFO nova.compute.manager [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Attaching volume 921d5d4b-260c-4d54-80c6-24610845e425 to /dev/vdb
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG os_brick.utils [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e96668-c7bf-48bb-8029-b28e0bd119ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a080c4cc-24e4-4ac8-9702-5a533d7125f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0184719-b2d5-48b4-a28c-9b2a1879acdc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1037b126-a3bd-40c2-afac-9a060fbc2d04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:59:45 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2722d37-085d-4d6d-81e1-af9b6e710cf0]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG os_brick.utils [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Updating existing volume attachment record: 6c06eed6-6e3c-43fe-be13-b8b8c5027afc {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG nova.compute.manager [req-317f5737-2ef8-4a3f-b331-185b24807272 req-5d2bf8c4-95a5-4b9c-859a-d5f75c5a7281 service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Received event network-changed-c33be124-9528-4fb1-8fbe-9fc2d55395b8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG nova.compute.manager [req-317f5737-2ef8-4a3f-b331-185b24807272 req-5d2bf8c4-95a5-4b9c-859a-d5f75c5a7281 service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Refreshing instance network info cache due to event network-changed-c33be124-9528-4fb1-8fbe-9fc2d55395b8. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-317f5737-2ef8-4a3f-b331-185b24807272 req-5d2bf8c4-95a5-4b9c-859a-d5f75c5a7281 service nova] Acquiring lock "refresh_cache-4970bd6b-69a6-479c-9f5f-bc5fc6021407" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-317f5737-2ef8-4a3f-b331-185b24807272 req-5d2bf8c4-95a5-4b9c-859a-d5f75c5a7281 service nova] Acquired lock "refresh_cache-4970bd6b-69a6-479c-9f5f-bc5fc6021407" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG nova.network.neutron [req-317f5737-2ef8-4a3f-b331-185b24807272 req-5d2bf8c4-95a5-4b9c-859a-d5f75c5a7281 service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Refreshing network info cache for port c33be124-9528-4fb1-8fbe-9fc2d55395b8 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG nova.network.neutron [req-317f5737-2ef8-4a3f-b331-185b24807272 req-5d2bf8c4-95a5-4b9c-859a-d5f75c5a7281 service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Updated VIF entry in instance network info cache for port c33be124-9528-4fb1-8fbe-9fc2d55395b8. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG nova.network.neutron [req-317f5737-2ef8-4a3f-b331-185b24807272 req-5d2bf8c4-95a5-4b9c-859a-d5f75c5a7281 service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Updating instance_info_cache with network_info: [{"id": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "address": "fa:16:3e:29:ae:2e", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33be124-95", "ovs_interfaceid": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-317f5737-2ef8-4a3f-b331-185b24807272 req-5d2bf8c4-95a5-4b9c-859a-d5f75c5a7281 service nova] Releasing lock "refresh_cache-4970bd6b-69a6-479c-9f5f-bc5fc6021407" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG nova.objects.instance [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lazy-loading 'flavor' on Instance uuid 4970bd6b-69a6-479c-9f5f-bc5fc6021407 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:48 user nova-compute[74611]: INFO nova.compute.manager [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Attaching volume 38a51496-255d-4582-ac29-c13290f558d4 to /dev/vdb
Nov 13 09:59:48 user nova-compute[74611]: DEBUG os_brick.utils [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0a9bfd-4239-4d50-9529-61171a78ccef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a213b4-4f2f-4bf3-ba31-516235464c13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3667f5-21b0-4b84-a74d-961574478699]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[00401e9c-2704-410f-b4ec-395adbaa9034]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 09:59:48 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[429819f7-16d5-45bb-b873-4548331da293]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG os_brick.utils [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Updating existing volume attachment record: a2fbc437-4346-45cf-ac8e-9bffd9b66219 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 09:59:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtITMiZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:59:50 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:59:50 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:59:50 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:59:50 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:59:50 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=6631MB free_disk=25.24053192138672GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb91687-afb5-4f8e-9444-644cc13543c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:59:50 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[834dd602-2f7c-4f8f-8d81-11f4cbdae8d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425] added
Nov 13 09:59:50 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e44999-0170-4d02-af08-56cb23b778df]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d123c49-e1fd-4ea6-95ae-136443cb9c5b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtITMiZe {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtITMiZe" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3512e655-8f97-4d13-835f-6d60e216c9c5]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OtITMiZe'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd3a104-2e9b-49f9-8126-0117e1809b01]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc39782c-5479-476e-92c7-113400e9341b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:59:50 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:59:50 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:59:50 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 09:59:50 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:59:50 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:59:50 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:59:50 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 09:59:50 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4513f7c-1a40-45fa-9f19-7086bcf4fe4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425, portal: 172.16.0.220,3260]
Nov 13 09:59:50 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425, portal: 172.16.0.220,3260] successful.
Nov 13 09:59:50 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 85cb3adb-b2b3-49ec-92ab-c2b7a028241a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 1c66c8a8-abb5-4f60-8464-074627c213d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 89038547-5416-4942-8070-dd5dd8e4b6c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4dca8fcf-5fed-4cd1-b8db-61f271b93d20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance e99e1557-500f-407e-aefc-3b5cde9ceba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4970bd6b-69a6-479c-9f5f-bc5fc6021407 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance b1913235-682f-486a-8b35-f917c3664eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 635636ea-96a0-4fdb-85a1-ca7a87b762f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f5cb6cf5-f915-4f50-bfc3-0112875dcfcc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance bedd770b-692e-4402-8724-2b9a8434a8fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f22437-6116-41f1-a12b-476e1d08c592]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing inventories for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[95da9435-122e-4db7-8258-183a40664ab8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:59:50 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:59:50 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:59:50 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 09:59:50 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 09:59:50 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:59:50 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:59:50 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:59:50 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 09:59:50 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 09:59:50 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating ProviderTree inventory for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating inventory in ProviderTree for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf2332c-b2b5-4fe8-a2cc-555f3e3e2b5d]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtITMiZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing aggregate associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, aggregates: None {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 09:59:50 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing trait associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 09:59:51 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 09:59:51 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 09:59:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 09:59:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.854s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 09:59:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74611) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 09:59:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:51 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:59:51 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23334636132643361', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:59:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334636132643361', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:59:51 user nova-compute[74611]: DEBUG nova.objects.instance [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'flavor' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:59:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 09:59:51 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:59:51 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 09:59:51 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:59:51 user nova-compute[74611]:   <serial>921d5d4b-260c-4d54-80c6-24610845e425</serial>
Nov 13 09:59:51 user nova-compute[74611]: </disk>
Nov 13 09:59:51 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] No VIF found with MAC fa:16:3e:e0:90:1a, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c3ca1eee-5ac8-4b90-926e-36432451e576 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.778s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxmeKXhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 09:59:52 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:59:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:59:52 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 09:59:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 09:59:52 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b08842c-6046-4739-874a-11e2af428ee1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 09:59:52 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cfc620-5506-4f9e-a825-ddddc5211af4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4] added
Nov 13 09:59:52 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e21b118-4442-4acd-800d-4301c94a3a9b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa41aa41-44f5-49dd-a7c8-91758cf220ec]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OxmeKXhy {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OxmeKXhy" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bf2fcd-26c1-49fb-b459-0aaf7a5420f6]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OxmeKXhy'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef321d5-dd82-4d74-a81b-046a05bb7801]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff5e0ed-5cb0-4780-9964-1bbcee2d8a15]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:59:52 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:59:52 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:59:52 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 09:59:52 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 09:59:52 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:59:52 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:59:52 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:59:52 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 09:59:52 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 09:59:52 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4479d6-281e-4417-9f69-2b5f3bc8c1cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4, portal: 172.16.0.220,3260]
Nov 13 09:59:52 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4, portal: 172.16.0.220,3260] successful.
Nov 13 09:59:52 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b930d4cf-1b8d-4362-a1ef-e041880164e8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 09:59:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a28285f-c927-40dd-a5ac-8e2db2ca6838]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:59:53 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:59:53 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:59:53 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 09:59:53 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 09:59:53 user nova-compute[74611]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 (non-flash)
Nov 13 09:59:53 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 09:59:53 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 09:59:53 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 09:59:53 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 09:59:53 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 09:59:53 user nova-compute[74611]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 (non-flash)
Nov 13 09:59:53 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[999f23e6-e94c-4a81-8720-d17d6095a4a7]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: None {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7082d590-0a41-441e-8648-c4d9673e5010 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7082d590-0a41-441e-8648-c4d9673e5010 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7082d590-0a41-441e-8648-c4d9673e5010 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7082d590-0a41-441e-8648-c4d9673e5010 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74611) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG nova.objects.instance [None req-7082d590-0a41-441e-8648-c4d9673e5010 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'flavor' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG nova.compute.manager [req-b14ce493-bc6b-4095-827e-22ff5562a3a4 req-85d995c9-af7a-49db-854d-7fb61ecc4378 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received event network-vif-unplugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b14ce493-bc6b-4095-827e-22ff5562a3a4 req-85d995c9-af7a-49db-854d-7fb61ecc4378 service nova] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b14ce493-bc6b-4095-827e-22ff5562a3a4 req-85d995c9-af7a-49db-854d-7fb61ecc4378 service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b14ce493-bc6b-4095-827e-22ff5562a3a4 req-85d995c9-af7a-49db-854d-7fb61ecc4378 service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:53 user nova-compute[74611]: DEBUG nova.compute.manager [req-b14ce493-bc6b-4095-827e-22ff5562a3a4 req-85d995c9-af7a-49db-854d-7fb61ecc4378 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] No waiting events found dispatching network-vif-unplugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:59:53 user nova-compute[74611]: WARNING nova.compute.manager [req-b14ce493-bc6b-4095-827e-22ff5562a3a4 req-85d995c9-af7a-49db-854d-7fb61ecc4378 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received unexpected event network-vif-unplugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b for instance with vm_state active and task_state powering-off.
Nov 13 09:59:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:53 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Instance destroyed successfully.
Nov 13 09:59:53 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7082d590-0a41-441e-8648-c4d9673e5010 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 09:59:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7082d590-0a41-441e-8648-c4d9673e5010 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.840s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:54 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 09:59:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxmeKXhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 09:59:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 09:59:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23038303465333835', 'path': '/dev/sdg'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 09:59:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038303465333835', 'path': '/dev/sdg'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 09:59:54 user nova-compute[74611]: DEBUG nova.objects.instance [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lazy-loading 'flavor' on Instance uuid 4970bd6b-69a6-479c-9f5f-bc5fc6021407 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 09:59:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 09:59:54 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:59:54 user nova-compute[74611]:   <source dev="/dev/sdg"/>
Nov 13 09:59:54 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:59:54 user nova-compute[74611]:   <serial>38a51496-255d-4582-ac29-c13290f558d4</serial>
Nov 13 09:59:54 user nova-compute[74611]: </disk>
Nov 13 09:59:54 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 09:59:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:59:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 09:59:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] No VIF found with MAC fa:16:3e:29:ae:2e, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 09:59:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9cb9ba82-7245-472e-a1ee-7fc0c19d7bec tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.152s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:55 user nova-compute[74611]: INFO nova.compute.manager [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Detaching volume 38a51496-255d-4582-ac29-c13290f558d4
Nov 13 09:59:55 user nova-compute[74611]: INFO nova.virt.block_device [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Attempting to driver detach volume 38a51496-255d-4582-ac29-c13290f558d4 from mountpoint /dev/vdb
Nov 13 09:59:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Attempting to detach device vdb from instance 4970bd6b-69a6-479c-9f5f-bc5fc6021407 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 09:59:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 09:59:55 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:59:55 user nova-compute[74611]:   <source dev="/dev/sdg"/>
Nov 13 09:59:55 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:59:55 user nova-compute[74611]:   <serial>38a51496-255d-4582-ac29-c13290f558d4</serial>
Nov 13 09:59:55 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 09:59:55 user nova-compute[74611]: </disk>
Nov 13 09:59:55 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:59:55 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Successfully detached device vdb from instance 4970bd6b-69a6-479c-9f5f-bc5fc6021407 from the persistent domain config.
Nov 13 09:59:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4970bd6b-69a6-479c-9f5f-bc5fc6021407 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 09:59:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 09:59:55 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 09:59:55 user nova-compute[74611]:   <source dev="/dev/sdg"/>
Nov 13 09:59:55 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 09:59:55 user nova-compute[74611]:   <serial>38a51496-255d-4582-ac29-c13290f558d4</serial>
Nov 13 09:59:55 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 09:59:55 user nova-compute[74611]: </disk>
Nov 13 09:59:55 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 09:59:55 user nova-compute[74611]: DEBUG nova.compute.manager [req-df534a7d-b536-4aca-ad23-607773580085 req-295811ac-0e1c-43b5-b9f2-8b695b243286 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 09:59:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-df534a7d-b536-4aca-ad23-607773580085 req-295811ac-0e1c-43b5-b9f2-8b695b243286 service nova] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 09:59:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-df534a7d-b536-4aca-ad23-607773580085 req-295811ac-0e1c-43b5-b9f2-8b695b243286 service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 09:59:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-df534a7d-b536-4aca-ad23-607773580085 req-295811ac-0e1c-43b5-b9f2-8b695b243286 service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 09:59:55 user nova-compute[74611]: DEBUG nova.compute.manager [req-df534a7d-b536-4aca-ad23-607773580085 req-295811ac-0e1c-43b5-b9f2-8b695b243286 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] No waiting events found dispatching network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 09:59:55 user nova-compute[74611]: WARNING nova.compute.manager [req-df534a7d-b536-4aca-ad23-607773580085 req-295811ac-0e1c-43b5-b9f2-8b695b243286 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received unexpected event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b for instance with vm_state stopped and task_state None.
Nov 13 09:59:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4970bd6b-69a6-479c-9f5f-bc5fc6021407 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 09:59:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 09:59:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-fd4e2886-f86d-4bd2-b70b-8bc51123861a req-ab332fbc-d4f5-4b4a-8219-2159aedfb200 service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Received event network-changed-c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-fd4e2886-f86d-4bd2-b70b-8bc51123861a req-ab332fbc-d4f5-4b4a-8219-2159aedfb200 service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Refreshing instance network info cache due to event network-changed-c2603a51-b07e-4040-b759-d8748ebd5fdc. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:00:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fd4e2886-f86d-4bd2-b70b-8bc51123861a req-ab332fbc-d4f5-4b4a-8219-2159aedfb200 service nova] Acquiring lock "refresh_cache-b1913235-682f-486a-8b35-f917c3664eec" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:00:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fd4e2886-f86d-4bd2-b70b-8bc51123861a req-ab332fbc-d4f5-4b4a-8219-2159aedfb200 service nova] Acquired lock "refresh_cache-b1913235-682f-486a-8b35-f917c3664eec" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:00:11 user nova-compute[74611]: DEBUG nova.network.neutron [req-fd4e2886-f86d-4bd2-b70b-8bc51123861a req-ab332fbc-d4f5-4b4a-8219-2159aedfb200 service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Refreshing network info cache for port c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:00:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "b1913235-682f-486a-8b35-f917c3664eec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "b1913235-682f-486a-8b35-f917c3664eec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:11 user nova-compute[74611]: DEBUG nova.objects.instance [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lazy-loading 'flavor' on Instance uuid b1913235-682f-486a-8b35-f917c3664eec {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "b1913235-682f-486a-8b35-f917c3664eec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "b1913235-682f-486a-8b35-f917c3664eec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "b1913235-682f-486a-8b35-f917c3664eec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:12 user nova-compute[74611]: INFO nova.compute.manager [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Attaching volume e2dde92b-2f6f-4253-b842-40403946e1ef to /dev/vdb
Nov 13 10:00:12 user nova-compute[74611]: DEBUG nova.network.neutron [req-fd4e2886-f86d-4bd2-b70b-8bc51123861a req-ab332fbc-d4f5-4b4a-8219-2159aedfb200 service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Updated VIF entry in instance network info cache for port c2603a51-b07e-4040-b759-d8748ebd5fdc. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG nova.network.neutron [req-fd4e2886-f86d-4bd2-b70b-8bc51123861a req-ab332fbc-d4f5-4b4a-8219-2159aedfb200 service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Updating instance_info_cache with network_info: [{"id": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "address": "fa:16:3e:14:c0:79", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2603a51-b0", "ovs_interfaceid": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG os_brick.utils [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fd4e2886-f86d-4bd2-b70b-8bc51123861a req-ab332fbc-d4f5-4b4a-8219-2159aedfb200 service nova] Releasing lock "refresh_cache-b1913235-682f-486a-8b35-f917c3664eec" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53071f7-35b4-4b05-89bd-c010de90a089]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1964d6-04da-4048-b228-73ac6777121c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8d4aef-4c7c-4f1e-83d5-ce775508845c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33816f7-d2cf-45af-bb79-8e18b856ec8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:00:12 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:00:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9360b15-c73e-4fa9-8099-97886a6137ba]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG os_brick.utils [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:00:12 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Updating existing volume attachment record: e8a2184d-623f-4491-91b5-74d116d3e408 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:00:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:13 user nova-compute[74611]: INFO nova.compute.manager [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Terminating instance
Nov 13 10:00:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:00:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-09c1fb96-1ce9-4bf4-b2c8-f539d99327b6 req-43479a48-abb9-4f57-af20-f12511628584 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received event network-vif-unplugged-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-09c1fb96-1ce9-4bf4-b2c8-f539d99327b6 req-43479a48-abb9-4f57-af20-f12511628584 service nova] Acquiring lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-09c1fb96-1ce9-4bf4-b2c8-f539d99327b6 req-43479a48-abb9-4f57-af20-f12511628584 service nova] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-09c1fb96-1ce9-4bf4-b2c8-f539d99327b6 req-43479a48-abb9-4f57-af20-f12511628584 service nova] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-09c1fb96-1ce9-4bf4-b2c8-f539d99327b6 req-43479a48-abb9-4f57-af20-f12511628584 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] No waiting events found dispatching network-vif-unplugged-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-09c1fb96-1ce9-4bf4-b2c8-f539d99327b6 req-43479a48-abb9-4f57-af20-f12511628584 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received event network-vif-unplugged-e730080f-c599-449b-b366-a642be4f9ac7 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:14 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Instance destroyed successfully.
Nov 13 10:00:14 user nova-compute[74611]: DEBUG nova.objects.instance [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'resources' on Instance uuid 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T09:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-610781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-610781',id=5,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsTret5b3iXWCuFDtJbfayGvRYlI07teJzdTCJFhqHq6mblu7HCq3e+QCXP3zDlNZ1sgvWyIl5dD63UFzJqtDj1HFz9fXZTyR+iHl22i4km+t7rGy8XkpvMx9Gjduo9mw==',key_name='tempest-keypair-1489015223',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:57:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5a6f570a7e7404680bd5809be8b0378',ramdisk_id='',reservation_id='r-yu0u8g36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-55203260',owner_user_name='tempest-AttachVolumeShelveTestJSON-55203260-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:57:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008616dff48b4bdeb2ea0f2be72a2934',uuid=8cdb9561-3b40-44cc-abf7-2cbff7e60a17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converting VIF {"id": "e730080f-c599-449b-b366-a642be4f9ac7", "address": "fa:16:3e:c0:96:5e", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape730080f-c5", "ovs_interfaceid": "e730080f-c599-449b-b366-a642be4f9ac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:96:5e,bridge_name='br-int',has_traffic_filtering=True,id=e730080f-c599-449b-b366-a642be4f9ac7,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape730080f-c5') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG os_vif [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:96:5e,bridge_name='br-int',has_traffic_filtering=True,id=e730080f-c599-449b-b366-a642be4f9ac7,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape730080f-c5') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape730080f-c5, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cf1be04-45e9-411b-87a5-8e58d04efd9c) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:14 user nova-compute[74611]: INFO os_vif [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:96:5e,bridge_name='br-int',has_traffic_filtering=True,id=e730080f-c599-449b-b366-a642be4f9ac7,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape730080f-c5')
Nov 13 10:00:14 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Deleting instance files /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17_del
Nov 13 10:00:14 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Deletion of /opt/stack/data/nova/instances/8cdb9561-3b40-44cc-abf7-2cbff7e60a17_del complete
Nov 13 10:00:14 user nova-compute[74611]: INFO nova.compute.manager [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 13 10:00:14 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:00:14 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:00:15 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:00:15 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Took 0.64 seconds to deallocate network for instance.
Nov 13 10:00:15 user nova-compute[74611]: DEBUG nova.compute.manager [req-1df86341-5c5a-4c06-b0eb-b1d52fd9224b req-d9196158-c65b-428a-bdc2-6bcd57b12fa2 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received event network-vif-deleted-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:15 user nova-compute[74611]: INFO nova.compute.manager [req-1df86341-5c5a-4c06-b0eb-b1d52fd9224b req-d9196158-c65b-428a-bdc2-6bcd57b12fa2 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Neutron deleted interface e730080f-c599-449b-b366-a642be4f9ac7; detaching it from the instance and deleting it from the info cache
Nov 13 10:00:15 user nova-compute[74611]: DEBUG nova.network.neutron [req-1df86341-5c5a-4c06-b0eb-b1d52fd9224b req-d9196158-c65b-428a-bdc2-6bcd57b12fa2 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:00:15 user nova-compute[74611]: DEBUG nova.compute.manager [req-1df86341-5c5a-4c06-b0eb-b1d52fd9224b req-d9196158-c65b-428a-bdc2-6bcd57b12fa2 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Detach interface failed, port_id=e730080f-c599-449b-b366-a642be4f9ac7, reason: Instance 8cdb9561-3b40-44cc-abf7-2cbff7e60a17 could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 10:00:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:15 user nova-compute[74611]: INFO nova.compute.manager [None req-49ef1628-9bb1-42e5-a20d-9e8c0fcaa14c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Unrescuing
Nov 13 10:00:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-49ef1628-9bb1-42e5-a20d-9e8c0fcaa14c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:00:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-49ef1628-9bb1-42e5-a20d-9e8c0fcaa14c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquired lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:00:15 user nova-compute[74611]: DEBUG nova.network.neutron [None req-49ef1628-9bb1-42e5-a20d-9e8c0fcaa14c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:00:15 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:00:15 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:00:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:15 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4970bd6b-69a6-479c-9f5f-bc5fc6021407 is timed out.
Nov 13 10:00:15 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Successfully detached device vdb from instance 4970bd6b-69a6-479c-9f5f-bc5fc6021407 from the live domain config.
Nov 13 10:00:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxmeKXhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:00:16 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Deleted allocations for instance 8cdb9561-3b40-44cc-abf7-2cbff7e60a17
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91e7ca0-ff1f-46e3-9a03-5f887a6f838e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:00:16 user nova-compute[74611]: No targets found.
Nov 13 10:00:16 user nova-compute[74611]: iSNS:
Nov 13 10:00:16 user nova-compute[74611]: No targets found.
Nov 13 10:00:16 user nova-compute[74611]: STATIC:
Nov 13 10:00:16 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373
Nov 13 10:00:16 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:16 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:16 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5
Nov 13 10:00:16 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:16 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:16 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425
Nov 13 10:00:16 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:16 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:16 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c
Nov 13 10:00:16 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:16 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:16 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:00:16 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:16 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:16 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4
Nov 13 10:00:16 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:16 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:16 user nova-compute[74611]: FIRMWARE:
Nov 13 10:00:16 user nova-compute[74611]: No targets found.
Nov 13 10:00:16 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:00:16 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:00:16 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e9e626-9a1b-41f4-b7e8-caf7093d77b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[66efe959-660f-41bf-8b82-c9d1217f5e06]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7c2b7d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4'): ({'sdg'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Removing single pathed devices sdg {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-01d6ba78-d2f4-4cf2-a5e9-11511f3a5f1b tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.234s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG nova.network.neutron [None req-49ef1628-9bb1-42e5-a20d-9e8c0fcaa14c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Updating instance_info_cache with network_info: [{"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff7b809-c4fc-4f8d-9396-13587de06206]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-49ef1628-9bb1-42e5-a20d-9e8c0fcaa14c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Releasing lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG nova.objects.instance [None req-49ef1628-9bb1-42e5-a20d-9e8c0fcaa14c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'flavor' on Instance uuid ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbd0a8c-18c8-4a53-96b0-9b6bd4aa8938]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Flushing IO for device /dev/sdg {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a481ed-da5f-4c0b-806b-63d258fd8417]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a07c3ae-b943-4fb6-9ea7-ca37290bfea1]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] SCSI volumes sdg have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG nova.compute.manager [req-4817862a-4e2e-4387-bff7-a485144e60a7 req-6b13287b-b5a3-4e7b-bfcc-82fce7cf1dd8 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received event network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4817862a-4e2e-4387-bff7-a485144e60a7 req-6b13287b-b5a3-4e7b-bfcc-82fce7cf1dd8 service nova] Acquiring lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4817862a-4e2e-4387-bff7-a485144e60a7 req-6b13287b-b5a3-4e7b-bfcc-82fce7cf1dd8 service nova] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4817862a-4e2e-4387-bff7-a485144e60a7 req-6b13287b-b5a3-4e7b-bfcc-82fce7cf1dd8 service nova] Lock "8cdb9561-3b40-44cc-abf7-2cbff7e60a17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG nova.compute.manager [req-4817862a-4e2e-4387-bff7-a485144e60a7 req-6b13287b-b5a3-4e7b-bfcc-82fce7cf1dd8 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] No waiting events found dispatching network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:00:16 user nova-compute[74611]: WARNING nova.compute.manager [req-4817862a-4e2e-4387-bff7-a485144e60a7 req-6b13287b-b5a3-4e7b-bfcc-82fce7cf1dd8 service nova] [instance: 8cdb9561-3b40-44cc-abf7-2cbff7e60a17] Received unexpected event network-vif-plugged-e730080f-c599-449b-b366-a642be4f9ac7 for instance with vm_state deleted and task_state None.
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e87f3d-87e1-4b93-9823-4ca6391bbd05]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b2e014-3ea2-4c7a-8ba7-4fb313cd2c4d]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4, portal: 172.16.0.220,3260]
Nov 13 10:00:16 user nova-compute[74611]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4, portal: 172.16.0.220,3260] successful.
Nov 13 10:00:16 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a51496-255d-4582-ac29-c13290f558d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f88849-c59a-492a-8533-192410a27f79]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] <== disconnect_volume: return (396ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIemdhFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:00:16 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:00:16 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:00:16 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[921e215c-e7b9-4c76-8db1-66a19d1509c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:00:16 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[608a6abf-f107-433b-9ad5-20b6f1efad63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef] added
Nov 13 10:00:16 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a825ff7c-9ce4-409b-85f9-5bb4abc7b410]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[288cf17d-1f62-4966-8254-1887fcc47869]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pIemdhFC {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pIemdhFC" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a4537e-c71d-487a-affb-01f27bc1d6c8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pIemdhFC'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5131555-adc7-49e9-82cd-7e9cb3145a81]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1980f8fa-74d9-408a-a70e-6bc345beded6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c4001b-26d8-4adb-b4f7-d232929b9e46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef, portal: 172.16.0.220,3260]
Nov 13 10:00:16 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef, portal: 172.16.0.220,3260] successful.
Nov 13 10:00:16 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9c5514-1642-4336-b3a2-6ac34dc84f76]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[633db030-73d8-4a9d-95da-5d197e7867f7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef (non-flash)
Nov 13 10:00:16 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:00:16 user nova-compute[74611]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef (non-flash)
Nov 13 10:00:16 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[555916d3-126f-4c03-a80c-d3878fa4c177]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:00:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIemdhFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:00:16 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Instance destroyed successfully.
Nov 13 10:00:17 user nova-compute[74611]: DEBUG nova.objects.instance [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lazy-loading 'flavor' on Instance uuid 4970bd6b-69a6-479c-9f5f-bc5fc6021407 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:00:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-22b2a295-6cf0-410f-97f0-90cfad839774 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.700s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:17 user nova-compute[74611]: DEBUG nova.compute.manager [req-2aec0164-6a80-4ba7-b39b-88229df3dd78 req-bc994446-e852-4ef3-a147-449f75c5335c service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received event network-vif-unplugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2aec0164-6a80-4ba7-b39b-88229df3dd78 req-bc994446-e852-4ef3-a147-449f75c5335c service nova] Acquiring lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2aec0164-6a80-4ba7-b39b-88229df3dd78 req-bc994446-e852-4ef3-a147-449f75c5335c service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2aec0164-6a80-4ba7-b39b-88229df3dd78 req-bc994446-e852-4ef3-a147-449f75c5335c service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:17 user nova-compute[74611]: DEBUG nova.compute.manager [req-2aec0164-6a80-4ba7-b39b-88229df3dd78 req-bc994446-e852-4ef3-a147-449f75c5335c service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] No waiting events found dispatching network-vif-unplugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:00:17 user nova-compute[74611]: WARNING nova.compute.manager [req-2aec0164-6a80-4ba7-b39b-88229df3dd78 req-bc994446-e852-4ef3-a147-449f75c5335c service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received unexpected event network-vif-unplugged-18262a82-8847-4594-98ce-2ad50387fbf2 for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:00:17 user nova-compute[74611]: DEBUG nova.compute.manager [req-2aec0164-6a80-4ba7-b39b-88229df3dd78 req-bc994446-e852-4ef3-a147-449f75c5335c service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2aec0164-6a80-4ba7-b39b-88229df3dd78 req-bc994446-e852-4ef3-a147-449f75c5335c service nova] Acquiring lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2aec0164-6a80-4ba7-b39b-88229df3dd78 req-bc994446-e852-4ef3-a147-449f75c5335c service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2aec0164-6a80-4ba7-b39b-88229df3dd78 req-bc994446-e852-4ef3-a147-449f75c5335c service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:17 user nova-compute[74611]: DEBUG nova.compute.manager [req-2aec0164-6a80-4ba7-b39b-88229df3dd78 req-bc994446-e852-4ef3-a147-449f75c5335c service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] No waiting events found dispatching network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:00:17 user nova-compute[74611]: WARNING nova.compute.manager [req-2aec0164-6a80-4ba7-b39b-88229df3dd78 req-bc994446-e852-4ef3-a147-449f75c5335c service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received unexpected event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:00:17 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:00:17 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23362333434363265', 'path': '/dev/sdg'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:00:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362333434363265', 'path': '/dev/sdg'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:00:17 user nova-compute[74611]: DEBUG nova.objects.instance [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lazy-loading 'flavor' on Instance uuid b1913235-682f-486a-8b35-f917c3664eec {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:00:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:00:17 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:00:17 user nova-compute[74611]:   <source dev="/dev/sdg"/>
Nov 13 10:00:17 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:00:17 user nova-compute[74611]:   <serial>e2dde92b-2f6f-4253-b842-40403946e1ef</serial>
Nov 13 10:00:17 user nova-compute[74611]: </disk>
Nov 13 10:00:17 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:00:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:00:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:00:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] No VIF found with MAC fa:16:3e:14:c0:79, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:00:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e6cc54c3-bbeb-4cc6-81d0-0471bc031118 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "b1913235-682f-486a-8b35-f917c3664eec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.610s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-9601476f-3317-4d92-9556-e81295aa967a req-05a4ce1a-faa5-4f94-b29a-b5f0d0c6f1c4 service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9601476f-3317-4d92-9556-e81295aa967a req-05a4ce1a-faa5-4f94-b29a-b5f0d0c6f1c4 service nova] Acquiring lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9601476f-3317-4d92-9556-e81295aa967a req-05a4ce1a-faa5-4f94-b29a-b5f0d0c6f1c4 service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9601476f-3317-4d92-9556-e81295aa967a req-05a4ce1a-faa5-4f94-b29a-b5f0d0c6f1c4 service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-9601476f-3317-4d92-9556-e81295aa967a req-05a4ce1a-faa5-4f94-b29a-b5f0d0c6f1c4 service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] No waiting events found dispatching network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:00:19 user nova-compute[74611]: WARNING nova.compute.manager [req-9601476f-3317-4d92-9556-e81295aa967a req-05a4ce1a-faa5-4f94-b29a-b5f0d0c6f1c4 service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received unexpected event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:00:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-9601476f-3317-4d92-9556-e81295aa967a req-05a4ce1a-faa5-4f94-b29a-b5f0d0c6f1c4 service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9601476f-3317-4d92-9556-e81295aa967a req-05a4ce1a-faa5-4f94-b29a-b5f0d0c6f1c4 service nova] Acquiring lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9601476f-3317-4d92-9556-e81295aa967a req-05a4ce1a-faa5-4f94-b29a-b5f0d0c6f1c4 service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9601476f-3317-4d92-9556-e81295aa967a req-05a4ce1a-faa5-4f94-b29a-b5f0d0c6f1c4 service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-9601476f-3317-4d92-9556-e81295aa967a req-05a4ce1a-faa5-4f94-b29a-b5f0d0c6f1c4 service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] No waiting events found dispatching network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:00:19 user nova-compute[74611]: WARNING nova.compute.manager [req-9601476f-3317-4d92-9556-e81295aa967a req-05a4ce1a-faa5-4f94-b29a-b5f0d0c6f1c4 service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received unexpected event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:00:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "23495073-10b7-4552-ad61-16fdf410956b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "23495073-10b7-4552-ad61-16fdf410956b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:20 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:00:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:20 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:00:20 user nova-compute[74611]: INFO nova.compute.claims [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Claim successful on node user
Nov 13 10:00:20 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:00:20 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:00:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:20 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG nova.network.neutron [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:00:21 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:00:21 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG nova.policy [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd93cfc3fb54b41ceb9f9657de0059043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1384599c1e484e54ae29b024377dbd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "b1913235-682f-486a-8b35-f917c3664eec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "b1913235-682f-486a-8b35-f917c3664eec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:21 user nova-compute[74611]: INFO nova.compute.manager [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Detaching volume e2dde92b-2f6f-4253-b842-40403946e1ef
Nov 13 10:00:21 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:00:21 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Creating image(s)
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "/opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "/opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "/opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:21 user nova-compute[74611]: INFO nova.virt.block_device [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Attempting to driver detach volume e2dde92b-2f6f-4253-b842-40403946e1ef from mountpoint /dev/vdb
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG nova.compute.manager [None req-49ef1628-9bb1-42e5-a20d-9e8c0fcaa14c tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Attempting to detach device vdb from instance b1913235-682f-486a-8b35-f917c3664eec from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:00:21 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:00:21 user nova-compute[74611]:   <source dev="/dev/sdg"/>
Nov 13 10:00:21 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:00:21 user nova-compute[74611]:   <serial>e2dde92b-2f6f-4253-b842-40403946e1ef</serial>
Nov 13 10:00:21 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:00:21 user nova-compute[74611]: </disk>
Nov 13 10:00:21 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:00:21 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Successfully detached device vdb from instance b1913235-682f-486a-8b35-f917c3664eec from the persistent domain config.
Nov 13 10:00:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b1913235-682f-486a-8b35-f917c3664eec from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:00:21 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:00:21 user nova-compute[74611]:   <source dev="/dev/sdg"/>
Nov 13 10:00:21 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:00:21 user nova-compute[74611]:   <serial>e2dde92b-2f6f-4253-b842-40403946e1ef</serial>
Nov 13 10:00:21 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:00:21 user nova-compute[74611]: </disk>
Nov 13 10:00:21 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.191s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.191s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG nova.network.neutron [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Successfully created port: cc222aae-de55-44ac-be3c-38b357e4c811 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk 1073741824" returned: 0 in 0.061s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b1913235-682f-486a-8b35-f917c3664eec {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.196s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:00:21 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Cannot resize image /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Ensure instance console log exists: /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:22 user nova-compute[74611]: INFO nova.compute.manager [None req-eb09d1e3-4151-4c14-a4d5-ef0c44ac5f55 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Unrescuing
Nov 13 10:00:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eb09d1e3-4151-4c14-a4d5-ef0c44ac5f55 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eb09d1e3-4151-4c14-a4d5-ef0c44ac5f55 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquired lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.network.neutron [None req-eb09d1e3-4151-4c14-a4d5-ef0c44ac5f55 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.network.neutron [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Successfully updated port: cc222aae-de55-44ac-be3c-38b357e4c811 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "refresh_cache-23495073-10b7-4552-ad61-16fdf410956b" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquired lock "refresh_cache-23495073-10b7-4552-ad61-16fdf410956b" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.network.neutron [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.compute.manager [req-1fc16c6e-3796-4780-99dd-b7c96a171fc0 req-27b987ca-eec4-4b52-a09c-ec24c8270a48 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Received event network-changed-cc222aae-de55-44ac-be3c-38b357e4c811 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.compute.manager [req-1fc16c6e-3796-4780-99dd-b7c96a171fc0 req-27b987ca-eec4-4b52-a09c-ec24c8270a48 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Refreshing instance network info cache due to event network-changed-cc222aae-de55-44ac-be3c-38b357e4c811. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1fc16c6e-3796-4780-99dd-b7c96a171fc0 req-27b987ca-eec4-4b52-a09c-ec24c8270a48 service nova] Acquiring lock "refresh_cache-23495073-10b7-4552-ad61-16fdf410956b" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.network.neutron [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.network.neutron [None req-eb09d1e3-4151-4c14-a4d5-ef0c44ac5f55 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Updating instance_info_cache with network_info: [{"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-eb09d1e3-4151-4c14-a4d5-ef0c44ac5f55 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Releasing lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.objects.instance [None req-eb09d1e3-4151-4c14-a4d5-ef0c44ac5f55 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'flavor' on Instance uuid 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.network.neutron [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Updating instance_info_cache with network_info: [{"id": "cc222aae-de55-44ac-be3c-38b357e4c811", "address": "fa:16:3e:56:8b:98", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc222aae-de", "ovs_interfaceid": "cc222aae-de55-44ac-be3c-38b357e4c811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Releasing lock "refresh_cache-23495073-10b7-4552-ad61-16fdf410956b" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Instance network_info: |[{"id": "cc222aae-de55-44ac-be3c-38b357e4c811", "address": "fa:16:3e:56:8b:98", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc222aae-de", "ovs_interfaceid": "cc222aae-de55-44ac-be3c-38b357e4c811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1fc16c6e-3796-4780-99dd-b7c96a171fc0 req-27b987ca-eec4-4b52-a09c-ec24c8270a48 service nova] Acquired lock "refresh_cache-23495073-10b7-4552-ad61-16fdf410956b" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.network.neutron [req-1fc16c6e-3796-4780-99dd-b7c96a171fc0 req-27b987ca-eec4-4b52-a09c-ec24c8270a48 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Refreshing network info cache for port cc222aae-de55-44ac-be3c-38b357e4c811 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Start _get_guest_xml network_info=[{"id": "cc222aae-de55-44ac-be3c-38b357e4c811", "address": "fa:16:3e:56:8b:98", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc222aae-de", "ovs_interfaceid": "cc222aae-de55-44ac-be3c-38b357e4c811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.compute.manager [req-ecf88304-cd3d-4ac9-8c4f-961a82600435 req-650225d3-b8ca-4e90-a021-8c42486787b0 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received event network-vif-unplugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ecf88304-cd3d-4ac9-8c4f-961a82600435 req-650225d3-b8ca-4e90-a021-8c42486787b0 service nova] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ecf88304-cd3d-4ac9-8c4f-961a82600435 req-650225d3-b8ca-4e90-a021-8c42486787b0 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ecf88304-cd3d-4ac9-8c4f-961a82600435 req-650225d3-b8ca-4e90-a021-8c42486787b0 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.compute.manager [req-ecf88304-cd3d-4ac9-8c4f-961a82600435 req-650225d3-b8ca-4e90-a021-8c42486787b0 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] No waiting events found dispatching network-vif-unplugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:00:22 user nova-compute[74611]: WARNING nova.compute.manager [req-ecf88304-cd3d-4ac9-8c4f-961a82600435 req-650225d3-b8ca-4e90-a021-8c42486787b0 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received unexpected event network-vif-unplugged-37c25482-a620-4013-9e9d-e14c53d87bc4 for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:00:22 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:00:22 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1594226373',display_name='tempest-AttachVolumeNegativeTest-server-1594226373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1594226373',id=25,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZPQk0MTmTuMo6ZDGI7e1+m8rmvipmL5Wo9gydeghixMTXlxDwR44lh+flgDoj9nx6NiluTf+5F1FmwhG84lcEdODV37F+bPUe+W3g3tZlg98smjVBGYJeBsmBsrpskxw==',key_name='tempest-keypair-2145589996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1384599c1e484e54ae29b024377dbd04',ramdisk_id='',reservation_id='r-vcsghs1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1307038303',owner_user_name='tempest-AttachVolumeNegativeTest-1307038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d93cfc3fb54b41ceb9f9657de0059043',uuid=23495073-10b7-4552-ad61-16fdf410956b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc222aae-de55-44ac-be3c-38b357e4c811", "address": "fa:16:3e:56:8b:98", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc222aae-de", "ovs_interfaceid": "cc222aae-de55-44ac-be3c-38b357e4c811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converting VIF {"id": "cc222aae-de55-44ac-be3c-38b357e4c811", "address": "fa:16:3e:56:8b:98", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc222aae-de", "ovs_interfaceid": "cc222aae-de55-44ac-be3c-38b357e4c811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:8b:98,bridge_name='br-int',has_traffic_filtering=True,id=cc222aae-de55-44ac-be3c-38b357e4c811,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc222aae-de') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.objects.instance [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'pci_devices' on Instance uuid 23495073-10b7-4552-ad61-16fdf410956b {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:00:22 user nova-compute[74611]:   <uuid>23495073-10b7-4552-ad61-16fdf410956b</uuid>
Nov 13 10:00:22 user nova-compute[74611]:   <name>instance-00000019</name>
Nov 13 10:00:22 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:00:22 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:00:22 user nova-compute[74611]:   <metadata>
Nov 13 10:00:22 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:00:22 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:00:22 user nova-compute[74611]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1594226373</nova:name>
Nov 13 10:00:22 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:00:22</nova:creationTime>
Nov 13 10:00:22 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:00:22 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:00:22 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:00:22 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:00:22 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:00:22 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:00:22 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:00:22 user nova-compute[74611]:       <nova:owner>
Nov 13 10:00:22 user nova-compute[74611]:         <nova:user uuid="d93cfc3fb54b41ceb9f9657de0059043">tempest-AttachVolumeNegativeTest-1307038303-project-member</nova:user>
Nov 13 10:00:22 user nova-compute[74611]:         <nova:project uuid="1384599c1e484e54ae29b024377dbd04">tempest-AttachVolumeNegativeTest-1307038303</nova:project>
Nov 13 10:00:22 user nova-compute[74611]:       </nova:owner>
Nov 13 10:00:22 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:00:22 user nova-compute[74611]:       <nova:ports>
Nov 13 10:00:22 user nova-compute[74611]:         <nova:port uuid="cc222aae-de55-44ac-be3c-38b357e4c811">
Nov 13 10:00:22 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 10:00:22 user nova-compute[74611]:         </nova:port>
Nov 13 10:00:22 user nova-compute[74611]:       </nova:ports>
Nov 13 10:00:22 user nova-compute[74611]:     </nova:instance>
Nov 13 10:00:22 user nova-compute[74611]:   </metadata>
Nov 13 10:00:22 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:00:22 user nova-compute[74611]:     <system>
Nov 13 10:00:22 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:00:22 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:00:22 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:00:22 user nova-compute[74611]:       <entry name="serial">23495073-10b7-4552-ad61-16fdf410956b</entry>
Nov 13 10:00:22 user nova-compute[74611]:       <entry name="uuid">23495073-10b7-4552-ad61-16fdf410956b</entry>
Nov 13 10:00:22 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:00:22 user nova-compute[74611]:     </system>
Nov 13 10:00:22 user nova-compute[74611]:   </sysinfo>
Nov 13 10:00:22 user nova-compute[74611]:   <os>
Nov 13 10:00:22 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:00:22 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:00:22 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:00:22 user nova-compute[74611]:   </os>
Nov 13 10:00:22 user nova-compute[74611]:   <features>
Nov 13 10:00:22 user nova-compute[74611]:     <acpi/>
Nov 13 10:00:22 user nova-compute[74611]:     <apic/>
Nov 13 10:00:22 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:00:22 user nova-compute[74611]:   </features>
Nov 13 10:00:22 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:00:22 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:00:22 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:00:22 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:00:22 user nova-compute[74611]:   </clock>
Nov 13 10:00:22 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:00:22 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:00:22 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:00:22 user nova-compute[74611]:   </cpu>
Nov 13 10:00:22 user nova-compute[74611]:   <devices>
Nov 13 10:00:22 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:00:22 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:00:22 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk"/>
Nov 13 10:00:22 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:00:22 user nova-compute[74611]:     </disk>
Nov 13 10:00:22 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:00:22 user nova-compute[74611]:       <mac address="fa:16:3e:56:8b:98"/>
Nov 13 10:00:22 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:00:22 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:00:22 user nova-compute[74611]:       <target dev="tapcc222aae-de"/>
Nov 13 10:00:22 user nova-compute[74611]:     </interface>
Nov 13 10:00:22 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:00:22 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/console.log" append="off"/>
Nov 13 10:00:22 user nova-compute[74611]:     </serial>
Nov 13 10:00:22 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:00:22 user nova-compute[74611]:     <video>
Nov 13 10:00:22 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:00:22 user nova-compute[74611]:     </video>
Nov 13 10:00:22 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:00:22 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:00:22 user nova-compute[74611]:     </rng>
Nov 13 10:00:22 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:00:22 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:00:22 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:00:22 user nova-compute[74611]:     </memballoon>
Nov 13 10:00:22 user nova-compute[74611]:   </devices>
Nov 13 10:00:22 user nova-compute[74611]: </domain>
Nov 13 10:00:22 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1594226373',display_name='tempest-AttachVolumeNegativeTest-server-1594226373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1594226373',id=25,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZPQk0MTmTuMo6ZDGI7e1+m8rmvipmL5Wo9gydeghixMTXlxDwR44lh+flgDoj9nx6NiluTf+5F1FmwhG84lcEdODV37F+bPUe+W3g3tZlg98smjVBGYJeBsmBsrpskxw==',key_name='tempest-keypair-2145589996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1384599c1e484e54ae29b024377dbd04',ramdisk_id='',reservation_id='r-vcsghs1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1307038303',owner_user_name='tempest-AttachVolumeNegativeTest-1307038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d93cfc3fb54b41ceb9f9657de0059043',uuid=23495073-10b7-4552-ad61-16fdf410956b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc222aae-de55-44ac-be3c-38b357e4c811", "address": "fa:16:3e:56:8b:98", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc222aae-de", "ovs_interfaceid": "cc222aae-de55-44ac-be3c-38b357e4c811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converting VIF {"id": "cc222aae-de55-44ac-be3c-38b357e4c811", "address": "fa:16:3e:56:8b:98", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc222aae-de", "ovs_interfaceid": "cc222aae-de55-44ac-be3c-38b357e4c811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:8b:98,bridge_name='br-int',has_traffic_filtering=True,id=cc222aae-de55-44ac-be3c-38b357e4c811,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc222aae-de') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG os_vif [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:8b:98,bridge_name='br-int',has_traffic_filtering=True,id=cc222aae-de55-44ac-be3c-38b357e4c811,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc222aae-de') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1465f22e-bacb-5837-aff5-6caf7194186d', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc222aae-de, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc222aae-de, col_values=(('qos', UUID('f90bbc5b-ab6e-4a9f-b61b-cf0e0fa76ce2')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc222aae-de, col_values=(('external_ids', {'iface-id': 'cc222aae-de55-44ac-be3c-38b357e4c811', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:8b:98', 'vm-uuid': '23495073-10b7-4552-ad61-16fdf410956b'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:23 user nova-compute[74611]: INFO os_vif [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:8b:98,bridge_name='br-int',has_traffic_filtering=True,id=cc222aae-de55-44ac-be3c-38b357e4c811,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc222aae-de')
Nov 13 10:00:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No VIF found with MAC fa:16:3e:56:8b:98, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG nova.network.neutron [req-1fc16c6e-3796-4780-99dd-b7c96a171fc0 req-27b987ca-eec4-4b52-a09c-ec24c8270a48 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Updated VIF entry in instance network info cache for port cc222aae-de55-44ac-be3c-38b357e4c811. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG nova.network.neutron [req-1fc16c6e-3796-4780-99dd-b7c96a171fc0 req-27b987ca-eec4-4b52-a09c-ec24c8270a48 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Updating instance_info_cache with network_info: [{"id": "cc222aae-de55-44ac-be3c-38b357e4c811", "address": "fa:16:3e:56:8b:98", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc222aae-de", "ovs_interfaceid": "cc222aae-de55-44ac-be3c-38b357e4c811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1fc16c6e-3796-4780-99dd-b7c96a171fc0 req-27b987ca-eec4-4b52-a09c-ec24c8270a48 service nova] Releasing lock "refresh_cache-23495073-10b7-4552-ad61-16fdf410956b" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:00:23 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Instance destroyed successfully.
Nov 13 10:00:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG nova.compute.manager [req-c32941a5-eb8d-43e7-b90e-17d09c0baa3f req-86644b91-67b4-4dd9-9ef0-c183e3640364 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received event network-changed-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG nova.compute.manager [req-c32941a5-eb8d-43e7-b90e-17d09c0baa3f req-86644b91-67b4-4dd9-9ef0-c183e3640364 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Refreshing instance network info cache due to event network-changed-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c32941a5-eb8d-43e7-b90e-17d09c0baa3f req-86644b91-67b4-4dd9-9ef0-c183e3640364 service nova] Acquiring lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c32941a5-eb8d-43e7-b90e-17d09c0baa3f req-86644b91-67b4-4dd9-9ef0-c183e3640364 service nova] Acquired lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:00:23 user nova-compute[74611]: DEBUG nova.network.neutron [req-c32941a5-eb8d-43e7-b90e-17d09c0baa3f req-86644b91-67b4-4dd9-9ef0-c183e3640364 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Refreshing network info cache for port 9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:00:24 user nova-compute[74611]: DEBUG nova.network.neutron [req-c32941a5-eb8d-43e7-b90e-17d09c0baa3f req-86644b91-67b4-4dd9-9ef0-c183e3640364 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updated VIF entry in instance network info cache for port 9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:00:24 user nova-compute[74611]: DEBUG nova.network.neutron [req-c32941a5-eb8d-43e7-b90e-17d09c0baa3f req-86644b91-67b4-4dd9-9ef0-c183e3640364 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updating instance_info_cache with network_info: [{"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:00:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c32941a5-eb8d-43e7-b90e-17d09c0baa3f req-86644b91-67b4-4dd9-9ef0-c183e3640364 service nova] Releasing lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:00:24 user nova-compute[74611]: DEBUG nova.compute.manager [req-89eb4b3e-5d32-4cb6-a6cf-30c6deb29703 req-67282a40-c861-4e4a-9218-aa12e5917e22 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-89eb4b3e-5d32-4cb6-a6cf-30c6deb29703 req-67282a40-c861-4e4a-9218-aa12e5917e22 service nova] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-89eb4b3e-5d32-4cb6-a6cf-30c6deb29703 req-67282a40-c861-4e4a-9218-aa12e5917e22 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-89eb4b3e-5d32-4cb6-a6cf-30c6deb29703 req-67282a40-c861-4e4a-9218-aa12e5917e22 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:24 user nova-compute[74611]: DEBUG nova.compute.manager [req-89eb4b3e-5d32-4cb6-a6cf-30c6deb29703 req-67282a40-c861-4e4a-9218-aa12e5917e22 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] No waiting events found dispatching network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:00:24 user nova-compute[74611]: WARNING nova.compute.manager [req-89eb4b3e-5d32-4cb6-a6cf-30c6deb29703 req-67282a40-c861-4e4a-9218-aa12e5917e22 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received unexpected event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:00:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:25 user nova-compute[74611]: DEBUG nova.compute.manager [req-81fd3165-4329-4c10-afbe-116f3dc9599f req-197168e4-f8f2-4316-8408-521cff72cdb7 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Received event network-vif-plugged-cc222aae-de55-44ac-be3c-38b357e4c811 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-81fd3165-4329-4c10-afbe-116f3dc9599f req-197168e4-f8f2-4316-8408-521cff72cdb7 service nova] Acquiring lock "23495073-10b7-4552-ad61-16fdf410956b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-81fd3165-4329-4c10-afbe-116f3dc9599f req-197168e4-f8f2-4316-8408-521cff72cdb7 service nova] Lock "23495073-10b7-4552-ad61-16fdf410956b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-81fd3165-4329-4c10-afbe-116f3dc9599f req-197168e4-f8f2-4316-8408-521cff72cdb7 service nova] Lock "23495073-10b7-4552-ad61-16fdf410956b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:25 user nova-compute[74611]: DEBUG nova.compute.manager [req-81fd3165-4329-4c10-afbe-116f3dc9599f req-197168e4-f8f2-4316-8408-521cff72cdb7 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] No waiting events found dispatching network-vif-plugged-cc222aae-de55-44ac-be3c-38b357e4c811 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:00:25 user nova-compute[74611]: WARNING nova.compute.manager [req-81fd3165-4329-4c10-afbe-116f3dc9599f req-197168e4-f8f2-4316-8408-521cff72cdb7 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Received unexpected event network-vif-plugged-cc222aae-de55-44ac-be3c-38b357e4c811 for instance with vm_state building and task_state spawning.
Nov 13 10:00:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-2049cc6d-b7e1-4501-854f-a3c303d37c3a req-37697630-b45f-4149-b613-157ce9dc6663 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2049cc6d-b7e1-4501-854f-a3c303d37c3a req-37697630-b45f-4149-b613-157ce9dc6663 service nova] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2049cc6d-b7e1-4501-854f-a3c303d37c3a req-37697630-b45f-4149-b613-157ce9dc6663 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2049cc6d-b7e1-4501-854f-a3c303d37c3a req-37697630-b45f-4149-b613-157ce9dc6663 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-2049cc6d-b7e1-4501-854f-a3c303d37c3a req-37697630-b45f-4149-b613-157ce9dc6663 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] No waiting events found dispatching network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:00:26 user nova-compute[74611]: WARNING nova.compute.manager [req-2049cc6d-b7e1-4501-854f-a3c303d37c3a req-37697630-b45f-4149-b613-157ce9dc6663 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received unexpected event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:00:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-2049cc6d-b7e1-4501-854f-a3c303d37c3a req-37697630-b45f-4149-b613-157ce9dc6663 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2049cc6d-b7e1-4501-854f-a3c303d37c3a req-37697630-b45f-4149-b613-157ce9dc6663 service nova] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2049cc6d-b7e1-4501-854f-a3c303d37c3a req-37697630-b45f-4149-b613-157ce9dc6663 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2049cc6d-b7e1-4501-854f-a3c303d37c3a req-37697630-b45f-4149-b613-157ce9dc6663 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-2049cc6d-b7e1-4501-854f-a3c303d37c3a req-37697630-b45f-4149-b613-157ce9dc6663 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] No waiting events found dispatching network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:00:26 user nova-compute[74611]: WARNING nova.compute.manager [req-2049cc6d-b7e1-4501-854f-a3c303d37c3a req-37697630-b45f-4149-b613-157ce9dc6663 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received unexpected event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:00:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-497b2189-5fef-42f4-b425-912e3f21ddbb req-a3dcf8a9-63d1-46f6-9a07-1b678808a768 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Received event network-vif-plugged-cc222aae-de55-44ac-be3c-38b357e4c811 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-497b2189-5fef-42f4-b425-912e3f21ddbb req-a3dcf8a9-63d1-46f6-9a07-1b678808a768 service nova] Acquiring lock "23495073-10b7-4552-ad61-16fdf410956b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-497b2189-5fef-42f4-b425-912e3f21ddbb req-a3dcf8a9-63d1-46f6-9a07-1b678808a768 service nova] Lock "23495073-10b7-4552-ad61-16fdf410956b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-497b2189-5fef-42f4-b425-912e3f21ddbb req-a3dcf8a9-63d1-46f6-9a07-1b678808a768 service nova] Lock "23495073-10b7-4552-ad61-16fdf410956b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-497b2189-5fef-42f4-b425-912e3f21ddbb req-a3dcf8a9-63d1-46f6-9a07-1b678808a768 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] No waiting events found dispatching network-vif-plugged-cc222aae-de55-44ac-be3c-38b357e4c811 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:00:27 user nova-compute[74611]: WARNING nova.compute.manager [req-497b2189-5fef-42f4-b425-912e3f21ddbb req-a3dcf8a9-63d1-46f6-9a07-1b678808a768 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Received unexpected event network-vif-plugged-cc222aae-de55-44ac-be3c-38b357e4c811 for instance with vm_state building and task_state spawning.
Nov 13 10:00:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-eb09d1e3-4151-4c14-a4d5-ef0c44ac5f55 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:00:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:00:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:00:28 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Instance spawned successfully.
Nov 13 10:00:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:00:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:00:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:00:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:00:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:00:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:00:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:00:28 user nova-compute[74611]: INFO nova.compute.manager [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Took 7.27 seconds to spawn the instance on the hypervisor.
Nov 13 10:00:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:00:28 user nova-compute[74611]: INFO nova.compute.manager [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Took 8.15 seconds to build instance.
Nov 13 10:00:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7277aa58-8b68-4233-9f8b-8727faead221 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "23495073-10b7-4552-ad61-16fdf410956b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.243s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid 85cb3adb-b2b3-49ec-92ab-c2b7a028241a {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid 1c66c8a8-abb5-4f60-8464-074627c213d8 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid 89038547-5416-4942-8070-dd5dd8e4b6c2 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid 4dca8fcf-5fed-4cd1-b8db-61f271b93d20 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid 4970bd6b-69a6-479c-9f5f-bc5fc6021407 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid b1913235-682f-486a-8b35-f917c3664eec {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid 635636ea-96a0-4fdb-85a1-ca7a87b762f0 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid 822a3afe-eae1-4960-b347-89c58fb10c4c {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid f5cb6cf5-f915-4f50-bfc3-0112875dcfcc {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid bedd770b-692e-4402-8724-2b9a8434a8fb {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid 23495073-10b7-4552-ad61-16fdf410956b {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "1c66c8a8-abb5-4f60-8464-074627c213d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "1c66c8a8-abb5-4f60-8464-074627c213d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "89038547-5416-4942-8070-dd5dd8e4b6c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "b1913235-682f-486a-8b35-f917c3664eec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "822a3afe-eae1-4960-b347-89c58fb10c4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "bedd770b-692e-4402-8724-2b9a8434a8fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "bedd770b-692e-4402-8724-2b9a8434a8fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "23495073-10b7-4552-ad61-16fdf410956b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "23495073-10b7-4552-ad61-16fdf410956b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.239s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.245s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.248s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.261s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.264s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.266s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.270s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.282s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.290s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "23495073-10b7-4552-ad61-16fdf410956b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.287s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.292s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "1c66c8a8-abb5-4f60-8464-074627c213d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.328s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.333s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "bedd770b-692e-4402-8724-2b9a8434a8fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.338s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-df73f03e-920f-48f2-a95d-9dec23f740a3 req-2c49ac60-65ab-48c3-812a-22cf864ba887 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Received event network-changed-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-df73f03e-920f-48f2-a95d-9dec23f740a3 req-2c49ac60-65ab-48c3-812a-22cf864ba887 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Refreshing instance network info cache due to event network-changed-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:00:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-df73f03e-920f-48f2-a95d-9dec23f740a3 req-2c49ac60-65ab-48c3-812a-22cf864ba887 service nova] Acquiring lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:00:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-df73f03e-920f-48f2-a95d-9dec23f740a3 req-2c49ac60-65ab-48c3-812a-22cf864ba887 service nova] Acquired lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:00:37 user nova-compute[74611]: DEBUG nova.network.neutron [req-df73f03e-920f-48f2-a95d-9dec23f740a3 req-2c49ac60-65ab-48c3-812a-22cf864ba887 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Refreshing network info cache for port a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:00:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:38 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:00:38 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:00:38 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:00:38 user nova-compute[74611]: DEBUG nova.network.neutron [req-df73f03e-920f-48f2-a95d-9dec23f740a3 req-2c49ac60-65ab-48c3-812a-22cf864ba887 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Updated VIF entry in instance network info cache for port a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:00:38 user nova-compute[74611]: DEBUG nova.network.neutron [req-df73f03e-920f-48f2-a95d-9dec23f740a3 req-2c49ac60-65ab-48c3-812a-22cf864ba887 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Updating instance_info_cache with network_info: [{"id": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "address": "fa:16:3e:b7:e1:19", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ef27e1-e7", "ovs_interfaceid": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:00:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-df73f03e-920f-48f2-a95d-9dec23f740a3 req-2c49ac60-65ab-48c3-812a-22cf864ba887 service nova] Releasing lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:00:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:00:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:00:38 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:00:38 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:00:38 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Updating instance_info_cache with network_info: [{"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:00:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:00:38 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:00:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:39 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:00:39 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:00:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c61ccf4-68ce-4579-a5c1-bb155ceb129f req-b9059557-ce95-41a5-8a91-f80aaa6f66b1 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received event network-changed-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c61ccf4-68ce-4579-a5c1-bb155ceb129f req-b9059557-ce95-41a5-8a91-f80aaa6f66b1 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Refreshing instance network info cache due to event network-changed-4e7f5a25-370f-4d77-a8e9-b29f90a337bc. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:00:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c61ccf4-68ce-4579-a5c1-bb155ceb129f req-b9059557-ce95-41a5-8a91-f80aaa6f66b1 service nova] Acquiring lock "refresh_cache-f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:00:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c61ccf4-68ce-4579-a5c1-bb155ceb129f req-b9059557-ce95-41a5-8a91-f80aaa6f66b1 service nova] Acquired lock "refresh_cache-f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:00:40 user nova-compute[74611]: DEBUG nova.network.neutron [req-7c61ccf4-68ce-4579-a5c1-bb155ceb129f req-b9059557-ce95-41a5-8a91-f80aaa6f66b1 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Refreshing network info cache for port 4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:00:40 user nova-compute[74611]: DEBUG nova.network.neutron [req-7c61ccf4-68ce-4579-a5c1-bb155ceb129f req-b9059557-ce95-41a5-8a91-f80aaa6f66b1 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Updated VIF entry in instance network info cache for port 4e7f5a25-370f-4d77-a8e9-b29f90a337bc. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:00:40 user nova-compute[74611]: DEBUG nova.network.neutron [req-7c61ccf4-68ce-4579-a5c1-bb155ceb129f req-b9059557-ce95-41a5-8a91-f80aaa6f66b1 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Updating instance_info_cache with network_info: [{"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:00:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c61ccf4-68ce-4579-a5c1-bb155ceb129f req-b9059557-ce95-41a5-8a91-f80aaa6f66b1 service nova] Releasing lock "refresh_cache-f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:00:40 user nova-compute[74611]: INFO nova.compute.manager [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Rebuilding instance
Nov 13 10:00:40 user nova-compute[74611]: DEBUG nova.compute.manager [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG nova.compute.manager [req-7a13c32e-2930-45b7-ba08-58d4e8fdc9d4 req-4c25c61e-1886-41b7-830f-48631d1b9459 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received event network-vif-unplugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7a13c32e-2930-45b7-ba08-58d4e8fdc9d4 req-4c25c61e-1886-41b7-830f-48631d1b9459 service nova] Acquiring lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7a13c32e-2930-45b7-ba08-58d4e8fdc9d4 req-4c25c61e-1886-41b7-830f-48631d1b9459 service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7a13c32e-2930-45b7-ba08-58d4e8fdc9d4 req-4c25c61e-1886-41b7-830f-48631d1b9459 service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG nova.compute.manager [req-7a13c32e-2930-45b7-ba08-58d4e8fdc9d4 req-4c25c61e-1886-41b7-830f-48631d1b9459 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] No waiting events found dispatching network-vif-unplugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:00:41 user nova-compute[74611]: WARNING nova.compute.manager [req-7a13c32e-2930-45b7-ba08-58d4e8fdc9d4 req-4c25c61e-1886-41b7-830f-48631d1b9459 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received unexpected event network-vif-unplugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc for instance with vm_state active and task_state rebuilding.
Nov 13 10:00:41 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b1913235-682f-486a-8b35-f917c3664eec is timed out.
Nov 13 10:00:41 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Successfully detached device vdb from instance b1913235-682f-486a-8b35-f917c3664eec from the live domain config.
Nov 13 10:00:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIemdhFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:00:41 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[485d16cc-5c6f-4173-9b67-c7ee0fc96d9a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:00:41 user nova-compute[74611]: No targets found.
Nov 13 10:00:41 user nova-compute[74611]: iSNS:
Nov 13 10:00:41 user nova-compute[74611]: No targets found.
Nov 13 10:00:41 user nova-compute[74611]: STATIC:
Nov 13 10:00:41 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373
Nov 13 10:00:41 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:41 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:41 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5
Nov 13 10:00:41 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:41 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:41 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425
Nov 13 10:00:41 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:41 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:41 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef
Nov 13 10:00:41 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:41 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:41 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c
Nov 13 10:00:41 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:41 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:41 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:00:41 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:41 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:41 user nova-compute[74611]: FIRMWARE:
Nov 13 10:00:41 user nova-compute[74611]: No targets found.
Nov 13 10:00:41 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:00:41 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:00:41 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:41 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Instance destroyed successfully.
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca48eeb-23f6-4440-bbd8-93bf07388e42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:41 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Instance destroyed successfully.
Nov 13 10:00:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1536159384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-465100190',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrNP72z9qjgl53p8K4Bq3orZH32b25sB2UyTgN3g4YZuL8kyeCNBH2NEmQXzAxuUQN/0PlafPwvEzbRPMpZH1ceGTQGF5og7k+5PrFKOPlIKNIvC13wL7dsDh6vUOEajw==',key_name='tempest-keypair-152512823',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:59:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='08875af299864cd9ac2d14fb5a9913fa',ramdisk_id='',reservation_id='r-i56vqppx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1007705503',owner_user_name='tempest-ServerActionsV293TestJSON-1007705503-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:00:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aee5968a8214444f83974d536878aaa3',uuid=f5cb6cf5-f915-4f50-bfc3-0112875dcfcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Converting VIF {"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=4e7f5a25-370f-4d77-a8e9-b29f90a337bc,network=Network(0c40801f-e2b5-4b56-acc2-1e6d7cf133ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7f5a25-37') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_vif [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=4e7f5a25-370f-4d77-a8e9-b29f90a337bc,network=Network(0c40801f-e2b5-4b56-acc2-1e6d7cf133ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7f5a25-37') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e7f5a25-37, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cac1d6f3-bff0-4412-9dcd-bf46bfbd4808) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fced9d1-cd74-4a5d-815c-2d140167e576]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:00:41 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:00:41 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:00:41 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:00:41 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:00:41 user nova-compute[74611]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef (non-flash)
Nov 13 10:00:41 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:00:41 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:00:41 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:00:41 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:00:41 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:00:41 user nova-compute[74611]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef (non-flash)
Nov 13 10:00:41 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb855d8dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef'): ({'sdg'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Removing single pathed devices sdg {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:41 user nova-compute[74611]: INFO os_vif [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=4e7f5a25-370f-4d77-a8e9-b29f90a337bc,network=Network(0c40801f-e2b5-4b56-acc2-1e6d7cf133ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7f5a25-37')
Nov 13 10:00:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnbdaUNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:00:41 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a28e7ae-1858-44d3-a27f-71c1525f424f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81cd3d5-bb28-4adc-ab94-6e80c5db356e]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Flushing IO for device /dev/sdg {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa71bf70-8855-4d8a-88d9-786dec09b3c9]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[db74209c-16a0-4b0b-ba69-0df9794fb2c1]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] SCSI volumes sdg have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:00:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa47d4f-f9a4-4367-8364-9a09f9edd6ea]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cb9117-610d-462d-9646-d9f5a0d45487]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef, portal: 172.16.0.220,3260]
Nov 13 10:00:42 user nova-compute[74611]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef, portal: 172.16.0.220,3260] successful.
Nov 13 10:00:42 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2dde92b-2f6f-4253-b842-40403946e1ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[173a3411-fe97-4396-8645-42d0449be394]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] <== disconnect_volume: return (353ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.250s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1ed3b1-8a01-4f9d-b96b-f3a467dc674d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:00:42 user nova-compute[74611]: No targets found.
Nov 13 10:00:42 user nova-compute[74611]: iSNS:
Nov 13 10:00:42 user nova-compute[74611]: No targets found.
Nov 13 10:00:42 user nova-compute[74611]: STATIC:
Nov 13 10:00:42 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373
Nov 13 10:00:42 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:42 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:42 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5
Nov 13 10:00:42 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:42 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:42 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425
Nov 13 10:00:42 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:42 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:42 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c
Nov 13 10:00:42 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:42 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:42 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:00:42 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:42 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:42 user nova-compute[74611]: FIRMWARE:
Nov 13 10:00:42 user nova-compute[74611]: No targets found.
Nov 13 10:00:42 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:00:42 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:00:42 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[955c9630-015f-4043-afbe-9d2a8f51820d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f323f1e5-f2cb-4518-af30-2cf5ca8cd014]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:00:42 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:00:42 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:00:42 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:00:42 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:00:42 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:00:42 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:00:42 user nova-compute[74611]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:00:42 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:00:42 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:00:42 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb84290c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5'): ({'sde'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Removing single pathed devices sde {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a309b1-dfb9-44b3-a760-0ecc06ee0e7f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaa1739-b8e8-4bfe-9898-592ebb2980c9]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Flushing IO for device /dev/sde {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[128b11fc-fddd-40c7-bcbb-03104a4ffaa0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1d9c3c-e0e2-47a5-82ca-9d97d609f673]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] SCSI volumes sde have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2e013f-ad62-4f04-83a5-61f35d4b6301]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9c6209-abc9-4115-8648-1fb8c5176534]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5, portal: 172.16.0.220,3260]
Nov 13 10:00:42 user nova-compute[74611]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5, portal: 172.16.0.220,3260] successful.
Nov 13 10:00:42 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d4e5d4-b5df-4a81-b273-68594d279efd]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] <== disconnect_volume: return (593ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:00:42 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Deleting instance files /opt/stack/data/nova/instances/f5cb6cf5-f915-4f50-bfc3-0112875dcfcc_del
Nov 13 10:00:42 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Deletion of /opt/stack/data/nova/instances/f5cb6cf5-f915-4f50-bfc3-0112875dcfcc_del complete
Nov 13 10:00:42 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance f5cb6cf5-f915-4f50-bfc3-0112875dcfcc could not be found.
Nov 13 10:00:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnbdaUNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:00:42 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ba424b-c5e6-44c0-a054-b7952101511c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:00:42 user nova-compute[74611]: No targets found.
Nov 13 10:00:42 user nova-compute[74611]: iSNS:
Nov 13 10:00:42 user nova-compute[74611]: No targets found.
Nov 13 10:00:42 user nova-compute[74611]: STATIC:
Nov 13 10:00:42 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373
Nov 13 10:00:42 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:42 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:42 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425
Nov 13 10:00:42 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:42 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:42 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c
Nov 13 10:00:42 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:42 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:42 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:00:42 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:00:42 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:00:42 user nova-compute[74611]: FIRMWARE:
Nov 13 10:00:42 user nova-compute[74611]: No targets found.
Nov 13 10:00:42 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:00:42 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:00:42 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ceb534-6f45-4b25-894d-5e1c3783ad6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7ee9e2-2ace-4494-80d3-001ff9b51665]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:00:42 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:00:42 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:00:42 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:00:42 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:00:42 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:00:42 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:00:42 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:00:42 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64366200>, {}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Disconnecting from: [] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] <== disconnect_volume: return (73ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lazy-loading 'flavor' on Instance uuid b1913235-682f-486a-8b35-f917c3664eec {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6672e041-4236-449b-a4b9-280ed592bc61 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "b1913235-682f-486a-8b35-f917c3664eec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.802s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "b1913235-682f-486a-8b35-f917c3664eec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.356s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "b1913235-682f-486a-8b35-f917c3664eec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:43 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:00:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-13908e8d-b174-49b3-b948-568df2cef2b9 req-a9907149-f5c5-49a4-b93c-07cd7fc863a2 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received event network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-13908e8d-b174-49b3-b948-568df2cef2b9 req-a9907149-f5c5-49a4-b93c-07cd7fc863a2 service nova] Acquiring lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-13908e8d-b174-49b3-b948-568df2cef2b9 req-a9907149-f5c5-49a4-b93c-07cd7fc863a2 service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-13908e8d-b174-49b3-b948-568df2cef2b9 req-a9907149-f5c5-49a4-b93c-07cd7fc863a2 service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-13908e8d-b174-49b3-b948-568df2cef2b9 req-a9907149-f5c5-49a4-b93c-07cd7fc863a2 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] No waiting events found dispatching network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:00:43 user nova-compute[74611]: WARNING nova.compute.manager [req-13908e8d-b174-49b3-b948-568df2cef2b9 req-a9907149-f5c5-49a4-b93c-07cd7fc863a2 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received unexpected event network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc for instance with vm_state active and task_state rebuilding.
Nov 13 10:00:43 user nova-compute[74611]: DEBUG nova.compute.manager [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Preparing to wait for external event volume-reimaged-a7437275-7b26-48c4-8727-b354462437e5 {{(pid=74611) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 13 10:00:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:44 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:00:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:44 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:00:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:00:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:00:47 user nova-compute[74611]: INFO nova.compute.claims [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Claim successful on node user
Nov 13 10:00:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:00:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.849s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG nova.network.neutron [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:00:48 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:00:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG nova.policy [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3227fb32ab644865880e5354d1306941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca1b2857119419e8d4cd65f6d77d9ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:00:48 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Creating image(s)
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "/opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "/opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "/opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.212s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:49 user nova-compute[74611]: DEBUG nova.network.neutron [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Successfully created port: 9c9a6625-758d-4420-996a-b18045a7e123 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:00:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49/disk 1073741824" returned: 0 in 0.103s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.231s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:49 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:00:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.network.neutron [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Successfully updated port: 9c9a6625-758d-4420-996a-b18045a7e123 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-96de0d65-8c5e-4b13-824d-961f5ce67029 req-ecf87565-1bd5-48a7-a1f7-cb35481a46ff service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Received event network-changed-9c9a6625-758d-4420-996a-b18045a7e123 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-96de0d65-8c5e-4b13-824d-961f5ce67029 req-ecf87565-1bd5-48a7-a1f7-cb35481a46ff service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Refreshing instance network info cache due to event network-changed-9c9a6625-758d-4420-996a-b18045a7e123. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-96de0d65-8c5e-4b13-824d-961f5ce67029 req-ecf87565-1bd5-48a7-a1f7-cb35481a46ff service nova] Acquiring lock "refresh_cache-ceabff0f-7be5-4fdc-9ac0-f49bc053be49" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-96de0d65-8c5e-4b13-824d-961f5ce67029 req-ecf87565-1bd5-48a7-a1f7-cb35481a46ff service nova] Acquired lock "refresh_cache-ceabff0f-7be5-4fdc-9ac0-f49bc053be49" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.network.neutron [req-96de0d65-8c5e-4b13-824d-961f5ce67029 req-ecf87565-1bd5-48a7-a1f7-cb35481a46ff service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Refreshing network info cache for port 9c9a6625-758d-4420-996a-b18045a7e123 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49/disk --force-share --output=json" returned: 0 in 0.609s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Cannot resize image /opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Ensure instance console log exists: /opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "refresh_cache-ceabff0f-7be5-4fdc-9ac0-f49bc053be49" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:00:50 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:00:50 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=7039MB free_disk=25.238449096679688GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.network.neutron [req-96de0d65-8c5e-4b13-824d-961f5ce67029 req-ecf87565-1bd5-48a7-a1f7-cb35481a46ff service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f5cb6cf5-f915-4f50-bfc3-0112875dcfcc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4970bd6b-69a6-479c-9f5f-bc5fc6021407 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ceabff0f-7be5-4fdc-9ac0-f49bc053be49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 23495073-10b7-4552-ad61-16fdf410956b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 89038547-5416-4942-8070-dd5dd8e4b6c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance b1913235-682f-486a-8b35-f917c3664eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 635636ea-96a0-4fdb-85a1-ca7a87b762f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 85cb3adb-b2b3-49ec-92ab-c2b7a028241a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 1c66c8a8-abb5-4f60-8464-074627c213d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance e99e1557-500f-407e-aefc-3b5cde9ceba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4dca8fcf-5fed-4cd1-b8db-61f271b93d20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance bedd770b-692e-4402-8724-2b9a8434a8fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.network.neutron [req-96de0d65-8c5e-4b13-824d-961f5ce67029 req-ecf87565-1bd5-48a7-a1f7-cb35481a46ff service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-96de0d65-8c5e-4b13-824d-961f5ce67029 req-ecf87565-1bd5-48a7-a1f7-cb35481a46ff service nova] Releasing lock "refresh_cache-ceabff0f-7be5-4fdc-9ac0-f49bc053be49" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquired lock "refresh_cache-ceabff0f-7be5-4fdc-9ac0-f49bc053be49" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.network.neutron [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.network.neutron [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.network.neutron [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Updating instance_info_cache with network_info: [{"id": "9c9a6625-758d-4420-996a-b18045a7e123", "address": "fa:16:3e:9f:35:61", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c9a6625-75", "ovs_interfaceid": "9c9a6625-758d-4420-996a-b18045a7e123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Releasing lock "refresh_cache-ceabff0f-7be5-4fdc-9ac0-f49bc053be49" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.manager [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Instance network_info: |[{"id": "9c9a6625-758d-4420-996a-b18045a7e123", "address": "fa:16:3e:9f:35:61", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c9a6625-75", "ovs_interfaceid": "9c9a6625-758d-4420-996a-b18045a7e123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Start _get_guest_xml network_info=[{"id": "9c9a6625-758d-4420-996a-b18045a7e123", "address": "fa:16:3e:9f:35:61", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c9a6625-75", "ovs_interfaceid": "9c9a6625-758d-4420-996a-b18045a7e123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:00:50 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:00:50 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:00:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-840872283',display_name='tempest-VolumesAdminNegativeTest-server-840872283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-840872283',id=26,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ca1b2857119419e8d4cd65f6d77d9ba',ramdisk_id='',reservation_id='r-ucnr0009',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1382146762',owner_user_name='tempest-VolumesAdminNegativeTest-1382146762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:00:49Z,user_data=None,user_id='3227fb32ab644865880e5354d1306941',uuid=ceabff0f-7be5-4fdc-9ac0-f49bc053be49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c9a6625-758d-4420-996a-b18045a7e123", "address": "fa:16:3e:9f:35:61", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c9a6625-75", "ovs_interfaceid": "9c9a6625-758d-4420-996a-b18045a7e123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Converting VIF {"id": "9c9a6625-758d-4420-996a-b18045a7e123", "address": "fa:16:3e:9f:35:61", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c9a6625-75", "ovs_interfaceid": "9c9a6625-758d-4420-996a-b18045a7e123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:35:61,bridge_name='br-int',has_traffic_filtering=True,id=9c9a6625-758d-4420-996a-b18045a7e123,network=Network(ca1cd594-c2c0-41e4-92dc-f828ce2b5423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c9a6625-75') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.objects.instance [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lazy-loading 'pci_devices' on Instance uuid ceabff0f-7be5-4fdc-9ac0-f49bc053be49 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:00:50 user nova-compute[74611]:   <uuid>ceabff0f-7be5-4fdc-9ac0-f49bc053be49</uuid>
Nov 13 10:00:50 user nova-compute[74611]:   <name>instance-0000001a</name>
Nov 13 10:00:50 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:00:50 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:00:50 user nova-compute[74611]:   <metadata>
Nov 13 10:00:50 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:00:50 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:00:50 user nova-compute[74611]:       <nova:name>tempest-VolumesAdminNegativeTest-server-840872283</nova:name>
Nov 13 10:00:50 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:00:50</nova:creationTime>
Nov 13 10:00:50 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:00:50 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:00:50 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:00:50 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:00:50 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:00:50 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:00:50 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:00:50 user nova-compute[74611]:       <nova:owner>
Nov 13 10:00:50 user nova-compute[74611]:         <nova:user uuid="3227fb32ab644865880e5354d1306941">tempest-VolumesAdminNegativeTest-1382146762-project-member</nova:user>
Nov 13 10:00:50 user nova-compute[74611]:         <nova:project uuid="0ca1b2857119419e8d4cd65f6d77d9ba">tempest-VolumesAdminNegativeTest-1382146762</nova:project>
Nov 13 10:00:50 user nova-compute[74611]:       </nova:owner>
Nov 13 10:00:50 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:00:50 user nova-compute[74611]:       <nova:ports>
Nov 13 10:00:50 user nova-compute[74611]:         <nova:port uuid="9c9a6625-758d-4420-996a-b18045a7e123">
Nov 13 10:00:50 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 10:00:50 user nova-compute[74611]:         </nova:port>
Nov 13 10:00:50 user nova-compute[74611]:       </nova:ports>
Nov 13 10:00:50 user nova-compute[74611]:     </nova:instance>
Nov 13 10:00:50 user nova-compute[74611]:   </metadata>
Nov 13 10:00:50 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:00:50 user nova-compute[74611]:     <system>
Nov 13 10:00:50 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:00:50 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:00:50 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:00:50 user nova-compute[74611]:       <entry name="serial">ceabff0f-7be5-4fdc-9ac0-f49bc053be49</entry>
Nov 13 10:00:50 user nova-compute[74611]:       <entry name="uuid">ceabff0f-7be5-4fdc-9ac0-f49bc053be49</entry>
Nov 13 10:00:50 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:00:50 user nova-compute[74611]:     </system>
Nov 13 10:00:50 user nova-compute[74611]:   </sysinfo>
Nov 13 10:00:50 user nova-compute[74611]:   <os>
Nov 13 10:00:50 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:00:50 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:00:50 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:00:50 user nova-compute[74611]:   </os>
Nov 13 10:00:50 user nova-compute[74611]:   <features>
Nov 13 10:00:50 user nova-compute[74611]:     <acpi/>
Nov 13 10:00:50 user nova-compute[74611]:     <apic/>
Nov 13 10:00:50 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:00:50 user nova-compute[74611]:   </features>
Nov 13 10:00:50 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:00:50 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:00:50 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:00:50 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:00:50 user nova-compute[74611]:   </clock>
Nov 13 10:00:50 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:00:50 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:00:50 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:00:50 user nova-compute[74611]:   </cpu>
Nov 13 10:00:50 user nova-compute[74611]:   <devices>
Nov 13 10:00:50 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:00:50 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:00:50 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49/disk"/>
Nov 13 10:00:50 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:00:50 user nova-compute[74611]:     </disk>
Nov 13 10:00:50 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:00:50 user nova-compute[74611]:       <mac address="fa:16:3e:9f:35:61"/>
Nov 13 10:00:50 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:00:50 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:00:50 user nova-compute[74611]:       <target dev="tap9c9a6625-75"/>
Nov 13 10:00:50 user nova-compute[74611]:     </interface>
Nov 13 10:00:50 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:00:50 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49/console.log" append="off"/>
Nov 13 10:00:50 user nova-compute[74611]:     </serial>
Nov 13 10:00:50 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:00:50 user nova-compute[74611]:     <video>
Nov 13 10:00:50 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:00:50 user nova-compute[74611]:     </video>
Nov 13 10:00:50 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:00:50 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:00:50 user nova-compute[74611]:     </rng>
Nov 13 10:00:50 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:00:50 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:00:50 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:00:50 user nova-compute[74611]:     </memballoon>
Nov 13 10:00:50 user nova-compute[74611]:   </devices>
Nov 13 10:00:50 user nova-compute[74611]: </domain>
Nov 13 10:00:50 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:00:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-840872283',display_name='tempest-VolumesAdminNegativeTest-server-840872283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-840872283',id=26,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ca1b2857119419e8d4cd65f6d77d9ba',ramdisk_id='',reservation_id='r-ucnr0009',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1382146762',owner_user_name='tempest-VolumesAdminNegativeTest-1382146762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:00:49Z,user_data=None,user_id='3227fb32ab644865880e5354d1306941',uuid=ceabff0f-7be5-4fdc-9ac0-f49bc053be49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c9a6625-758d-4420-996a-b18045a7e123", "address": "fa:16:3e:9f:35:61", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c9a6625-75", "ovs_interfaceid": "9c9a6625-758d-4420-996a-b18045a7e123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Converting VIF {"id": "9c9a6625-758d-4420-996a-b18045a7e123", "address": "fa:16:3e:9f:35:61", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c9a6625-75", "ovs_interfaceid": "9c9a6625-758d-4420-996a-b18045a7e123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:35:61,bridge_name='br-int',has_traffic_filtering=True,id=9c9a6625-758d-4420-996a-b18045a7e123,network=Network(ca1cd594-c2c0-41e4-92dc-f828ce2b5423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c9a6625-75') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG os_vif [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:35:61,bridge_name='br-int',has_traffic_filtering=True,id=9c9a6625-758d-4420-996a-b18045a7e123,network=Network(ca1cd594-c2c0-41e4-92dc-f828ce2b5423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c9a6625-75') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '737cd3df-4616-585f-836b-5df3e17956ac', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c9a6625-75, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c9a6625-75, col_values=(('qos', UUID('1055b080-375d-478e-afd1-3fee2e8de8af')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c9a6625-75, col_values=(('external_ids', {'iface-id': '9c9a6625-758d-4420-996a-b18045a7e123', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:35:61', 'vm-uuid': 'ceabff0f-7be5-4fdc-9ac0-f49bc053be49'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:50 user nova-compute[74611]: INFO os_vif [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:35:61,bridge_name='br-int',has_traffic_filtering=True,id=9c9a6625-758d-4420-996a-b18045a7e123,network=Network(ca1cd594-c2c0-41e4-92dc-f828ce2b5423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c9a6625-75')
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.719s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:00:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] No VIF found with MAC fa:16:3e:9f:35:61, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:00:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:00:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:00:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-0051eaab-b64d-4e49-bfee-b6c929961244 req-a74e4116-108f-47d6-9249-f8796f0db5da service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Received event network-vif-plugged-9c9a6625-758d-4420-996a-b18045a7e123 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0051eaab-b64d-4e49-bfee-b6c929961244 req-a74e4116-108f-47d6-9249-f8796f0db5da service nova] Acquiring lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0051eaab-b64d-4e49-bfee-b6c929961244 req-a74e4116-108f-47d6-9249-f8796f0db5da service nova] Lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0051eaab-b64d-4e49-bfee-b6c929961244 req-a74e4116-108f-47d6-9249-f8796f0db5da service nova] Lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-0051eaab-b64d-4e49-bfee-b6c929961244 req-a74e4116-108f-47d6-9249-f8796f0db5da service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] No waiting events found dispatching network-vif-plugged-9c9a6625-758d-4420-996a-b18045a7e123 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:00:52 user nova-compute[74611]: WARNING nova.compute.manager [req-0051eaab-b64d-4e49-bfee-b6c929961244 req-a74e4116-108f-47d6-9249-f8796f0db5da service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Received unexpected event network-vif-plugged-9c9a6625-758d-4420-996a-b18045a7e123 for instance with vm_state building and task_state spawning.
Nov 13 10:00:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-7ba1bab4-d670-4758-9015-c54d99d57f04 req-0a8ee3a8-440a-4c17-b843-471c713acd2d service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Received event network-vif-plugged-9c9a6625-758d-4420-996a-b18045a7e123 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7ba1bab4-d670-4758-9015-c54d99d57f04 req-0a8ee3a8-440a-4c17-b843-471c713acd2d service nova] Acquiring lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7ba1bab4-d670-4758-9015-c54d99d57f04 req-0a8ee3a8-440a-4c17-b843-471c713acd2d service nova] Lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7ba1bab4-d670-4758-9015-c54d99d57f04 req-0a8ee3a8-440a-4c17-b843-471c713acd2d service nova] Lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-7ba1bab4-d670-4758-9015-c54d99d57f04 req-0a8ee3a8-440a-4c17-b843-471c713acd2d service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] No waiting events found dispatching network-vif-plugged-9c9a6625-758d-4420-996a-b18045a7e123 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:00:54 user nova-compute[74611]: WARNING nova.compute.manager [req-7ba1bab4-d670-4758-9015-c54d99d57f04 req-0a8ee3a8-440a-4c17-b843-471c713acd2d service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Received unexpected event network-vif-plugged-9c9a6625-758d-4420-996a-b18045a7e123 for instance with vm_state building and task_state spawning.
Nov 13 10:00:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:00:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:00:54 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Instance spawned successfully.
Nov 13 10:00:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:00:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:00:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:00:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:00:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:00:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:00:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:00:54 user nova-compute[74611]: INFO nova.compute.manager [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 13 10:00:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:00:54 user nova-compute[74611]: INFO nova.compute.manager [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Took 7.21 seconds to build instance.
Nov 13 10:00:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9ce4ce91-bacd-4ee0-ba38-9705c24a782b tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.313s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-463a0405-d6d9-4142-8575-83e2108677f0 req-2443792a-3ecd-4be7-bc41-d3155ef4e987 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received event volume-reimaged-a7437275-7b26-48c4-8727-b354462437e5 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-463a0405-d6d9-4142-8575-83e2108677f0 req-2443792a-3ecd-4be7-bc41-d3155ef4e987 service nova] Acquiring lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-463a0405-d6d9-4142-8575-83e2108677f0 req-2443792a-3ecd-4be7-bc41-d3155ef4e987 service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-463a0405-d6d9-4142-8575-83e2108677f0 req-2443792a-3ecd-4be7-bc41-d3155ef4e987 service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-463a0405-d6d9-4142-8575-83e2108677f0 req-2443792a-3ecd-4be7-bc41-d3155ef4e987 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Processing event volume-reimaged-a7437275-7b26-48c4-8727-b354462437e5 {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG nova.compute.manager [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Instance event wait completed in 12 seconds for volume-reimaged {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:00:56 user nova-compute[74611]: INFO nova.virt.block_device [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Booting with volume a7437275-7b26-48c4-8727-b354462437e5 at /dev/vda
Nov 13 10:00:56 user nova-compute[74611]: DEBUG os_brick.utils [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa835a6-7453-4a76-9498-2d96a78937c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb2a76c-857d-419e-97e3-ff4f99f729f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc09fd2-f361-4ba8-9f7f-9e5df3cda5ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ea098c-8df8-47a7-9cf9-48b788d3fe08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:00:56 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:00:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a949255-125b-4a29-a406-68b152e2f6d2]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG os_brick.utils [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:00:56 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Updating existing volume attachment record: 1ddb6ed5-239f-4a25-8083-f5af888f6052 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:00:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:01:00 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Creating image(s)
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Ensure instance console log exists: /opt/stack/data/nova/instances/f5cb6cf5-f915-4f50-bfc3-0112875dcfcc/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Start _get_guest_xml network_info=[{"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '1ddb6ed5-239f-4a25-8083-f5af888f6052', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnbdaUNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f5cb6cf5-f915-4f50-bfc3-0112875dcfcc', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7437275-7b26-48c4-8727-b354462437e5', 'serial': 'a7437275-7b26-48c4-8727-b354462437e5'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:01:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 10:01:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.objects.instance [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lazy-loading 'vcpu_model' on Instance uuid f5cb6cf5-f915-4f50-bfc3-0112875dcfcc {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnbdaUNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:01:00 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 10:01:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:01:00 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 10:01:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:01:00 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5ea0fa-2dd0-413d-83fa-3bfc40146369]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:01:00 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb07852-5a39-4a49-b6f9-25954ce29bb1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5] added
Nov 13 10:01:00 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1070cce-40f6-436c-854c-ace8ee8aaa0d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a64d90-081a-4d04-be4b-8dd42e20e644]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnbdaUNJ {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnbdaUNJ" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f040023-24d4-4b67-bec3-6a3504dbd3eb]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MnbdaUNJ'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a200e85c-06ee-4b8b-86b5-335c5d3a1043]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23b82cf-fc0c-49f8-b494-04b1419d5a26]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:01:00 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:01:00 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:01:00 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:01:00 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:01:00 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:01:00 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:01:00 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:01:00 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:01:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7785f9c6-1637-4223-8540-4f4ae74db6f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5, portal: 172.16.0.220,3260]
Nov 13 10:01:01 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5, portal: 172.16.0.220,3260] successful.
Nov 13 10:01:01 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db6b00b-642a-49ec-b6b9-6da6a201e849]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6c94aa-b6a0-43f6-844c-8edce90d8d5a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:01:01 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:01:01 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:01:01 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:01:01 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:01:01 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:01:01 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:01:01 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:01:01 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:01:01 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:01:01 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6eaadf-978d-432b-88af-5a2fb2b561c6]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:01 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: None {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnbdaUNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23037383163343738', 'path': '/dev/sde'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037383163343738', 'path': '/dev/sde'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T09:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1536159384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-465100190',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrNP72z9qjgl53p8K4Bq3orZH32b25sB2UyTgN3g4YZuL8kyeCNBH2NEmQXzAxuUQN/0PlafPwvEzbRPMpZH1ceGTQGF5og7k+5PrFKOPlIKNIvC13wL7dsDh6vUOEajw==',key_name='tempest-keypair-152512823',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:59:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='08875af299864cd9ac2d14fb5a9913fa',ramdisk_id='',reservation_id='r-i56vqppx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1007705503',owner_user_name='tempest-ServerActionsV293TestJSON-1007705503-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aee5968a8214444f83974d536878aaa3',uuid=f5cb6cf5-f915-4f50-bfc3-0112875dcfcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Converting VIF {"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=4e7f5a25-370f-4d77-a8e9-b29f90a337bc,network=Network(0c40801f-e2b5-4b56-acc2-1e6d7cf133ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7f5a25-37') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:01:02 user nova-compute[74611]:   <uuid>f5cb6cf5-f915-4f50-bfc3-0112875dcfcc</uuid>
Nov 13 10:01:02 user nova-compute[74611]:   <name>instance-00000017</name>
Nov 13 10:01:02 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:01:02 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:01:02 user nova-compute[74611]:   <metadata>
Nov 13 10:01:02 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:01:02 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:01:02 user nova-compute[74611]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1536159384</nova:name>
Nov 13 10:01:02 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:01:00</nova:creationTime>
Nov 13 10:01:02 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:01:02 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:01:02 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:01:02 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:01:02 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:01:02 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:01:02 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:01:02 user nova-compute[74611]:       <nova:owner>
Nov 13 10:01:02 user nova-compute[74611]:         <nova:user uuid="aee5968a8214444f83974d536878aaa3">tempest-ServerActionsV293TestJSON-1007705503-project-member</nova:user>
Nov 13 10:01:02 user nova-compute[74611]:         <nova:project uuid="08875af299864cd9ac2d14fb5a9913fa">tempest-ServerActionsV293TestJSON-1007705503</nova:project>
Nov 13 10:01:02 user nova-compute[74611]:       </nova:owner>
Nov 13 10:01:02 user nova-compute[74611]:       <nova:ports>
Nov 13 10:01:02 user nova-compute[74611]:         <nova:port uuid="4e7f5a25-370f-4d77-a8e9-b29f90a337bc">
Nov 13 10:01:02 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 10:01:02 user nova-compute[74611]:         </nova:port>
Nov 13 10:01:02 user nova-compute[74611]:       </nova:ports>
Nov 13 10:01:02 user nova-compute[74611]:     </nova:instance>
Nov 13 10:01:02 user nova-compute[74611]:   </metadata>
Nov 13 10:01:02 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:01:02 user nova-compute[74611]:     <system>
Nov 13 10:01:02 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:01:02 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:01:02 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:01:02 user nova-compute[74611]:       <entry name="serial">f5cb6cf5-f915-4f50-bfc3-0112875dcfcc</entry>
Nov 13 10:01:02 user nova-compute[74611]:       <entry name="uuid">f5cb6cf5-f915-4f50-bfc3-0112875dcfcc</entry>
Nov 13 10:01:02 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:01:02 user nova-compute[74611]:     </system>
Nov 13 10:01:02 user nova-compute[74611]:   </sysinfo>
Nov 13 10:01:02 user nova-compute[74611]:   <os>
Nov 13 10:01:02 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:01:02 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:01:02 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:01:02 user nova-compute[74611]:   </os>
Nov 13 10:01:02 user nova-compute[74611]:   <features>
Nov 13 10:01:02 user nova-compute[74611]:     <acpi/>
Nov 13 10:01:02 user nova-compute[74611]:     <apic/>
Nov 13 10:01:02 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:01:02 user nova-compute[74611]:   </features>
Nov 13 10:01:02 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:01:02 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:01:02 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:01:02 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:01:02 user nova-compute[74611]:   </clock>
Nov 13 10:01:02 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:01:02 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:01:02 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:01:02 user nova-compute[74611]:   </cpu>
Nov 13 10:01:02 user nova-compute[74611]:   <devices>
Nov 13 10:01:02 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:01:02 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:01:02 user nova-compute[74611]:       <source dev="/dev/sde"/>
Nov 13 10:01:02 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:01:02 user nova-compute[74611]:       <serial>a7437275-7b26-48c4-8727-b354462437e5</serial>
Nov 13 10:01:02 user nova-compute[74611]:     </disk>
Nov 13 10:01:02 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:01:02 user nova-compute[74611]:       <mac address="fa:16:3e:43:32:2b"/>
Nov 13 10:01:02 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:01:02 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:01:02 user nova-compute[74611]:       <target dev="tap4e7f5a25-37"/>
Nov 13 10:01:02 user nova-compute[74611]:     </interface>
Nov 13 10:01:02 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:01:02 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/f5cb6cf5-f915-4f50-bfc3-0112875dcfcc/console.log" append="off"/>
Nov 13 10:01:02 user nova-compute[74611]:     </serial>
Nov 13 10:01:02 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:01:02 user nova-compute[74611]:     <video>
Nov 13 10:01:02 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:01:02 user nova-compute[74611]:     </video>
Nov 13 10:01:02 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:01:02 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:01:02 user nova-compute[74611]:     </rng>
Nov 13 10:01:02 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:01:02 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:01:02 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:01:02 user nova-compute[74611]:     </memballoon>
Nov 13 10:01:02 user nova-compute[74611]:   </devices>
Nov 13 10:01:02 user nova-compute[74611]: </domain>
Nov 13 10:01:02 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T09:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1536159384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-465100190',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrNP72z9qjgl53p8K4Bq3orZH32b25sB2UyTgN3g4YZuL8kyeCNBH2NEmQXzAxuUQN/0PlafPwvEzbRPMpZH1ceGTQGF5og7k+5PrFKOPlIKNIvC13wL7dsDh6vUOEajw==',key_name='tempest-keypair-152512823',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:59:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='08875af299864cd9ac2d14fb5a9913fa',ramdisk_id='',reservation_id='r-i56vqppx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1007705503',owner_user_name='tempest-ServerActionsV293TestJSON-1007705503-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aee5968a8214444f83974d536878aaa3',uuid=f5cb6cf5-f915-4f50-bfc3-0112875dcfcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Converting VIF {"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=4e7f5a25-370f-4d77-a8e9-b29f90a337bc,network=Network(0c40801f-e2b5-4b56-acc2-1e6d7cf133ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7f5a25-37') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG os_vif [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=4e7f5a25-370f-4d77-a8e9-b29f90a337bc,network=Network(0c40801f-e2b5-4b56-acc2-1e6d7cf133ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7f5a25-37') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92127587-c1bc-50fa-adc5-5444cfdc5fcc', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e7f5a25-37, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e7f5a25-37, col_values=(('qos', UUID('371e91ab-ad12-4288-97b5-496ae45c1863')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e7f5a25-37, col_values=(('external_ids', {'iface-id': '4e7f5a25-370f-4d77-a8e9-b29f90a337bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:32:2b', 'vm-uuid': 'f5cb6cf5-f915-4f50-bfc3-0112875dcfcc'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:02 user nova-compute[74611]: INFO os_vif [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=4e7f5a25-370f-4d77-a8e9-b29f90a337bc,network=Network(0c40801f-e2b5-4b56-acc2-1e6d7cf133ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7f5a25-37')
Nov 13 10:01:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:01:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] No VIF found with MAC fa:16:3e:43:32:2b, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:01:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:03 user nova-compute[74611]: DEBUG nova.compute.manager [req-2684132f-72f2-4677-abbc-465fc6ee0cc0 req-e95b023e-9231-47fe-83d5-669248446c36 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received event network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:01:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2684132f-72f2-4677-abbc-465fc6ee0cc0 req-e95b023e-9231-47fe-83d5-669248446c36 service nova] Acquiring lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2684132f-72f2-4677-abbc-465fc6ee0cc0 req-e95b023e-9231-47fe-83d5-669248446c36 service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2684132f-72f2-4677-abbc-465fc6ee0cc0 req-e95b023e-9231-47fe-83d5-669248446c36 service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:03 user nova-compute[74611]: DEBUG nova.compute.manager [req-2684132f-72f2-4677-abbc-465fc6ee0cc0 req-e95b023e-9231-47fe-83d5-669248446c36 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] No waiting events found dispatching network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:01:03 user nova-compute[74611]: WARNING nova.compute.manager [req-2684132f-72f2-4677-abbc-465fc6ee0cc0 req-e95b023e-9231-47fe-83d5-669248446c36 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received unexpected event network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc for instance with vm_state active and task_state rebuild_spawning.
Nov 13 10:01:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG nova.compute.manager [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:01:05 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Instance spawned successfully.
Nov 13 10:01:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG nova.compute.manager [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c53886d-524b-451c-a749-c7f69bc2d6ea req-0c33bf9c-065f-4663-af64-01deac071b36 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received event network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c53886d-524b-451c-a749-c7f69bc2d6ea req-0c33bf9c-065f-4663-af64-01deac071b36 service nova] Acquiring lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c53886d-524b-451c-a749-c7f69bc2d6ea req-0c33bf9c-065f-4663-af64-01deac071b36 service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c53886d-524b-451c-a749-c7f69bc2d6ea req-0c33bf9c-065f-4663-af64-01deac071b36 service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c53886d-524b-451c-a749-c7f69bc2d6ea req-0c33bf9c-065f-4663-af64-01deac071b36 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] No waiting events found dispatching network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:01:05 user nova-compute[74611]: WARNING nova.compute.manager [req-7c53886d-524b-451c-a749-c7f69bc2d6ea req-0c33bf9c-065f-4663-af64-01deac071b36 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received unexpected event network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc for instance with vm_state active and task_state rebuild_spawning.
Nov 13 10:01:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG nova.objects.instance [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74611) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 13 10:01:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-463a0405-d6d9-4142-8575-83e2108677f0 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.079s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:01:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:07 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:01:07 user nova-compute[74611]: INFO nova.compute.claims [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Claim successful on node user
Nov 13 10:01:08 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:01:08 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:01:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:08 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:01:08 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:01:08 user nova-compute[74611]: DEBUG nova.network.neutron [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:01:08 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:01:08 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:01:08 user nova-compute[74611]: DEBUG nova.policy [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '008616dff48b4bdeb2ea0f2be72a2934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a6f570a7e7404680bd5809be8b0378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:01:08 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:01:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:01:08 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Creating image(s)
Nov 13 10:01:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "/opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "/opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "/opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.183s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk 1073741824" returned: 0 in 0.060s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG nova.network.neutron [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Successfully created port: a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.208s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Checking if we can resize image /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Cannot resize image /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Ensure instance console log exists: /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG nova.network.neutron [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Successfully updated port: a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquired lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:01:09 user nova-compute[74611]: DEBUG nova.network.neutron [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.compute.manager [req-f61bfacd-d800-46e0-94e6-ba7bb9435d93 req-35bb84de-ba1a-4c65-9181-0f7af1773ad4 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received event network-changed-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.compute.manager [req-f61bfacd-d800-46e0-94e6-ba7bb9435d93 req-35bb84de-ba1a-4c65-9181-0f7af1773ad4 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Refreshing instance network info cache due to event network-changed-a2a9d4c3-0ad3-48b0-a588-65a18320392a. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f61bfacd-d800-46e0-94e6-ba7bb9435d93 req-35bb84de-ba1a-4c65-9181-0f7af1773ad4 service nova] Acquiring lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.network.neutron [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.compute.manager [req-bbf00f62-bfe7-4d6f-bf91-33f7d769280f req-b1ded7f0-019e-4915-9e13-04a69246239b service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Received event network-changed-89decc1b-05fe-40df-8378-4a68d1395b17 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.compute.manager [req-bbf00f62-bfe7-4d6f-bf91-33f7d769280f req-b1ded7f0-019e-4915-9e13-04a69246239b service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Refreshing instance network info cache due to event network-changed-89decc1b-05fe-40df-8378-4a68d1395b17. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bbf00f62-bfe7-4d6f-bf91-33f7d769280f req-b1ded7f0-019e-4915-9e13-04a69246239b service nova] Acquiring lock "refresh_cache-bedd770b-692e-4402-8724-2b9a8434a8fb" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bbf00f62-bfe7-4d6f-bf91-33f7d769280f req-b1ded7f0-019e-4915-9e13-04a69246239b service nova] Acquired lock "refresh_cache-bedd770b-692e-4402-8724-2b9a8434a8fb" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.network.neutron [req-bbf00f62-bfe7-4d6f-bf91-33f7d769280f req-b1ded7f0-019e-4915-9e13-04a69246239b service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Refreshing network info cache for port 89decc1b-05fe-40df-8378-4a68d1395b17 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.network.neutron [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Updating instance_info_cache with network_info: [{"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Releasing lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Instance network_info: |[{"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f61bfacd-d800-46e0-94e6-ba7bb9435d93 req-35bb84de-ba1a-4c65-9181-0f7af1773ad4 service nova] Acquired lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.network.neutron [req-f61bfacd-d800-46e0-94e6-ba7bb9435d93 req-35bb84de-ba1a-4c65-9181-0f7af1773ad4 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Refreshing network info cache for port a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Start _get_guest_xml network_info=[{"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:01:10 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:01:10 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:01:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-524802819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-524802819',id=27,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRrlMzFCuFCjqjYKCH+sueVQQbVqfjjNW/9j7fYfIOLB3UnjpV/tuyjC6WhmLe9LgwBS7VJ9bdKHTWsQ3e9xHMYL0Gm98yNrPr+71s8aupumxioGndh4CUCrqKGTpqA2w==',key_name='tempest-keypair-399446396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5a6f570a7e7404680bd5809be8b0378',ramdisk_id='',reservation_id='r-fk8bipxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-55203260',owner_user_name='tempest-AttachVolumeShelveTestJSON-55203260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:01:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008616dff48b4bdeb2ea0f2be72a2934',uuid=261e3e34-7a30-42f5-ae31-c3d3a76d0d67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converting VIF {"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9c:83,bridge_name='br-int',has_traffic_filtering=True,id=a2a9d4c3-0ad3-48b0-a588-65a18320392a,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a9d4c3-0a') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'pci_devices' on Instance uuid 261e3e34-7a30-42f5-ae31-c3d3a76d0d67 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:01:10 user nova-compute[74611]:   <uuid>261e3e34-7a30-42f5-ae31-c3d3a76d0d67</uuid>
Nov 13 10:01:10 user nova-compute[74611]:   <name>instance-0000001b</name>
Nov 13 10:01:10 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:01:10 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:01:10 user nova-compute[74611]:   <metadata>
Nov 13 10:01:10 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:01:10 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:01:10 user nova-compute[74611]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-524802819</nova:name>
Nov 13 10:01:10 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:01:10</nova:creationTime>
Nov 13 10:01:10 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:01:10 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:01:10 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:01:10 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:01:10 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:01:10 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:01:10 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:01:10 user nova-compute[74611]:       <nova:owner>
Nov 13 10:01:10 user nova-compute[74611]:         <nova:user uuid="008616dff48b4bdeb2ea0f2be72a2934">tempest-AttachVolumeShelveTestJSON-55203260-project-member</nova:user>
Nov 13 10:01:10 user nova-compute[74611]:         <nova:project uuid="d5a6f570a7e7404680bd5809be8b0378">tempest-AttachVolumeShelveTestJSON-55203260</nova:project>
Nov 13 10:01:10 user nova-compute[74611]:       </nova:owner>
Nov 13 10:01:10 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:01:10 user nova-compute[74611]:       <nova:ports>
Nov 13 10:01:10 user nova-compute[74611]:         <nova:port uuid="a2a9d4c3-0ad3-48b0-a588-65a18320392a">
Nov 13 10:01:10 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 10:01:10 user nova-compute[74611]:         </nova:port>
Nov 13 10:01:10 user nova-compute[74611]:       </nova:ports>
Nov 13 10:01:10 user nova-compute[74611]:     </nova:instance>
Nov 13 10:01:10 user nova-compute[74611]:   </metadata>
Nov 13 10:01:10 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:01:10 user nova-compute[74611]:     <system>
Nov 13 10:01:10 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:01:10 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:01:10 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:01:10 user nova-compute[74611]:       <entry name="serial">261e3e34-7a30-42f5-ae31-c3d3a76d0d67</entry>
Nov 13 10:01:10 user nova-compute[74611]:       <entry name="uuid">261e3e34-7a30-42f5-ae31-c3d3a76d0d67</entry>
Nov 13 10:01:10 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:01:10 user nova-compute[74611]:     </system>
Nov 13 10:01:10 user nova-compute[74611]:   </sysinfo>
Nov 13 10:01:10 user nova-compute[74611]:   <os>
Nov 13 10:01:10 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:01:10 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:01:10 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:01:10 user nova-compute[74611]:   </os>
Nov 13 10:01:10 user nova-compute[74611]:   <features>
Nov 13 10:01:10 user nova-compute[74611]:     <acpi/>
Nov 13 10:01:10 user nova-compute[74611]:     <apic/>
Nov 13 10:01:10 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:01:10 user nova-compute[74611]:   </features>
Nov 13 10:01:10 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:01:10 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:01:10 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:01:10 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:01:10 user nova-compute[74611]:   </clock>
Nov 13 10:01:10 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:01:10 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:01:10 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:01:10 user nova-compute[74611]:   </cpu>
Nov 13 10:01:10 user nova-compute[74611]:   <devices>
Nov 13 10:01:10 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:01:10 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:01:10 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk"/>
Nov 13 10:01:10 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:01:10 user nova-compute[74611]:     </disk>
Nov 13 10:01:10 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:01:10 user nova-compute[74611]:       <mac address="fa:16:3e:c9:9c:83"/>
Nov 13 10:01:10 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:01:10 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:01:10 user nova-compute[74611]:       <target dev="tapa2a9d4c3-0a"/>
Nov 13 10:01:10 user nova-compute[74611]:     </interface>
Nov 13 10:01:10 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:01:10 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/console.log" append="off"/>
Nov 13 10:01:10 user nova-compute[74611]:     </serial>
Nov 13 10:01:10 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:01:10 user nova-compute[74611]:     <video>
Nov 13 10:01:10 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:01:10 user nova-compute[74611]:     </video>
Nov 13 10:01:10 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:01:10 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:01:10 user nova-compute[74611]:     </rng>
Nov 13 10:01:10 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:01:10 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:01:10 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:01:10 user nova-compute[74611]:     </memballoon>
Nov 13 10:01:10 user nova-compute[74611]:   </devices>
Nov 13 10:01:10 user nova-compute[74611]: </domain>
Nov 13 10:01:10 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:01:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-524802819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-524802819',id=27,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRrlMzFCuFCjqjYKCH+sueVQQbVqfjjNW/9j7fYfIOLB3UnjpV/tuyjC6WhmLe9LgwBS7VJ9bdKHTWsQ3e9xHMYL0Gm98yNrPr+71s8aupumxioGndh4CUCrqKGTpqA2w==',key_name='tempest-keypair-399446396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5a6f570a7e7404680bd5809be8b0378',ramdisk_id='',reservation_id='r-fk8bipxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-55203260',owner_user_name='tempest-AttachVolumeShelveTestJSON-55203260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:01:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008616dff48b4bdeb2ea0f2be72a2934',uuid=261e3e34-7a30-42f5-ae31-c3d3a76d0d67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converting VIF {"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9c:83,bridge_name='br-int',has_traffic_filtering=True,id=a2a9d4c3-0ad3-48b0-a588-65a18320392a,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a9d4c3-0a') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG os_vif [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9c:83,bridge_name='br-int',has_traffic_filtering=True,id=a2a9d4c3-0ad3-48b0-a588-65a18320392a,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a9d4c3-0a') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a774d56-cbc3-5255-802c-7b936acdf1fe', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2a9d4c3-0a, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2a9d4c3-0a, col_values=(('qos', UUID('9d9f347e-4356-47fd-92b2-931cdcdcecf8')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2a9d4c3-0a, col_values=(('external_ids', {'iface-id': 'a2a9d4c3-0ad3-48b0-a588-65a18320392a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:9c:83', 'vm-uuid': '261e3e34-7a30-42f5-ae31-c3d3a76d0d67'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:10 user nova-compute[74611]: INFO os_vif [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9c:83,bridge_name='br-int',has_traffic_filtering=True,id=a2a9d4c3-0ad3-48b0-a588-65a18320392a,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a9d4c3-0a')
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] No VIF found with MAC fa:16:3e:c9:9c:83, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.network.neutron [req-bbf00f62-bfe7-4d6f-bf91-33f7d769280f req-b1ded7f0-019e-4915-9e13-04a69246239b service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Updated VIF entry in instance network info cache for port 89decc1b-05fe-40df-8378-4a68d1395b17. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.network.neutron [req-bbf00f62-bfe7-4d6f-bf91-33f7d769280f req-b1ded7f0-019e-4915-9e13-04a69246239b service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Updating instance_info_cache with network_info: [{"id": "89decc1b-05fe-40df-8378-4a68d1395b17", "address": "fa:16:3e:57:08:63", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89decc1b-05", "ovs_interfaceid": "89decc1b-05fe-40df-8378-4a68d1395b17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "bedd770b-692e-4402-8724-2b9a8434a8fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "bedd770b-692e-4402-8724-2b9a8434a8fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "bedd770b-692e-4402-8724-2b9a8434a8fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "bedd770b-692e-4402-8724-2b9a8434a8fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "bedd770b-692e-4402-8724-2b9a8434a8fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:10 user nova-compute[74611]: INFO nova.compute.manager [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Terminating instance
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bbf00f62-bfe7-4d6f-bf91-33f7d769280f req-b1ded7f0-019e-4915-9e13-04a69246239b service nova] Releasing lock "refresh_cache-bedd770b-692e-4402-8724-2b9a8434a8fb" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.network.neutron [req-f61bfacd-d800-46e0-94e6-ba7bb9435d93 req-35bb84de-ba1a-4c65-9181-0f7af1773ad4 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Updated VIF entry in instance network info cache for port a2a9d4c3-0ad3-48b0-a588-65a18320392a. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG nova.network.neutron [req-f61bfacd-d800-46e0-94e6-ba7bb9435d93 req-35bb84de-ba1a-4c65-9181-0f7af1773ad4 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Updating instance_info_cache with network_info: [{"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f61bfacd-d800-46e0-94e6-ba7bb9435d93 req-35bb84de-ba1a-4c65-9181-0f7af1773ad4 service nova] Releasing lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:01:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:11 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Instance destroyed successfully.
Nov 13 10:01:11 user nova-compute[74611]: DEBUG nova.objects.instance [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lazy-loading 'resources' on Instance uuid bedd770b-692e-4402-8724-2b9a8434a8fb {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1748558320',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1748558320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1748558320',id=24,image_ref='d47bcf64-bf67-4536-aa6d-5efb3b5156c9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/aqtwtX1z9yl0fbQizXkJtQY2tbnetOBwm9QbxIzeK4FmVBt21BJ9buua8rkCnRzMDQjFdwKC8xoEyj9HTdEbCdug0o6w6a1wtysTATuwR4P3EUYnHmZG+RlL5kK1F/A==',key_name='tempest-keypair-1099154900',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:59:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-jh3l2zow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-633061604',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=bedd770b-692e-4402-8724-2b9a8434a8fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89decc1b-05fe-40df-8378-4a68d1395b17", "address": "fa:16:3e:57:08:63", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89decc1b-05", "ovs_interfaceid": "89decc1b-05fe-40df-8378-4a68d1395b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "89decc1b-05fe-40df-8378-4a68d1395b17", "address": "fa:16:3e:57:08:63", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89decc1b-05", "ovs_interfaceid": "89decc1b-05fe-40df-8378-4a68d1395b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:08:63,bridge_name='br-int',has_traffic_filtering=True,id=89decc1b-05fe-40df-8378-4a68d1395b17,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89decc1b-05') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG os_vif [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:08:63,bridge_name='br-int',has_traffic_filtering=True,id=89decc1b-05fe-40df-8378-4a68d1395b17,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89decc1b-05') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89decc1b-05, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b670ee81-0c5e-4761-9434-8ddfdbae333f) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:11 user nova-compute[74611]: INFO os_vif [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:08:63,bridge_name='br-int',has_traffic_filtering=True,id=89decc1b-05fe-40df-8378-4a68d1395b17,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89decc1b-05')
Nov 13 10:01:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JNbILBCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:01:11 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:01:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:01:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[da03db62-a5e0-446b-8cc3-c3ff430a5e10]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:01:12 user nova-compute[74611]: No targets found.
Nov 13 10:01:12 user nova-compute[74611]: iSNS:
Nov 13 10:01:12 user nova-compute[74611]: No targets found.
Nov 13 10:01:12 user nova-compute[74611]: STATIC:
Nov 13 10:01:12 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373
Nov 13 10:01:12 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:01:12 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:01:12 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5
Nov 13 10:01:12 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:01:12 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:01:12 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425
Nov 13 10:01:12 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:01:12 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:01:12 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c
Nov 13 10:01:12 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:01:12 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:01:12 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:01:12 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:01:12 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:01:12 user nova-compute[74611]: FIRMWARE:
Nov 13 10:01:12 user nova-compute[74611]: No targets found.
Nov 13 10:01:12 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:01:12 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:01:12 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[664c6b00-0cda-42d4-b36b-59881709f3fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9093a9-a66b-4ef2-bc14-44268a8ec251]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:01:12 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:01:12 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:01:12 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:01:12 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:01:12 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:01:12 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:01:12 user nova-compute[74611]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c (non-flash)
Nov 13 10:01:12 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:01:12 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:01:12 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8424da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c'): ({'sdf'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Removing single pathed devices sdf {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[97db490e-f095-4424-b6f1-6f0f9f1d816b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67363a4-67ed-46da-844b-242dc4da1e1a]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flushing IO for device /dev/sdf {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7353298a-cbb0-4304-97b7-de289a48f61f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.071s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d13d315-1a20-4248-a3f9-33784364ce2a]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] SCSI volumes sdf have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db10940-1c0f-40a1-81b3-91a0d556391a]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-addbf81e-fd41-4690-bd12-9d0643b7ea61 req-b87b9f37-a2e1-4ac3-98ea-930ad710f3c1 service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Received event network-changed-c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-addbf81e-fd41-4690-bd12-9d0643b7ea61 req-b87b9f37-a2e1-4ac3-98ea-930ad710f3c1 service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Refreshing instance network info cache due to event network-changed-c2603a51-b07e-4040-b759-d8748ebd5fdc. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-addbf81e-fd41-4690-bd12-9d0643b7ea61 req-b87b9f37-a2e1-4ac3-98ea-930ad710f3c1 service nova] Acquiring lock "refresh_cache-b1913235-682f-486a-8b35-f917c3664eec" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-addbf81e-fd41-4690-bd12-9d0643b7ea61 req-b87b9f37-a2e1-4ac3-98ea-930ad710f3c1 service nova] Acquired lock "refresh_cache-b1913235-682f-486a-8b35-f917c3664eec" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG nova.network.neutron [req-addbf81e-fd41-4690-bd12-9d0643b7ea61 req-b87b9f37-a2e1-4ac3-98ea-930ad710f3c1 service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Refreshing network info cache for port c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-e06d472d-7f83-4709-978b-0b6f1a6bc157 req-8494409c-4fc1-4283-9e76-e17ac9e54d2e service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Received event network-vif-unplugged-89decc1b-05fe-40df-8378-4a68d1395b17 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e06d472d-7f83-4709-978b-0b6f1a6bc157 req-8494409c-4fc1-4283-9e76-e17ac9e54d2e service nova] Acquiring lock "bedd770b-692e-4402-8724-2b9a8434a8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e06d472d-7f83-4709-978b-0b6f1a6bc157 req-8494409c-4fc1-4283-9e76-e17ac9e54d2e service nova] Lock "bedd770b-692e-4402-8724-2b9a8434a8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e06d472d-7f83-4709-978b-0b6f1a6bc157 req-8494409c-4fc1-4283-9e76-e17ac9e54d2e service nova] Lock "bedd770b-692e-4402-8724-2b9a8434a8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-e06d472d-7f83-4709-978b-0b6f1a6bc157 req-8494409c-4fc1-4283-9e76-e17ac9e54d2e service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] No waiting events found dispatching network-vif-unplugged-89decc1b-05fe-40df-8378-4a68d1395b17 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-e06d472d-7f83-4709-978b-0b6f1a6bc157 req-8494409c-4fc1-4283-9e76-e17ac9e54d2e service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Received event network-vif-unplugged-89decc1b-05fe-40df-8378-4a68d1395b17 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-e06d472d-7f83-4709-978b-0b6f1a6bc157 req-8494409c-4fc1-4283-9e76-e17ac9e54d2e service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Received event network-vif-plugged-89decc1b-05fe-40df-8378-4a68d1395b17 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e06d472d-7f83-4709-978b-0b6f1a6bc157 req-8494409c-4fc1-4283-9e76-e17ac9e54d2e service nova] Acquiring lock "bedd770b-692e-4402-8724-2b9a8434a8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e06d472d-7f83-4709-978b-0b6f1a6bc157 req-8494409c-4fc1-4283-9e76-e17ac9e54d2e service nova] Lock "bedd770b-692e-4402-8724-2b9a8434a8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e06d472d-7f83-4709-978b-0b6f1a6bc157 req-8494409c-4fc1-4283-9e76-e17ac9e54d2e service nova] Lock "bedd770b-692e-4402-8724-2b9a8434a8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-e06d472d-7f83-4709-978b-0b6f1a6bc157 req-8494409c-4fc1-4283-9e76-e17ac9e54d2e service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] No waiting events found dispatching network-vif-plugged-89decc1b-05fe-40df-8378-4a68d1395b17 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:01:12 user nova-compute[74611]: WARNING nova.compute.manager [req-e06d472d-7f83-4709-978b-0b6f1a6bc157 req-8494409c-4fc1-4283-9e76-e17ac9e54d2e service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Received unexpected event network-vif-plugged-89decc1b-05fe-40df-8378-4a68d1395b17 for instance with vm_state active and task_state deleting.
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c79e7b5-6dde-4eb3-a0d2-58ec8dce219f]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c, portal: 172.16.0.220,3260]
Nov 13 10:01:12 user nova-compute[74611]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c, portal: 172.16.0.220,3260] successful.
Nov 13 10:01:12 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "b1913235-682f-486a-8b35-f917c3664eec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "b1913235-682f-486a-8b35-f917c3664eec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "b1913235-682f-486a-8b35-f917c3664eec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "b1913235-682f-486a-8b35-f917c3664eec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "b1913235-682f-486a-8b35-f917c3664eec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:12 user nova-compute[74611]: INFO nova.compute.manager [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Terminating instance
Nov 13 10:01:12 user nova-compute[74611]: DEBUG nova.compute.manager [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44df8ee2-15f9-450d-8616-a95f7a8a0d1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.064s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c442a98-9277-4f49-8ad5-8d065307b08e]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.498s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== disconnect_volume: return (501ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:01:12 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Deleting instance files /opt/stack/data/nova/instances/bedd770b-692e-4402-8724-2b9a8434a8fb_del
Nov 13 10:01:12 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Deletion of /opt/stack/data/nova/instances/bedd770b-692e-4402-8724-2b9a8434a8fb_del complete
Nov 13 10:01:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:12 user nova-compute[74611]: INFO nova.compute.manager [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Took 1.82 seconds to destroy the instance on the hypervisor.
Nov 13 10:01:12 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG nova.network.neutron [req-addbf81e-fd41-4690-bd12-9d0643b7ea61 req-b87b9f37-a2e1-4ac3-98ea-930ad710f3c1 service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Updated VIF entry in instance network info cache for port c2603a51-b07e-4040-b759-d8748ebd5fdc. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:01:12 user nova-compute[74611]: DEBUG nova.network.neutron [req-addbf81e-fd41-4690-bd12-9d0643b7ea61 req-b87b9f37-a2e1-4ac3-98ea-930ad710f3c1 service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Updating instance_info_cache with network_info: [{"id": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "address": "fa:16:3e:14:c0:79", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2603a51-b0", "ovs_interfaceid": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-addbf81e-fd41-4690-bd12-9d0643b7ea61 req-b87b9f37-a2e1-4ac3-98ea-930ad710f3c1 service nova] Releasing lock "refresh_cache-b1913235-682f-486a-8b35-f917c3664eec" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG nova.compute.manager [req-dc300604-8e06-444a-a431-3d9e71a1e2da req-fc7db65b-f730-4276-8383-a880ac151ebb service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Received event network-vif-unplugged-c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dc300604-8e06-444a-a431-3d9e71a1e2da req-fc7db65b-f730-4276-8383-a880ac151ebb service nova] Acquiring lock "b1913235-682f-486a-8b35-f917c3664eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dc300604-8e06-444a-a431-3d9e71a1e2da req-fc7db65b-f730-4276-8383-a880ac151ebb service nova] Lock "b1913235-682f-486a-8b35-f917c3664eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dc300604-8e06-444a-a431-3d9e71a1e2da req-fc7db65b-f730-4276-8383-a880ac151ebb service nova] Lock "b1913235-682f-486a-8b35-f917c3664eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG nova.compute.manager [req-dc300604-8e06-444a-a431-3d9e71a1e2da req-fc7db65b-f730-4276-8383-a880ac151ebb service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] No waiting events found dispatching network-vif-unplugged-c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG nova.compute.manager [req-dc300604-8e06-444a-a431-3d9e71a1e2da req-fc7db65b-f730-4276-8383-a880ac151ebb service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Received event network-vif-unplugged-c2603a51-b07e-4040-b759-d8748ebd5fdc for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:01:13 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: b1913235-682f-486a-8b35-f917c3664eec] Instance destroyed successfully.
Nov 13 10:01:13 user nova-compute[74611]: DEBUG nova.objects.instance [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lazy-loading 'resources' on Instance uuid b1913235-682f-486a-8b35-f917c3664eec {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1541398196',display_name='tempest-TestStampPattern-server-1541398196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1541398196',id=20,image_ref='6f2d558b-5f8a-4846-aed9-98fd66fd83ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7yEcTGCYgYQQ15n06GslTPAn66P3BsID6l5qVrR50yqGTIakIpEEZW+YrSNkhKYZHWTi4IFmCBW3J1HXYI+Mzp3JImjkhJzXOkCMzv7+aS8nhc5OnaYd9h98IBbTgI6g==',key_name='tempest-TestStampPattern-296911042',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:58:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ff71e8694b6414d9df6bc665eb0a9b9',ramdisk_id='',reservation_id='r-1sf2eqes',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='89038547-5416-4942-8070-dd5dd8e4b6c2',image_min_disk='1',image_min_ram='0',image_owner_id='3ff71e8694b6414d9df6bc665eb0a9b9',image_owner_project_name='tempest-TestStampPattern-833358871',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-833358871-project-member',image_user_id='43cba8f20865492e8f1c169e2b2b706c',owner_project_name='tempest-TestStampPattern-833358871',owner_user_name='tempest-TestStampPattern-833358871-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:58:30Z,user_data=None,user_id='43cba8f20865492e8f1c169e2b2b706c',uuid=b1913235-682f-486a-8b35-f917c3664eec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "address": "fa:16:3e:14:c0:79", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2603a51-b0", "ovs_interfaceid": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Converting VIF {"id": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "address": "fa:16:3e:14:c0:79", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2603a51-b0", "ovs_interfaceid": "c2603a51-b07e-4040-b759-d8748ebd5fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:c0:79,bridge_name='br-int',has_traffic_filtering=True,id=c2603a51-b07e-4040-b759-d8748ebd5fdc,network=Network(b8196669-7bef-4c06-b6bb-a32fabaec23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2603a51-b0') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG os_vif [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:c0:79,bridge_name='br-int',has_traffic_filtering=True,id=c2603a51-b07e-4040-b759-d8748ebd5fdc,network=Network(b8196669-7bef-4c06-b6bb-a32fabaec23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2603a51-b0') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2603a51-b0, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4dd5eb59-c33f-42fc-bb59-b347fbaeb59a) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:13 user nova-compute[74611]: INFO os_vif [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:c0:79,bridge_name='br-int',has_traffic_filtering=True,id=c2603a51-b07e-4040-b759-d8748ebd5fdc,network=Network(b8196669-7bef-4c06-b6bb-a32fabaec23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2603a51-b0')
Nov 13 10:01:13 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Deleting instance files /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec_del
Nov 13 10:01:13 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Deletion of /opt/stack/data/nova/instances/b1913235-682f-486a-8b35-f917c3664eec_del complete
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:13 user nova-compute[74611]: INFO nova.compute.manager [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: b1913235-682f-486a-8b35-f917c3664eec] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 13 10:01:13 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: b1913235-682f-486a-8b35-f917c3664eec] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: b1913235-682f-486a-8b35-f917c3664eec] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:13 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:01:13 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Took 1.29 seconds to deallocate network for instance.
Nov 13 10:01:13 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: b1913235-682f-486a-8b35-f917c3664eec] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:01:13 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: b1913235-682f-486a-8b35-f917c3664eec] Took 0.52 seconds to deallocate network for instance.
Nov 13 10:01:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-88b629a0-7a83-44fb-ae31-c281c5c39e4c req-6380d3af-cda1-4099-8f88-4d3fbfee892a service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Received event network-vif-deleted-c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-182af408-2641-4d5b-aac8-00aa78f1be6c req-3e1cd0ad-3ec3-4fd7-b766-e24b84228c82 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received event network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-182af408-2641-4d5b-aac8-00aa78f1be6c req-3e1cd0ad-3ec3-4fd7-b766-e24b84228c82 service nova] Acquiring lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-182af408-2641-4d5b-aac8-00aa78f1be6c req-3e1cd0ad-3ec3-4fd7-b766-e24b84228c82 service nova] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-182af408-2641-4d5b-aac8-00aa78f1be6c req-3e1cd0ad-3ec3-4fd7-b766-e24b84228c82 service nova] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-182af408-2641-4d5b-aac8-00aa78f1be6c req-3e1cd0ad-3ec3-4fd7-b766-e24b84228c82 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] No waiting events found dispatching network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:01:14 user nova-compute[74611]: WARNING nova.compute.manager [req-182af408-2641-4d5b-aac8-00aa78f1be6c req-3e1cd0ad-3ec3-4fd7-b766-e24b84228c82 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received unexpected event network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a for instance with vm_state building and task_state spawning.
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-182af408-2641-4d5b-aac8-00aa78f1be6c req-3e1cd0ad-3ec3-4fd7-b766-e24b84228c82 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received event network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-182af408-2641-4d5b-aac8-00aa78f1be6c req-3e1cd0ad-3ec3-4fd7-b766-e24b84228c82 service nova] Acquiring lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-182af408-2641-4d5b-aac8-00aa78f1be6c req-3e1cd0ad-3ec3-4fd7-b766-e24b84228c82 service nova] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-182af408-2641-4d5b-aac8-00aa78f1be6c req-3e1cd0ad-3ec3-4fd7-b766-e24b84228c82 service nova] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-182af408-2641-4d5b-aac8-00aa78f1be6c req-3e1cd0ad-3ec3-4fd7-b766-e24b84228c82 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] No waiting events found dispatching network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:01:14 user nova-compute[74611]: WARNING nova.compute.manager [req-182af408-2641-4d5b-aac8-00aa78f1be6c req-3e1cd0ad-3ec3-4fd7-b766-e24b84228c82 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received unexpected event network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a for instance with vm_state building and task_state spawning.
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.580s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:01:14 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Deleted allocations for instance b1913235-682f-486a-8b35-f917c3664eec
Nov 13 10:01:14 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Instance spawned successfully.
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:01:14 user nova-compute[74611]: INFO nova.compute.manager [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Took 0.77 seconds to detach 1 volumes for instance.
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Deleting volume: 44df8ee2-15f9-450d-8616-a95f7a8a0d1c {{(pid=74611) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1e4e3f88-c131-4940-9d38-5ec334bb7963 tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "b1913235-682f-486a-8b35-f917c3664eec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.276s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:14 user nova-compute[74611]: INFO nova.compute.manager [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Took 6.11 seconds to spawn the instance on the hypervisor.
Nov 13 10:01:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:14 user nova-compute[74611]: INFO nova.compute.manager [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Took 7.07 seconds to build instance.
Nov 13 10:01:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dad0aa38-d9fa-499a-b191-2d3919b4437f tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.227s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:15 user nova-compute[74611]: DEBUG nova.compute.manager [req-b4d7317c-f736-4e25-ad61-a68c374774bf req-6b9fc7f6-54b8-4d50-9dcc-4a2417934644 service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Received event network-vif-plugged-c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:01:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b4d7317c-f736-4e25-ad61-a68c374774bf req-6b9fc7f6-54b8-4d50-9dcc-4a2417934644 service nova] Acquiring lock "b1913235-682f-486a-8b35-f917c3664eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b4d7317c-f736-4e25-ad61-a68c374774bf req-6b9fc7f6-54b8-4d50-9dcc-4a2417934644 service nova] Lock "b1913235-682f-486a-8b35-f917c3664eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b4d7317c-f736-4e25-ad61-a68c374774bf req-6b9fc7f6-54b8-4d50-9dcc-4a2417934644 service nova] Lock "b1913235-682f-486a-8b35-f917c3664eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:15 user nova-compute[74611]: DEBUG nova.compute.manager [req-b4d7317c-f736-4e25-ad61-a68c374774bf req-6b9fc7f6-54b8-4d50-9dcc-4a2417934644 service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] No waiting events found dispatching network-vif-plugged-c2603a51-b07e-4040-b759-d8748ebd5fdc {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:01:15 user nova-compute[74611]: WARNING nova.compute.manager [req-b4d7317c-f736-4e25-ad61-a68c374774bf req-6b9fc7f6-54b8-4d50-9dcc-4a2417934644 service nova] [instance: b1913235-682f-486a-8b35-f917c3664eec] Received unexpected event network-vif-plugged-c2603a51-b07e-4040-b759-d8748ebd5fdc for instance with vm_state deleted and task_state None.
Nov 13 10:01:15 user nova-compute[74611]: DEBUG nova.compute.manager [req-b4d7317c-f736-4e25-ad61-a68c374774bf req-6b9fc7f6-54b8-4d50-9dcc-4a2417934644 service nova] [instance: bedd770b-692e-4402-8724-2b9a8434a8fb] Received event network-vif-deleted-89decc1b-05fe-40df-8378-4a68d1395b17 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:01:15 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:01:15 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:01:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.621s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:15 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Deleted allocations for instance bedd770b-692e-4402-8724-2b9a8434a8fb
Nov 13 10:01:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-842a1878-30ff-451d-bdce-f493547e6e9d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "bedd770b-692e-4402-8724-2b9a8434a8fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.788s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:38 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:01:38 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:01:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:01:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:01:38 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:01:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:38 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Updating instance_info_cache with network_info: [{"id": "e5967c05-de89-4853-b421-516eb483271e", "address": "fa:16:3e:c6:32:07", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5967c05-de", "ovs_interfaceid": "e5967c05-de89-4853-b421-516eb483271e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:01:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:01:38 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:01:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:39 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:01:39 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:01:42 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:01:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:01:43 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:01:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'flavor' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquired lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'info_cache' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.objects.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Object Instance<e99e1557-500f-407e-aefc-3b5cde9ceba0> lazy-loaded attributes: flavor,info_cache {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Updating instance_info_cache with network_info: [{"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Releasing lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:01:44 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Instance destroyed successfully.
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'resources' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.objects.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Object Instance<e99e1557-500f-407e-aefc-3b5cde9ceba0> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1508598088',display_name='tempest-AttachVolumeTestJSON-server-1508598088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1508598088',id=18,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgN2fOxghmivj853mZ2ksKDLn8tdFXuOHZwAmmMU0voEMAFBi/R/0d3RmLKBvhLUKwr6VaNoAX27Qgtk/V6TuVskjG8QOa9sC9yhByta66dRmM6E1ACXtMK3U+5xSdm5g==',key_name='tempest-keypair-977132060',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:57:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ce3f0d3282d547249997fdad18cefc9c',ramdisk_id='',reservation_id='r-tmd58a9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-658018398',owner_user_name='tempest-AttachVolumeTestJSON-658018398-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:59:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0428809075cd41f0a6eb84c21e9abfed',uuid=e99e1557-500f-407e-aefc-3b5cde9ceba0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converting VIF {"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_vif [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16c3fba0-60, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=816dfdcc-2564-4b05-b662-90d058304ac9) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:44 user nova-compute[74611]: INFO os_vif [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60')
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtITMiZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:01:44 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[256532d0-f0c5-4611-9a21-0cd167b5caf5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:01:44 user nova-compute[74611]: No targets found.
Nov 13 10:01:44 user nova-compute[74611]: iSNS:
Nov 13 10:01:44 user nova-compute[74611]: No targets found.
Nov 13 10:01:44 user nova-compute[74611]: STATIC:
Nov 13 10:01:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373
Nov 13 10:01:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:01:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:01:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5
Nov 13 10:01:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:01:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:01:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425
Nov 13 10:01:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:01:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:01:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:01:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:01:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:01:44 user nova-compute[74611]: FIRMWARE:
Nov 13 10:01:44 user nova-compute[74611]: No targets found.
Nov 13 10:01:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:01:44 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:01:44 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a81ba2c-2343-451b-bb96-56f237ad0818]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3961588f-213c-45db-ac6d-79c027842f92]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:01:44 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:01:44 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:01:44 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:01:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:01:44 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:01:44 user nova-compute[74611]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:01:44 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:01:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7c2b7640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[341f8487-8ac2-4e16-91fe-9c40f9656a9a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ca4dbf-82df-4179-b5d9-0513ab752f55]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c321cb31-4c08-4bad-8873-87124d34b535]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69df538-6ecc-499f-a3a6-138d30a403ed]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[913ae8a7-dcde-49a3-b0a8-787afc0ae9f9]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0562fde0-877e-434c-a1a0-ea5e163ce61c]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425, portal: 172.16.0.220,3260]
Nov 13 10:01:44 user nova-compute[74611]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425, portal: 172.16.0.220,3260] successful.
Nov 13 10:01:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74e2237-12ee-4e45-beef-8d167e11c33c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] <== disconnect_volume: return (310ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Start _get_guest_xml network_info=[{"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': '6c06eed6-6e3c-43fe-be13-b8b8c5027afc', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtITMiZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e99e1557-500f-407e-aefc-3b5cde9ceba0', 'attached_at': '', 'detached_at': '', 'volume_id': '921d5d4b-260c-4d54-80c6-24610845e425', 'serial': '921d5d4b-260c-4d54-80c6-24610845e425'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'numa_topology' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.objects.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Object Instance<e99e1557-500f-407e-aefc-3b5cde9ceba0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:01:44 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:01:44 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'vcpu_model' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.objects.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Object Instance<e99e1557-500f-407e-aefc-3b5cde9ceba0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtITMiZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:01:44 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:01:44 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:01:44 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daab660-5f08-47af-9dda-ee93a719f8a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:01:44 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[50feb562-e3a2-4c1f-8817-db62f7ed16a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425] added
Nov 13 10:01:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f0f675-e501-4714-993a-716eb4d6a6d8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa96f2d-e150-4df4-af66-711ddee142f0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtITMiZe {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtITMiZe" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfeb5ce-b5d7-43d1-a099-7e3f9deff18e]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OtITMiZe'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f971776c-9186-4a8c-936a-8a441006ddc1]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1493973-dbd2-4d46-b462-c0fdcad85956]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:01:45 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:01:45 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:01:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:01:45 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:01:45 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:01:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[49832024-3862-42c4-87b3-4ef593459d64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425, portal: 172.16.0.220,3260]
Nov 13 10:01:45 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425, portal: 172.16.0.220,3260] successful.
Nov 13 10:01:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb18c65-b205-4492-8988-bde358d4c9d2]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[141ce2c2-d0cf-42a5-a572-06f354245ba8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:01:45 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:01:45 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:01:45 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:01:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:01:45 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:01:45 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:01:45 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:01:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[674f2a4a-d0fc-46aa-9a41-1b969964f751]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:01:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtITMiZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23334636132643361', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334636132643361', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1508598088',display_name='tempest-AttachVolumeTestJSON-server-1508598088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1508598088',id=18,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgN2fOxghmivj853mZ2ksKDLn8tdFXuOHZwAmmMU0voEMAFBi/R/0d3RmLKBvhLUKwr6VaNoAX27Qgtk/V6TuVskjG8QOa9sC9yhByta66dRmM6E1ACXtMK3U+5xSdm5g==',key_name='tempest-keypair-977132060',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:57:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ce3f0d3282d547249997fdad18cefc9c',ramdisk_id='',reservation_id='r-tmd58a9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-658018398',owner_user_name='tempest-AttachVolumeTestJSON-658018398-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:59:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0428809075cd41f0a6eb84c21e9abfed',uuid=e99e1557-500f-407e-aefc-3b5cde9ceba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converting VIF {"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'pci_devices' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG nova.objects.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Object Instance<e99e1557-500f-407e-aefc-3b5cde9ceba0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:01:46 user nova-compute[74611]:   <uuid>e99e1557-500f-407e-aefc-3b5cde9ceba0</uuid>
Nov 13 10:01:46 user nova-compute[74611]:   <name>instance-00000012</name>
Nov 13 10:01:46 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:01:46 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:01:46 user nova-compute[74611]:   <metadata>
Nov 13 10:01:46 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:01:46 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:01:46 user nova-compute[74611]:       <nova:name>tempest-AttachVolumeTestJSON-server-1508598088</nova:name>
Nov 13 10:01:46 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:01:44</nova:creationTime>
Nov 13 10:01:46 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:01:46 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:01:46 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:01:46 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:01:46 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:01:46 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:01:46 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:01:46 user nova-compute[74611]:       <nova:owner>
Nov 13 10:01:46 user nova-compute[74611]:         <nova:user uuid="0428809075cd41f0a6eb84c21e9abfed">tempest-AttachVolumeTestJSON-658018398-project-member</nova:user>
Nov 13 10:01:46 user nova-compute[74611]:         <nova:project uuid="ce3f0d3282d547249997fdad18cefc9c">tempest-AttachVolumeTestJSON-658018398</nova:project>
Nov 13 10:01:46 user nova-compute[74611]:       </nova:owner>
Nov 13 10:01:46 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:01:46 user nova-compute[74611]:       <nova:ports>
Nov 13 10:01:46 user nova-compute[74611]:         <nova:port uuid="16c3fba0-6005-4fd4-a1b9-005df1f6771b">
Nov 13 10:01:46 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 10:01:46 user nova-compute[74611]:         </nova:port>
Nov 13 10:01:46 user nova-compute[74611]:       </nova:ports>
Nov 13 10:01:46 user nova-compute[74611]:     </nova:instance>
Nov 13 10:01:46 user nova-compute[74611]:   </metadata>
Nov 13 10:01:46 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:01:46 user nova-compute[74611]:     <system>
Nov 13 10:01:46 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:01:46 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:01:46 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:01:46 user nova-compute[74611]:       <entry name="serial">e99e1557-500f-407e-aefc-3b5cde9ceba0</entry>
Nov 13 10:01:46 user nova-compute[74611]:       <entry name="uuid">e99e1557-500f-407e-aefc-3b5cde9ceba0</entry>
Nov 13 10:01:46 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:01:46 user nova-compute[74611]:     </system>
Nov 13 10:01:46 user nova-compute[74611]:   </sysinfo>
Nov 13 10:01:46 user nova-compute[74611]:   <os>
Nov 13 10:01:46 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:01:46 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:01:46 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:01:46 user nova-compute[74611]:   </os>
Nov 13 10:01:46 user nova-compute[74611]:   <features>
Nov 13 10:01:46 user nova-compute[74611]:     <acpi/>
Nov 13 10:01:46 user nova-compute[74611]:     <apic/>
Nov 13 10:01:46 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:01:46 user nova-compute[74611]:   </features>
Nov 13 10:01:46 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:01:46 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:01:46 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:01:46 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:01:46 user nova-compute[74611]:   </clock>
Nov 13 10:01:46 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:01:46 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:01:46 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:01:46 user nova-compute[74611]:   </cpu>
Nov 13 10:01:46 user nova-compute[74611]:   <devices>
Nov 13 10:01:46 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:01:46 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:01:46 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk"/>
Nov 13 10:01:46 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:01:46 user nova-compute[74611]:     </disk>
Nov 13 10:01:46 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:01:46 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:01:46 user nova-compute[74611]:       <source dev="/dev/sdb"/>
Nov 13 10:01:46 user nova-compute[74611]:       <target dev="vdb" bus="virtio"/>
Nov 13 10:01:46 user nova-compute[74611]:       <serial>921d5d4b-260c-4d54-80c6-24610845e425</serial>
Nov 13 10:01:46 user nova-compute[74611]:     </disk>
Nov 13 10:01:46 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:01:46 user nova-compute[74611]:       <mac address="fa:16:3e:e0:90:1a"/>
Nov 13 10:01:46 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:01:46 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:01:46 user nova-compute[74611]:       <target dev="tap16c3fba0-60"/>
Nov 13 10:01:46 user nova-compute[74611]:     </interface>
Nov 13 10:01:46 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:01:46 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/console.log" append="off"/>
Nov 13 10:01:46 user nova-compute[74611]:     </serial>
Nov 13 10:01:46 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:01:46 user nova-compute[74611]:     <video>
Nov 13 10:01:46 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:01:46 user nova-compute[74611]:     </video>
Nov 13 10:01:46 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:01:46 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:01:46 user nova-compute[74611]:     </rng>
Nov 13 10:01:46 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:01:46 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:01:46 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:01:46 user nova-compute[74611]:     </memballoon>
Nov 13 10:01:46 user nova-compute[74611]:   </devices>
Nov 13 10:01:46 user nova-compute[74611]: </domain>
Nov 13 10:01:46 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'trusted_certs' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG nova.objects.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Object Instance<e99e1557-500f-407e-aefc-3b5cde9ceba0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Cannot resize image /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'migration_context' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG nova.objects.base [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Object Instance<e99e1557-500f-407e-aefc-3b5cde9ceba0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1508598088',display_name='tempest-AttachVolumeTestJSON-server-1508598088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1508598088',id=18,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgN2fOxghmivj853mZ2ksKDLn8tdFXuOHZwAmmMU0voEMAFBi/R/0d3RmLKBvhLUKwr6VaNoAX27Qgtk/V6TuVskjG8QOa9sC9yhByta66dRmM6E1ACXtMK3U+5xSdm5g==',key_name='tempest-keypair-977132060',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:57:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ce3f0d3282d547249997fdad18cefc9c',ramdisk_id='',reservation_id='r-tmd58a9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-658018398',owner_user_name='tempest-AttachVolumeTestJSON-658018398-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T09:59:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0428809075cd41f0a6eb84c21e9abfed',uuid=e99e1557-500f-407e-aefc-3b5cde9ceba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converting VIF {"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG os_vif [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e82700cd-979d-5172-915f-24ee4909c24d', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16c3fba0-60, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16c3fba0-60, col_values=(('qos', UUID('ed495599-c2c2-4754-b99e-1e315afa1355')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16c3fba0-60, col_values=(('external_ids', {'iface-id': '16c3fba0-6005-4fd4-a1b9-005df1f6771b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:90:1a', 'vm-uuid': 'e99e1557-500f-407e-aefc-3b5cde9ceba0'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:47 user nova-compute[74611]: INFO os_vif [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60')
Nov 13 10:01:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG nova.compute.manager [req-59812cc6-1fe0-4e57-bbcf-cfc3428c40d0 req-a6c1be4b-76d7-44e2-ba8e-5649a0e3550e service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-59812cc6-1fe0-4e57-bbcf-cfc3428c40d0 req-a6c1be4b-76d7-44e2-ba8e-5649a0e3550e service nova] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-59812cc6-1fe0-4e57-bbcf-cfc3428c40d0 req-a6c1be4b-76d7-44e2-ba8e-5649a0e3550e service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-59812cc6-1fe0-4e57-bbcf-cfc3428c40d0 req-a6c1be4b-76d7-44e2-ba8e-5649a0e3550e service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG nova.compute.manager [req-59812cc6-1fe0-4e57-bbcf-cfc3428c40d0 req-a6c1be4b-76d7-44e2-ba8e-5649a0e3550e service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] No waiting events found dispatching network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:01:48 user nova-compute[74611]: WARNING nova.compute.manager [req-59812cc6-1fe0-4e57-bbcf-cfc3428c40d0 req-a6c1be4b-76d7-44e2-ba8e-5649a0e3550e service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received unexpected event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b for instance with vm_state stopped and task_state powering-on.
Nov 13 10:01:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:50 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:01:50 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Instance rebooted successfully.
Nov 13 10:01:50 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6096571f-2201-433b-87ca-6116643b8a13 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:01:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-e9de2ca9-b50d-4eff-854d-58d8b7d15063 req-5aaa5c24-587a-424b-83ca-6b5cc00e3eae service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:01:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e9de2ca9-b50d-4eff-854d-58d8b7d15063 req-5aaa5c24-587a-424b-83ca-6b5cc00e3eae service nova] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e9de2ca9-b50d-4eff-854d-58d8b7d15063 req-5aaa5c24-587a-424b-83ca-6b5cc00e3eae service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e9de2ca9-b50d-4eff-854d-58d8b7d15063 req-5aaa5c24-587a-424b-83ca-6b5cc00e3eae service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-e9de2ca9-b50d-4eff-854d-58d8b7d15063 req-5aaa5c24-587a-424b-83ca-6b5cc00e3eae service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] No waiting events found dispatching network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:01:50 user nova-compute[74611]: WARNING nova.compute.manager [req-e9de2ca9-b50d-4eff-854d-58d8b7d15063 req-5aaa5c24-587a-424b-83ca-6b5cc00e3eae service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received unexpected event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b for instance with vm_state stopped and task_state powering-on.
Nov 13 10:01:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:01:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:01:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:01:51 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:01:51 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=6910MB free_disk=25.154109954833984GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 85cb3adb-b2b3-49ec-92ab-c2b7a028241a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 1c66c8a8-abb5-4f60-8464-074627c213d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 89038547-5416-4942-8070-dd5dd8e4b6c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4dca8fcf-5fed-4cd1-b8db-61f271b93d20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance e99e1557-500f-407e-aefc-3b5cde9ceba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4970bd6b-69a6-479c-9f5f-bc5fc6021407 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 635636ea-96a0-4fdb-85a1-ca7a87b762f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f5cb6cf5-f915-4f50-bfc3-0112875dcfcc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 23495073-10b7-4552-ad61-16fdf410956b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ceabff0f-7be5-4fdc-9ac0-f49bc053be49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 261e3e34-7a30-42f5-ae31-c3d3a76d0d67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:01:51 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:01:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:01:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.610s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:01:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:53 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:01:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:01:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:02 user nova-compute[74611]: INFO nova.compute.manager [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Terminating instance
Nov 13 10:02:02 user nova-compute[74611]: DEBUG nova.compute.manager [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:02:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-6c6e554c-b7d4-4e60-8a13-e8eaf0ea70ff req-a99427de-3e06-4102-94a7-1070488930f6 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Received event network-vif-unplugged-a49d8a46-5910-496b-a366-dbf873e81748 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6c6e554c-b7d4-4e60-8a13-e8eaf0ea70ff req-a99427de-3e06-4102-94a7-1070488930f6 service nova] Acquiring lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6c6e554c-b7d4-4e60-8a13-e8eaf0ea70ff req-a99427de-3e06-4102-94a7-1070488930f6 service nova] Lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6c6e554c-b7d4-4e60-8a13-e8eaf0ea70ff req-a99427de-3e06-4102-94a7-1070488930f6 service nova] Lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-6c6e554c-b7d4-4e60-8a13-e8eaf0ea70ff req-a99427de-3e06-4102-94a7-1070488930f6 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] No waiting events found dispatching network-vif-unplugged-a49d8a46-5910-496b-a366-dbf873e81748 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-6c6e554c-b7d4-4e60-8a13-e8eaf0ea70ff req-a99427de-3e06-4102-94a7-1070488930f6 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Received event network-vif-unplugged-a49d8a46-5910-496b-a366-dbf873e81748 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:02:03 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Instance destroyed successfully.
Nov 13 10:02:03 user nova-compute[74611]: DEBUG nova.objects.instance [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lazy-loading 'resources' on Instance uuid 4dca8fcf-5fed-4cd1-b8db-61f271b93d20 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1315669298',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1315669298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1315669298',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzgUqg7kdjn4KeG9rPNkMbmVu086xV3JV1xbiUBzg4WtgG7GNLkc6mx1YWAf+PnYL0G4TXrG4AJa840v7zu30ubs0bgRP0UrWwbfCA7lfNV8c9MA9jsSCrNEagu7vnnsQ==',key_name='tempest-keypair-1427390821',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:57:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-iu0ach9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:57:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=4dca8fcf-5fed-4cd1-b8db-61f271b93d20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a49d8a46-5910-496b-a366-dbf873e81748", "address": "fa:16:3e:4f:94:ae", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49d8a46-59", "ovs_interfaceid": "a49d8a46-5910-496b-a366-dbf873e81748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "a49d8a46-5910-496b-a366-dbf873e81748", "address": "fa:16:3e:4f:94:ae", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49d8a46-59", "ovs_interfaceid": "a49d8a46-5910-496b-a366-dbf873e81748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:94:ae,bridge_name='br-int',has_traffic_filtering=True,id=a49d8a46-5910-496b-a366-dbf873e81748,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49d8a46-59') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_vif [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:94:ae,bridge_name='br-int',has_traffic_filtering=True,id=a49d8a46-5910-496b-a366-dbf873e81748,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49d8a46-59') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa49d8a46-59, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9dcedb5e-eb43-48a6-8d22-303dd9859f4f) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:02:03 user nova-compute[74611]: INFO os_vif [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:94:ae,bridge_name='br-int',has_traffic_filtering=True,id=a49d8a46-5910-496b-a366-dbf873e81748,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49d8a46-59')
Nov 13 10:02:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWyGPcbV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:02:03 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccd348b-8dae-4313-ad9d-a4e0a0cb9746]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:02:03 user nova-compute[74611]: No targets found.
Nov 13 10:02:03 user nova-compute[74611]: iSNS:
Nov 13 10:02:03 user nova-compute[74611]: No targets found.
Nov 13 10:02:03 user nova-compute[74611]: STATIC:
Nov 13 10:02:03 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373
Nov 13 10:02:03 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:03 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:03 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5
Nov 13 10:02:03 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:03 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:03 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425
Nov 13 10:02:03 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:03 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:03 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:02:03 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:03 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:03 user nova-compute[74611]: FIRMWARE:
Nov 13 10:02:03 user nova-compute[74611]: No targets found.
Nov 13 10:02:03 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:02:03 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:02:03 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d21220e-d706-4050-a6f1-b164af9fb8c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[17734462-c538-4825-ba4a-60b513e5caae]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:03 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:02:03 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:02:03 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:03 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:03 user nova-compute[74611]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 (non-flash)
Nov 13 10:02:03 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:02:03 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:03 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb644328c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373'): ({'sdd'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Removing single pathed devices sdd {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[df43180d-7e05-4b57-85ee-2558f84f0a37]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f15f0f-3b48-492c-82e8-ebac0d5a15f8]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flushing IO for device /dev/sdd {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c67751e-d6f0-4ed6-8281-72f808dde89c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[18386a4d-f9f2-400d-8341-14efc208908b]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] SCSI volumes sdd have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3f303e3d', '/dev/disk/by-id/scsi-23139613533353436', '/dev/disk/by-id/scsi-1SCST_BIO3f303e3d-19a53546f6964c47') {{(pid=85776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 10:02:03 user nova-compute[74611]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_3f303e3d
Nov 13 10:02:03 user nova-compute[74611]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23139613533353436
Nov 13 10:02:03 user nova-compute[74611]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO3f303e3d-19a53546f6964c47
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0874fa5a-8df0-4a5a-aa55-605270acd30e]: (4, None) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c36415-6aa9-4dc4-a639-7fccff967de8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbac4a0-7aa6-4796-8617-99733f8992ae]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373, portal: 172.16.0.220,3260]
Nov 13 10:02:03 user nova-compute[74611]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373, portal: 172.16.0.220,3260] successful.
Nov 13 10:02:03 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:643e04eb-4c49-4334-81ee-51a6b3478373 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ee2f09-8b7a-4212-8c4c-3cdc6216a89f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== disconnect_volume: return (400ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:02:03 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Deleting instance files /opt/stack/data/nova/instances/4dca8fcf-5fed-4cd1-b8db-61f271b93d20_del
Nov 13 10:02:03 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Deletion of /opt/stack/data/nova/instances/4dca8fcf-5fed-4cd1-b8db-61f271b93d20_del complete
Nov 13 10:02:03 user nova-compute[74611]: INFO nova.compute.manager [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 13 10:02:03 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:02:03 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:02:04 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:04 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Took 0.76 seconds to deallocate network for instance.
Nov 13 10:02:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-5ef43170-3579-4c0e-9ba5-691304d1e413 req-451272b4-fef4-410b-bd39-62e6a46f6427 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Received event network-vif-deleted-a49d8a46-5910-496b-a366-dbf873e81748 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:04 user nova-compute[74611]: INFO nova.compute.manager [req-5ef43170-3579-4c0e-9ba5-691304d1e413 req-451272b4-fef4-410b-bd39-62e6a46f6427 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Neutron deleted interface a49d8a46-5910-496b-a366-dbf873e81748; detaching it from the instance and deleting it from the info cache
Nov 13 10:02:04 user nova-compute[74611]: DEBUG nova.network.neutron [req-5ef43170-3579-4c0e-9ba5-691304d1e413 req-451272b4-fef4-410b-bd39-62e6a46f6427 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-5ef43170-3579-4c0e-9ba5-691304d1e413 req-451272b4-fef4-410b-bd39-62e6a46f6427 service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Detach interface failed, port_id=a49d8a46-5910-496b-a366-dbf873e81748, reason: Instance 4dca8fcf-5fed-4cd1-b8db-61f271b93d20 could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 10:02:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-051f2e23-6e48-4638-bae6-58b44424baeb req-532e1fd3-0ac9-46f5-8ec1-2d13c7d5105f service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Received event network-vif-plugged-a49d8a46-5910-496b-a366-dbf873e81748 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-051f2e23-6e48-4638-bae6-58b44424baeb req-532e1fd3-0ac9-46f5-8ec1-2d13c7d5105f service nova] Acquiring lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-051f2e23-6e48-4638-bae6-58b44424baeb req-532e1fd3-0ac9-46f5-8ec1-2d13c7d5105f service nova] Lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-051f2e23-6e48-4638-bae6-58b44424baeb req-532e1fd3-0ac9-46f5-8ec1-2d13c7d5105f service nova] Lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-051f2e23-6e48-4638-bae6-58b44424baeb req-532e1fd3-0ac9-46f5-8ec1-2d13c7d5105f service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] No waiting events found dispatching network-vif-plugged-a49d8a46-5910-496b-a366-dbf873e81748 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:04 user nova-compute[74611]: WARNING nova.compute.manager [req-051f2e23-6e48-4638-bae6-58b44424baeb req-532e1fd3-0ac9-46f5-8ec1-2d13c7d5105f service nova] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Received unexpected event network-vif-plugged-a49d8a46-5910-496b-a366-dbf873e81748 for instance with vm_state active and task_state deleting.
Nov 13 10:02:05 user nova-compute[74611]: INFO nova.compute.manager [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Took 0.74 seconds to detach 1 volumes for instance.
Nov 13 10:02:05 user nova-compute[74611]: DEBUG nova.compute.manager [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 4dca8fcf-5fed-4cd1-b8db-61f271b93d20] Deleting volume: 643e04eb-4c49-4334-81ee-51a6b3478373 {{(pid=74611) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 10:02:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:05 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:02:05 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:02:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:05 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Deleted allocations for instance 4dca8fcf-5fed-4cd1-b8db-61f271b93d20
Nov 13 10:02:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-636ece07-b7ed-483c-b61c-503ab82e2b18 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "4dca8fcf-5fed-4cd1-b8db-61f271b93d20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.583s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG nova.compute.manager [req-1fe6cfd0-1d21-4068-a92b-74feb1960273 req-2a8357f4-7afb-4cd3-9be2-0e9b8493413b service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Received event network-changed-b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG nova.compute.manager [req-1fe6cfd0-1d21-4068-a92b-74feb1960273 req-2a8357f4-7afb-4cd3-9be2-0e9b8493413b service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Refreshing instance network info cache due to event network-changed-b7d65c35-0bb4-49fc-886d-4f9606372e9a. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1fe6cfd0-1d21-4068-a92b-74feb1960273 req-2a8357f4-7afb-4cd3-9be2-0e9b8493413b service nova] Acquiring lock "refresh_cache-89038547-5416-4942-8070-dd5dd8e4b6c2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1fe6cfd0-1d21-4068-a92b-74feb1960273 req-2a8357f4-7afb-4cd3-9be2-0e9b8493413b service nova] Acquired lock "refresh_cache-89038547-5416-4942-8070-dd5dd8e4b6c2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG nova.network.neutron [req-1fe6cfd0-1d21-4068-a92b-74feb1960273 req-2a8357f4-7afb-4cd3-9be2-0e9b8493413b service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Refreshing network info cache for port b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "89038547-5416-4942-8070-dd5dd8e4b6c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "89038547-5416-4942-8070-dd5dd8e4b6c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:06 user nova-compute[74611]: INFO nova.compute.manager [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Terminating instance
Nov 13 10:02:06 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG nova.compute.manager [req-2af592bc-ef5e-41d3-9423-eeb1c8c97cb2 req-9ffe26de-366d-4919-b924-f0981591ea80 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Received event network-vif-unplugged-b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2af592bc-ef5e-41d3-9423-eeb1c8c97cb2 req-9ffe26de-366d-4919-b924-f0981591ea80 service nova] Acquiring lock "89038547-5416-4942-8070-dd5dd8e4b6c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2af592bc-ef5e-41d3-9423-eeb1c8c97cb2 req-9ffe26de-366d-4919-b924-f0981591ea80 service nova] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2af592bc-ef5e-41d3-9423-eeb1c8c97cb2 req-9ffe26de-366d-4919-b924-f0981591ea80 service nova] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG nova.compute.manager [req-2af592bc-ef5e-41d3-9423-eeb1c8c97cb2 req-9ffe26de-366d-4919-b924-f0981591ea80 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] No waiting events found dispatching network-vif-unplugged-b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG nova.compute.manager [req-2af592bc-ef5e-41d3-9423-eeb1c8c97cb2 req-9ffe26de-366d-4919-b924-f0981591ea80 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Received event network-vif-unplugged-b7d65c35-0bb4-49fc-886d-4f9606372e9a for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG nova.network.neutron [req-1fe6cfd0-1d21-4068-a92b-74feb1960273 req-2a8357f4-7afb-4cd3-9be2-0e9b8493413b service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Updated VIF entry in instance network info cache for port b7d65c35-0bb4-49fc-886d-4f9606372e9a. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG nova.network.neutron [req-1fe6cfd0-1d21-4068-a92b-74feb1960273 req-2a8357f4-7afb-4cd3-9be2-0e9b8493413b service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Updating instance_info_cache with network_info: [{"id": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "address": "fa:16:3e:78:67:ad", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d65c35-0b", "ovs_interfaceid": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1fe6cfd0-1d21-4068-a92b-74feb1960273 req-2a8357f4-7afb-4cd3-9be2-0e9b8493413b service nova] Releasing lock "refresh_cache-89038547-5416-4942-8070-dd5dd8e4b6c2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:02:07 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Instance destroyed successfully.
Nov 13 10:02:07 user nova-compute[74611]: DEBUG nova.objects.instance [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lazy-loading 'resources' on Instance uuid 89038547-5416-4942-8070-dd5dd8e4b6c2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:02:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1632814246',display_name='tempest-TestStampPattern-server-1632814246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1632814246',id=13,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7yEcTGCYgYQQ15n06GslTPAn66P3BsID6l5qVrR50yqGTIakIpEEZW+YrSNkhKYZHWTi4IFmCBW3J1HXYI+Mzp3JImjkhJzXOkCMzv7+aS8nhc5OnaYd9h98IBbTgI6g==',key_name='tempest-TestStampPattern-296911042',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ff71e8694b6414d9df6bc665eb0a9b9',ramdisk_id='',reservation_id='r-k79l0y3m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-833358871',owner_user_name='tempest-TestStampPattern-833358871-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:58:18Z,user_data=None,user_id='43cba8f20865492e8f1c169e2b2b706c',uuid=89038547-5416-4942-8070-dd5dd8e4b6c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "address": "fa:16:3e:78:67:ad", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d65c35-0b", "ovs_interfaceid": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:02:07 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Converting VIF {"id": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "address": "fa:16:3e:78:67:ad", "network": {"id": "b8196669-7bef-4c06-b6bb-a32fabaec23c", "bridge": "br-int", "label": "tempest-TestStampPattern-345038212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ff71e8694b6414d9df6bc665eb0a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d65c35-0b", "ovs_interfaceid": "b7d65c35-0bb4-49fc-886d-4f9606372e9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:02:07 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:67:ad,bridge_name='br-int',has_traffic_filtering=True,id=b7d65c35-0bb4-49fc-886d-4f9606372e9a,network=Network(b8196669-7bef-4c06-b6bb-a32fabaec23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d65c35-0b') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:02:07 user nova-compute[74611]: DEBUG os_vif [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:67:ad,bridge_name='br-int',has_traffic_filtering=True,id=b7d65c35-0bb4-49fc-886d-4f9606372e9a,network=Network(b8196669-7bef-4c06-b6bb-a32fabaec23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d65c35-0b') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:02:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7d65c35-0b, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f8d1985-44d1-47e1-aba4-b67a2a5f423f) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:07 user nova-compute[74611]: INFO os_vif [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:67:ad,bridge_name='br-int',has_traffic_filtering=True,id=b7d65c35-0bb4-49fc-886d-4f9606372e9a,network=Network(b8196669-7bef-4c06-b6bb-a32fabaec23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d65c35-0b')
Nov 13 10:02:07 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Deleting instance files /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2_del
Nov 13 10:02:07 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Deletion of /opt/stack/data/nova/instances/89038547-5416-4942-8070-dd5dd8e4b6c2_del complete
Nov 13 10:02:07 user nova-compute[74611]: INFO nova.compute.manager [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 13 10:02:07 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:02:07 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:02:07 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:02:07 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:07 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Took 0.50 seconds to deallocate network for instance.
Nov 13 10:02:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:08 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:02:08 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:02:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:08 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Deleted allocations for instance 89038547-5416-4942-8070-dd5dd8e4b6c2
Nov 13 10:02:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c0e801e7-1bc4-4f9f-9e00-df0f4c3979fc tempest-TestStampPattern-833358871 tempest-TestStampPattern-833358871-project-member] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.059s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-4a3a8e77-a3da-42c2-b7a7-fae54f60670b req-e94c42e2-b404-4e93-b0b9-d3ae8292d6e3 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Received event network-vif-plugged-b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4a3a8e77-a3da-42c2-b7a7-fae54f60670b req-e94c42e2-b404-4e93-b0b9-d3ae8292d6e3 service nova] Acquiring lock "89038547-5416-4942-8070-dd5dd8e4b6c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4a3a8e77-a3da-42c2-b7a7-fae54f60670b req-e94c42e2-b404-4e93-b0b9-d3ae8292d6e3 service nova] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4a3a8e77-a3da-42c2-b7a7-fae54f60670b req-e94c42e2-b404-4e93-b0b9-d3ae8292d6e3 service nova] Lock "89038547-5416-4942-8070-dd5dd8e4b6c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-4a3a8e77-a3da-42c2-b7a7-fae54f60670b req-e94c42e2-b404-4e93-b0b9-d3ae8292d6e3 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] No waiting events found dispatching network-vif-plugged-b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:08 user nova-compute[74611]: WARNING nova.compute.manager [req-4a3a8e77-a3da-42c2-b7a7-fae54f60670b req-e94c42e2-b404-4e93-b0b9-d3ae8292d6e3 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Received unexpected event network-vif-plugged-b7d65c35-0bb4-49fc-886d-4f9606372e9a for instance with vm_state deleted and task_state None.
Nov 13 10:02:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-4a3a8e77-a3da-42c2-b7a7-fae54f60670b req-e94c42e2-b404-4e93-b0b9-d3ae8292d6e3 service nova] [instance: 89038547-5416-4942-8070-dd5dd8e4b6c2] Received event network-vif-deleted-b7d65c35-0bb4-49fc-886d-4f9606372e9a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:02:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:10 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:02:10 user nova-compute[74611]: INFO nova.compute.claims [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Claim successful on node user
Nov 13 10:02:10 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:02:10 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:02:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:02:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:02:10 user nova-compute[74611]: DEBUG nova.network.neutron [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:02:10 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:02:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG nova.policy [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '863471360be04ab5acb07ef3e99007c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9ab18bb67e4db19e6c3366771ad218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG nova.compute.manager [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:02:11 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Creating image(s)
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "/opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "/opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.183s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-85a803a7-7c11-4011-b3c1-0f6f4455ff02 req-1364864d-9b40-40c9-99fb-6606df6beda8 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Received event network-changed-cc222aae-de55-44ac-be3c-38b357e4c811 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-85a803a7-7c11-4011-b3c1-0f6f4455ff02 req-1364864d-9b40-40c9-99fb-6606df6beda8 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Refreshing instance network info cache due to event network-changed-cc222aae-de55-44ac-be3c-38b357e4c811. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-85a803a7-7c11-4011-b3c1-0f6f4455ff02 req-1364864d-9b40-40c9-99fb-6606df6beda8 service nova] Acquiring lock "refresh_cache-23495073-10b7-4552-ad61-16fdf410956b" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-85a803a7-7c11-4011-b3c1-0f6f4455ff02 req-1364864d-9b40-40c9-99fb-6606df6beda8 service nova] Acquired lock "refresh_cache-23495073-10b7-4552-ad61-16fdf410956b" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG nova.network.neutron [req-85a803a7-7c11-4011-b3c1-0f6f4455ff02 req-1364864d-9b40-40c9-99fb-6606df6beda8 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Refreshing network info cache for port cc222aae-de55-44ac-be3c-38b357e4c811 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk 1073741824" returned: 0 in 0.067s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG nova.network.neutron [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Successfully created port: ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.186s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Cannot resize image /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Ensure instance console log exists: /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.network.neutron [req-85a803a7-7c11-4011-b3c1-0f6f4455ff02 req-1364864d-9b40-40c9-99fb-6606df6beda8 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Updated VIF entry in instance network info cache for port cc222aae-de55-44ac-be3c-38b357e4c811. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.network.neutron [req-85a803a7-7c11-4011-b3c1-0f6f4455ff02 req-1364864d-9b40-40c9-99fb-6606df6beda8 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Updating instance_info_cache with network_info: [{"id": "cc222aae-de55-44ac-be3c-38b357e4c811", "address": "fa:16:3e:56:8b:98", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc222aae-de", "ovs_interfaceid": "cc222aae-de55-44ac-be3c-38b357e4c811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-85a803a7-7c11-4011-b3c1-0f6f4455ff02 req-1364864d-9b40-40c9-99fb-6606df6beda8 service nova] Releasing lock "refresh_cache-23495073-10b7-4552-ad61-16fdf410956b" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.network.neutron [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Successfully updated port: ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquired lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.network.neutron [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-6d745e50-6b39-4742-a3af-223ee413bbc0 req-4e77037e-f14d-467f-96c7-087ad476291b service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-changed-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-6d745e50-6b39-4742-a3af-223ee413bbc0 req-4e77037e-f14d-467f-96c7-087ad476291b service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Refreshing instance network info cache due to event network-changed-ffb1eb13-f028-447f-a01d-45bae2d17edd. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6d745e50-6b39-4742-a3af-223ee413bbc0 req-4e77037e-f14d-467f-96c7-087ad476291b service nova] Acquiring lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.network.neutron [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.network.neutron [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Updating instance_info_cache with network_info: [{"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Releasing lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.compute.manager [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Instance network_info: |[{"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6d745e50-6b39-4742-a3af-223ee413bbc0 req-4e77037e-f14d-467f-96c7-087ad476291b service nova] Acquired lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.network.neutron [req-6d745e50-6b39-4742-a3af-223ee413bbc0 req-4e77037e-f14d-467f-96c7-087ad476291b service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Refreshing network info cache for port ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Start _get_guest_xml network_info=[{"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:02:12 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:02:12 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-444308231',display_name='tempest-ServerRescueNegativeTestJSON-server-444308231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-444308231',id=28,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIRCQ9tYBQJ2Euvs7EpBOn3hJTaw2Vrx9tlGYc3FTElAI39JHbVLOxgQPucNZb3Ubif7cKCIZtlfjaxGMqTy7zAtScYXSjAUwAvWJc8/a4aSJoP6GFgfWY4Zy4/89qcIA==',key_name='tempest-keypair-1249039539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae9ab18bb67e4db19e6c3366771ad218',ramdisk_id='',reservation_id='r-3wrgft7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-961432289',owner_user_name='tempest-ServerRescueNegativeTestJSON-961432289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863471360be04ab5acb07ef3e99007c4',uuid=4fa9e23b-30f2-41ae-83ed-86145389d474,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converting VIF {"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:0a:26,bridge_name='br-int',has_traffic_filtering=True,id=ffb1eb13-f028-447f-a01d-45bae2d17edd,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb1eb13-f0') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.objects.instance [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fa9e23b-30f2-41ae-83ed-86145389d474 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:02:12 user nova-compute[74611]:   <uuid>4fa9e23b-30f2-41ae-83ed-86145389d474</uuid>
Nov 13 10:02:12 user nova-compute[74611]:   <name>instance-0000001c</name>
Nov 13 10:02:12 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:02:12 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:02:12 user nova-compute[74611]:   <metadata>
Nov 13 10:02:12 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:02:12 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:02:12 user nova-compute[74611]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-444308231</nova:name>
Nov 13 10:02:12 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:02:12</nova:creationTime>
Nov 13 10:02:12 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:02:12 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:02:12 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:02:12 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:02:12 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:02:12 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:02:12 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:02:12 user nova-compute[74611]:       <nova:owner>
Nov 13 10:02:12 user nova-compute[74611]:         <nova:user uuid="863471360be04ab5acb07ef3e99007c4">tempest-ServerRescueNegativeTestJSON-961432289-project-member</nova:user>
Nov 13 10:02:12 user nova-compute[74611]:         <nova:project uuid="ae9ab18bb67e4db19e6c3366771ad218">tempest-ServerRescueNegativeTestJSON-961432289</nova:project>
Nov 13 10:02:12 user nova-compute[74611]:       </nova:owner>
Nov 13 10:02:12 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:02:12 user nova-compute[74611]:       <nova:ports>
Nov 13 10:02:12 user nova-compute[74611]:         <nova:port uuid="ffb1eb13-f028-447f-a01d-45bae2d17edd">
Nov 13 10:02:12 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 10:02:12 user nova-compute[74611]:         </nova:port>
Nov 13 10:02:12 user nova-compute[74611]:       </nova:ports>
Nov 13 10:02:12 user nova-compute[74611]:     </nova:instance>
Nov 13 10:02:12 user nova-compute[74611]:   </metadata>
Nov 13 10:02:12 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:02:12 user nova-compute[74611]:     <system>
Nov 13 10:02:12 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:02:12 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:02:12 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:02:12 user nova-compute[74611]:       <entry name="serial">4fa9e23b-30f2-41ae-83ed-86145389d474</entry>
Nov 13 10:02:12 user nova-compute[74611]:       <entry name="uuid">4fa9e23b-30f2-41ae-83ed-86145389d474</entry>
Nov 13 10:02:12 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:02:12 user nova-compute[74611]:     </system>
Nov 13 10:02:12 user nova-compute[74611]:   </sysinfo>
Nov 13 10:02:12 user nova-compute[74611]:   <os>
Nov 13 10:02:12 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:02:12 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:02:12 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:02:12 user nova-compute[74611]:   </os>
Nov 13 10:02:12 user nova-compute[74611]:   <features>
Nov 13 10:02:12 user nova-compute[74611]:     <acpi/>
Nov 13 10:02:12 user nova-compute[74611]:     <apic/>
Nov 13 10:02:12 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:02:12 user nova-compute[74611]:   </features>
Nov 13 10:02:12 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:02:12 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:02:12 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:02:12 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:02:12 user nova-compute[74611]:   </clock>
Nov 13 10:02:12 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:02:12 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:02:12 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:02:12 user nova-compute[74611]:   </cpu>
Nov 13 10:02:12 user nova-compute[74611]:   <devices>
Nov 13 10:02:12 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:02:12 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:02:12 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk"/>
Nov 13 10:02:12 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:02:12 user nova-compute[74611]:     </disk>
Nov 13 10:02:12 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:02:12 user nova-compute[74611]:       <mac address="fa:16:3e:39:0a:26"/>
Nov 13 10:02:12 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:02:12 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:02:12 user nova-compute[74611]:       <target dev="tapffb1eb13-f0"/>
Nov 13 10:02:12 user nova-compute[74611]:     </interface>
Nov 13 10:02:12 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:02:12 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/console.log" append="off"/>
Nov 13 10:02:12 user nova-compute[74611]:     </serial>
Nov 13 10:02:12 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:02:12 user nova-compute[74611]:     <video>
Nov 13 10:02:12 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:02:12 user nova-compute[74611]:     </video>
Nov 13 10:02:12 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:02:12 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:02:12 user nova-compute[74611]:     </rng>
Nov 13 10:02:12 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:02:12 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:02:12 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:02:12 user nova-compute[74611]:     </memballoon>
Nov 13 10:02:12 user nova-compute[74611]:   </devices>
Nov 13 10:02:12 user nova-compute[74611]: </domain>
Nov 13 10:02:12 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-444308231',display_name='tempest-ServerRescueNegativeTestJSON-server-444308231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-444308231',id=28,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIRCQ9tYBQJ2Euvs7EpBOn3hJTaw2Vrx9tlGYc3FTElAI39JHbVLOxgQPucNZb3Ubif7cKCIZtlfjaxGMqTy7zAtScYXSjAUwAvWJc8/a4aSJoP6GFgfWY4Zy4/89qcIA==',key_name='tempest-keypair-1249039539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae9ab18bb67e4db19e6c3366771ad218',ramdisk_id='',reservation_id='r-3wrgft7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-961432289',owner_user_name='tempest-ServerRescueNegativeTestJSON-961432289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863471360be04ab5acb07ef3e99007c4',uuid=4fa9e23b-30f2-41ae-83ed-86145389d474,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converting VIF {"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:0a:26,bridge_name='br-int',has_traffic_filtering=True,id=ffb1eb13-f028-447f-a01d-45bae2d17edd,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb1eb13-f0') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG os_vif [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:0a:26,bridge_name='br-int',has_traffic_filtering=True,id=ffb1eb13-f028-447f-a01d-45bae2d17edd,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb1eb13-f0') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e86c3e60-c56b-5bd5-9c59-9cda92397a9e', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffb1eb13-f0, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffb1eb13-f0, col_values=(('qos', UUID('c977beb7-0a8c-44c4-b6f7-ff14945dabd0')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffb1eb13-f0, col_values=(('external_ids', {'iface-id': 'ffb1eb13-f028-447f-a01d-45bae2d17edd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:0a:26', 'vm-uuid': '4fa9e23b-30f2-41ae-83ed-86145389d474'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:12 user nova-compute[74611]: INFO os_vif [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:0a:26,bridge_name='br-int',has_traffic_filtering=True,id=ffb1eb13-f028-447f-a01d-45bae2d17edd,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb1eb13-f0')
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:02:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No VIF found with MAC fa:16:3e:39:0a:26, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG nova.network.neutron [req-6d745e50-6b39-4742-a3af-223ee413bbc0 req-4e77037e-f14d-467f-96c7-087ad476291b service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Updated VIF entry in instance network info cache for port ffb1eb13-f028-447f-a01d-45bae2d17edd. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG nova.network.neutron [req-6d745e50-6b39-4742-a3af-223ee413bbc0 req-4e77037e-f14d-467f-96c7-087ad476291b service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Updating instance_info_cache with network_info: [{"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6d745e50-6b39-4742-a3af-223ee413bbc0 req-4e77037e-f14d-467f-96c7-087ad476291b service nova] Releasing lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "23495073-10b7-4552-ad61-16fdf410956b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "23495073-10b7-4552-ad61-16fdf410956b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG nova.objects.instance [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'flavor' on Instance uuid 23495073-10b7-4552-ad61-16fdf410956b {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "23495073-10b7-4552-ad61-16fdf410956b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "23495073-10b7-4552-ad61-16fdf410956b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "23495073-10b7-4552-ad61-16fdf410956b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:13 user nova-compute[74611]: INFO nova.compute.manager [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Attaching volume 5fc78390-5c44-4ddd-bc2d-299aba8e3535 to /dev/vdb
Nov 13 10:02:13 user nova-compute[74611]: DEBUG os_brick.utils [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[293a7534-705e-4eb3-8f58-f92a768fb746]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e23b7b-bbbb-4110-a800-b821e39bcdde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cbc56b-567c-457e-a245-50ec191754a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb51fb2-9bff-419a-8495-3c4ecb51c256]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:02:13 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:02:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[921336ca-353a-4ce7-844e-2767de9e5e74]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG os_brick.utils [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Updating existing volume attachment record: 7b8be5a3-f84b-4606-ab78-3235fc22b61c {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:02:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:02:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-49fa2f1c-d335-4742-b188-2bf511f521d6 req-1330ae6f-2a91-4548-a9c7-7b26f2bd8aff service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-49fa2f1c-d335-4742-b188-2bf511f521d6 req-1330ae6f-2a91-4548-a9c7-7b26f2bd8aff service nova] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-49fa2f1c-d335-4742-b188-2bf511f521d6 req-1330ae6f-2a91-4548-a9c7-7b26f2bd8aff service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-49fa2f1c-d335-4742-b188-2bf511f521d6 req-1330ae6f-2a91-4548-a9c7-7b26f2bd8aff service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-49fa2f1c-d335-4742-b188-2bf511f521d6 req-1330ae6f-2a91-4548-a9c7-7b26f2bd8aff service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] No waiting events found dispatching network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:14 user nova-compute[74611]: WARNING nova.compute.manager [req-49fa2f1c-d335-4742-b188-2bf511f521d6 req-1330ae6f-2a91-4548-a9c7-7b26f2bd8aff service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received unexpected event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd for instance with vm_state building and task_state spawning.
Nov 13 10:02:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:14 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:02:14 user nova-compute[74611]: INFO nova.compute.claims [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Claim successful on node user
Nov 13 10:02:15 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.634s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:02:15 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:02:15 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG nova.policy [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6bc911a5649643a6a3606d8b80e20eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e3b3233a5b43d682200d91f29a80b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:02:15 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Creating image(s)
Nov 13 10:02:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "/opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "/opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "/opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.186s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Successfully created port: 1a42c4f5-af22-43ef-be4b-960f27a17259 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk 1073741824" returned: 0 in 0.120s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.203s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Cannot resize image /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Ensure instance console log exists: /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.compute.manager [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:02:16 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Instance spawned successfully.
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.compute.manager [req-c8ea1bb9-080d-4425-afc5-e0ea24e3b867 req-879b3090-57a1-4fa5-82a7-2c965b84338d service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c8ea1bb9-080d-4425-afc5-e0ea24e3b867 req-879b3090-57a1-4fa5-82a7-2c965b84338d service nova] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c8ea1bb9-080d-4425-afc5-e0ea24e3b867 req-879b3090-57a1-4fa5-82a7-2c965b84338d service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c8ea1bb9-080d-4425-afc5-e0ea24e3b867 req-879b3090-57a1-4fa5-82a7-2c965b84338d service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.compute.manager [req-c8ea1bb9-080d-4425-afc5-e0ea24e3b867 req-879b3090-57a1-4fa5-82a7-2c965b84338d service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] No waiting events found dispatching network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:16 user nova-compute[74611]: WARNING nova.compute.manager [req-c8ea1bb9-080d-4425-afc5-e0ea24e3b867 req-879b3090-57a1-4fa5-82a7-2c965b84338d service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received unexpected event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd for instance with vm_state building and task_state spawning.
Nov 13 10:02:16 user nova-compute[74611]: INFO nova.compute.manager [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.compute.manager [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Successfully updated port: 1a42c4f5-af22-43ef-be4b-960f27a17259 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:02:16 user nova-compute[74611]: INFO nova.compute.manager [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Took 6.40 seconds to build instance.
Nov 13 10:02:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "refresh_cache-3eba6d0b-f9b2-4fc4-ba55-2efe67236e36" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquired lock "refresh_cache-3eba6d0b-f9b2-4fc4-ba55-2efe67236e36" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-24549144-a127-4fd3-86d6-2a7aece6aeec tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.499s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:02:16 user nova-compute[74611]: DEBUG nova.network.neutron [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Updating instance_info_cache with network_info: [{"id": "1a42c4f5-af22-43ef-be4b-960f27a17259", "address": "fa:16:3e:b9:b7:60", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a42c4f5-af", "ovs_interfaceid": "1a42c4f5-af22-43ef-be4b-960f27a17259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Releasing lock "refresh_cache-3eba6d0b-f9b2-4fc4-ba55-2efe67236e36" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Instance network_info: |[{"id": "1a42c4f5-af22-43ef-be4b-960f27a17259", "address": "fa:16:3e:b9:b7:60", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a42c4f5-af", "ovs_interfaceid": "1a42c4f5-af22-43ef-be4b-960f27a17259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Start _get_guest_xml network_info=[{"id": "1a42c4f5-af22-43ef-be4b-960f27a17259", "address": "fa:16:3e:b9:b7:60", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a42c4f5-af", "ovs_interfaceid": "1a42c4f5-af22-43ef-be4b-960f27a17259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:02:17 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:02:17 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-449883671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-449883671',id=29,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83e3b3233a5b43d682200d91f29a80b4',ramdisk_id='',reservation_id='r-1mata5dc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-182847603',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:02:15Z,user_data=None,user_id='6bc911a5649643a6a3606d8b80e20eb0',uuid=3eba6d0b-f9b2-4fc4-ba55-2efe67236e36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a42c4f5-af22-43ef-be4b-960f27a17259", "address": "fa:16:3e:b9:b7:60", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a42c4f5-af", "ovs_interfaceid": "1a42c4f5-af22-43ef-be4b-960f27a17259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converting VIF {"id": "1a42c4f5-af22-43ef-be4b-960f27a17259", "address": "fa:16:3e:b9:b7:60", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a42c4f5-af", "ovs_interfaceid": "1a42c4f5-af22-43ef-be4b-960f27a17259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b7:60,bridge_name='br-int',has_traffic_filtering=True,id=1a42c4f5-af22-43ef-be4b-960f27a17259,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a42c4f5-af') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.objects.instance [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'pci_devices' on Instance uuid 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:02:17 user nova-compute[74611]:   <uuid>3eba6d0b-f9b2-4fc4-ba55-2efe67236e36</uuid>
Nov 13 10:02:17 user nova-compute[74611]:   <name>instance-0000001d</name>
Nov 13 10:02:17 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:02:17 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:02:17 user nova-compute[74611]:   <metadata>
Nov 13 10:02:17 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:02:17 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:02:17 user nova-compute[74611]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-449883671</nova:name>
Nov 13 10:02:17 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:02:17</nova:creationTime>
Nov 13 10:02:17 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:02:17 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:02:17 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:02:17 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:02:17 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:02:17 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:02:17 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:02:17 user nova-compute[74611]:       <nova:owner>
Nov 13 10:02:17 user nova-compute[74611]:         <nova:user uuid="6bc911a5649643a6a3606d8b80e20eb0">tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member</nova:user>
Nov 13 10:02:17 user nova-compute[74611]:         <nova:project uuid="83e3b3233a5b43d682200d91f29a80b4">tempest-ServerBootFromVolumeStableRescueTest-182847603</nova:project>
Nov 13 10:02:17 user nova-compute[74611]:       </nova:owner>
Nov 13 10:02:17 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:02:17 user nova-compute[74611]:       <nova:ports>
Nov 13 10:02:17 user nova-compute[74611]:         <nova:port uuid="1a42c4f5-af22-43ef-be4b-960f27a17259">
Nov 13 10:02:17 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 10:02:17 user nova-compute[74611]:         </nova:port>
Nov 13 10:02:17 user nova-compute[74611]:       </nova:ports>
Nov 13 10:02:17 user nova-compute[74611]:     </nova:instance>
Nov 13 10:02:17 user nova-compute[74611]:   </metadata>
Nov 13 10:02:17 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:02:17 user nova-compute[74611]:     <system>
Nov 13 10:02:17 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:02:17 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:02:17 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:02:17 user nova-compute[74611]:       <entry name="serial">3eba6d0b-f9b2-4fc4-ba55-2efe67236e36</entry>
Nov 13 10:02:17 user nova-compute[74611]:       <entry name="uuid">3eba6d0b-f9b2-4fc4-ba55-2efe67236e36</entry>
Nov 13 10:02:17 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:02:17 user nova-compute[74611]:     </system>
Nov 13 10:02:17 user nova-compute[74611]:   </sysinfo>
Nov 13 10:02:17 user nova-compute[74611]:   <os>
Nov 13 10:02:17 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:02:17 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:02:17 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:02:17 user nova-compute[74611]:   </os>
Nov 13 10:02:17 user nova-compute[74611]:   <features>
Nov 13 10:02:17 user nova-compute[74611]:     <acpi/>
Nov 13 10:02:17 user nova-compute[74611]:     <apic/>
Nov 13 10:02:17 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:02:17 user nova-compute[74611]:   </features>
Nov 13 10:02:17 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:02:17 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:02:17 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:02:17 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:02:17 user nova-compute[74611]:   </clock>
Nov 13 10:02:17 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:02:17 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:02:17 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:02:17 user nova-compute[74611]:   </cpu>
Nov 13 10:02:17 user nova-compute[74611]:   <devices>
Nov 13 10:02:17 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:02:17 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:02:17 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk"/>
Nov 13 10:02:17 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:02:17 user nova-compute[74611]:     </disk>
Nov 13 10:02:17 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:02:17 user nova-compute[74611]:       <mac address="fa:16:3e:b9:b7:60"/>
Nov 13 10:02:17 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:02:17 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:02:17 user nova-compute[74611]:       <target dev="tap1a42c4f5-af"/>
Nov 13 10:02:17 user nova-compute[74611]:     </interface>
Nov 13 10:02:17 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:02:17 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/console.log" append="off"/>
Nov 13 10:02:17 user nova-compute[74611]:     </serial>
Nov 13 10:02:17 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:02:17 user nova-compute[74611]:     <video>
Nov 13 10:02:17 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:02:17 user nova-compute[74611]:     </video>
Nov 13 10:02:17 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:02:17 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:02:17 user nova-compute[74611]:     </rng>
Nov 13 10:02:17 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:02:17 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:02:17 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:02:17 user nova-compute[74611]:     </memballoon>
Nov 13 10:02:17 user nova-compute[74611]:   </devices>
Nov 13 10:02:17 user nova-compute[74611]: </domain>
Nov 13 10:02:17 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-449883671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-449883671',id=29,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83e3b3233a5b43d682200d91f29a80b4',ramdisk_id='',reservation_id='r-1mata5dc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-182847603',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:02:15Z,user_data=None,user_id='6bc911a5649643a6a3606d8b80e20eb0',uuid=3eba6d0b-f9b2-4fc4-ba55-2efe67236e36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a42c4f5-af22-43ef-be4b-960f27a17259", "address": "fa:16:3e:b9:b7:60", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a42c4f5-af", "ovs_interfaceid": "1a42c4f5-af22-43ef-be4b-960f27a17259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converting VIF {"id": "1a42c4f5-af22-43ef-be4b-960f27a17259", "address": "fa:16:3e:b9:b7:60", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a42c4f5-af", "ovs_interfaceid": "1a42c4f5-af22-43ef-be4b-960f27a17259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b7:60,bridge_name='br-int',has_traffic_filtering=True,id=1a42c4f5-af22-43ef-be4b-960f27a17259,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a42c4f5-af') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG os_vif [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b7:60,bridge_name='br-int',has_traffic_filtering=True,id=1a42c4f5-af22-43ef-be4b-960f27a17259,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a42c4f5-af') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ded0942b-d4a8-50a7-9494-457a2c278556', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a42c4f5-af, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a42c4f5-af, col_values=(('qos', UUID('f8c3328c-5b24-4cb4-8221-3abbbd469ead')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a42c4f5-af, col_values=(('external_ids', {'iface-id': '1a42c4f5-af22-43ef-be4b-960f27a17259', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:b7:60', 'vm-uuid': '3eba6d0b-f9b2-4fc4-ba55-2efe67236e36'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:17 user nova-compute[74611]: INFO os_vif [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b7:60,bridge_name='br-int',has_traffic_filtering=True,id=1a42c4f5-af22-43ef-be4b-960f27a17259,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a42c4f5-af')
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:02:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] No VIF found with MAC fa:16:3e:b9:b7:60, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lazy-loading 'flavor' on Instance uuid 635636ea-96a0-4fdb-85a1-ca7a87b762f0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:18 user nova-compute[74611]: INFO nova.compute.manager [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Attaching volume c9fb42e8-06d6-42aa-a06c-142251173f9f to /dev/vdb
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.utils [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde86b73-4b99-4272-9533-a84e1992f528]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2106d84-4a27-4abe-b7b2-5102ecc884d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[aace0087-8e3d-4238-b4d3-925bfc0ab45e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c4a309-ff1e-4412-a068-92544c369401]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvIVEDHj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:02:18 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:02:18 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:02:18 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:02:18 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a8a9a0-0b0d-41fb-9a2f-d51cb14f4d9d]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG nova.compute.manager [req-da4c9df0-96fb-42a4-81d5-1f6b7cac2a6d req-caa3da24-a5b8-48e6-8bfa-1ea0cb0b8ef4 service nova] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Received event network-changed-1a42c4f5-af22-43ef-be4b-960f27a17259 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG nova.compute.manager [req-da4c9df0-96fb-42a4-81d5-1f6b7cac2a6d req-caa3da24-a5b8-48e6-8bfa-1ea0cb0b8ef4 service nova] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Refreshing instance network info cache due to event network-changed-1a42c4f5-af22-43ef-be4b-960f27a17259. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-da4c9df0-96fb-42a4-81d5-1f6b7cac2a6d req-caa3da24-a5b8-48e6-8bfa-1ea0cb0b8ef4 service nova] Acquiring lock "refresh_cache-3eba6d0b-f9b2-4fc4-ba55-2efe67236e36" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-da4c9df0-96fb-42a4-81d5-1f6b7cac2a6d req-caa3da24-a5b8-48e6-8bfa-1ea0cb0b8ef4 service nova] Acquired lock "refresh_cache-3eba6d0b-f9b2-4fc4-ba55-2efe67236e36" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG nova.network.neutron [req-da4c9df0-96fb-42a4-81d5-1f6b7cac2a6d req-caa3da24-a5b8-48e6-8bfa-1ea0cb0b8ef4 service nova] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Refreshing network info cache for port 1a42c4f5-af22-43ef-be4b-960f27a17259 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.utils [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updating existing volume attachment record: 6f6c2338-6846-4692-82b5-efdc581ba01f {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cf8525-5eac-44a7-a6c2-9ec01a7db3c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:02:18 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f757d142-4989-422a-9fe8-0d115eacf113]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535] added
Nov 13 10:02:18 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63a69ff-28b7-4b1f-be0c-ce716e1858ed]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac9e7f5-2c95-40a7-bc90-424b0e598991]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zvIVEDHj {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zvIVEDHj" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b7f569-827e-42e7-902c-c021fb8b3b71]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zvIVEDHj'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f6548b-662c-473c-ae65-8fb035e2c28f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[649288e2-164e-4973-b42d-364f19e1f864]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:18 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:02:18 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:18 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:18 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:02:18 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:18 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --login" returned: 0 in 0.111s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc09fd6-8170-40a1-8c5f-6a7c43be4519]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535, portal: 172.16.0.220,3260]
Nov 13 10:02:18 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535, portal: 172.16.0.220,3260] successful.
Nov 13 10:02:18 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[836468c0-8191-4687-99dc-123e951d7da0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9556394a-3dd8-4d05-a12c-34df0d91d0db]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:19 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:02:19 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:19 user nova-compute[74611]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)
Nov 13 10:02:19 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:19 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:02:19 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:19 user nova-compute[74611]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)
Nov 13 10:02:19 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.424s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f23a29-8681-49f5-a636-af923314b6b9]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvIVEDHj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG nova.network.neutron [req-da4c9df0-96fb-42a4-81d5-1f6b7cac2a6d req-caa3da24-a5b8-48e6-8bfa-1ea0cb0b8ef4 service nova] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Updated VIF entry in instance network info cache for port 1a42c4f5-af22-43ef-be4b-960f27a17259. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG nova.network.neutron [req-da4c9df0-96fb-42a4-81d5-1f6b7cac2a6d req-caa3da24-a5b8-48e6-8bfa-1ea0cb0b8ef4 service nova] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Updating instance_info_cache with network_info: [{"id": "1a42c4f5-af22-43ef-be4b-960f27a17259", "address": "fa:16:3e:b9:b7:60", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a42c4f5-af", "ovs_interfaceid": "1a42c4f5-af22-43ef-be4b-960f27a17259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-da4c9df0-96fb-42a4-81d5-1f6b7cac2a6d req-caa3da24-a5b8-48e6-8bfa-1ea0cb0b8ef4 service nova] Releasing lock "refresh_cache-3eba6d0b-f9b2-4fc4-ba55-2efe67236e36" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] <== connect_volume: return (1479ms) {'type': 'block', 'scsi_wwn': '26537316536376639', 'path': '/dev/sdd'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537316536376639', 'path': '/dev/sdd'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG nova.objects.instance [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'flavor' on Instance uuid 23495073-10b7-4552-ad61-16fdf410956b {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:02:20 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:02:20 user nova-compute[74611]:   <source dev="/dev/sdd"/>
Nov 13 10:02:20 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:02:20 user nova-compute[74611]:   <serial>5fc78390-5c44-4ddd-bc2d-299aba8e3535</serial>
Nov 13 10:02:20 user nova-compute[74611]: </disk>
Nov 13 10:02:20 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No VIF found with MAC fa:16:3e:56:8b:98, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-89b42b59-0540-41de-8721-eb0f1b4e8051 req-039d9147-7036-4a58-a0ad-fd002075d3b4 service nova] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Received event network-vif-plugged-1a42c4f5-af22-43ef-be4b-960f27a17259 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-89b42b59-0540-41de-8721-eb0f1b4e8051 req-039d9147-7036-4a58-a0ad-fd002075d3b4 service nova] Acquiring lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-89b42b59-0540-41de-8721-eb0f1b4e8051 req-039d9147-7036-4a58-a0ad-fd002075d3b4 service nova] Lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-89b42b59-0540-41de-8721-eb0f1b4e8051 req-039d9147-7036-4a58-a0ad-fd002075d3b4 service nova] Lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-89b42b59-0540-41de-8721-eb0f1b4e8051 req-039d9147-7036-4a58-a0ad-fd002075d3b4 service nova] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] No waiting events found dispatching network-vif-plugged-1a42c4f5-af22-43ef-be4b-960f27a17259 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:20 user nova-compute[74611]: WARNING nova.compute.manager [req-89b42b59-0540-41de-8721-eb0f1b4e8051 req-039d9147-7036-4a58-a0ad-fd002075d3b4 service nova] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Received unexpected event network-vif-plugged-1a42c4f5-af22-43ef-be4b-960f27a17259 for instance with vm_state building and task_state spawning.
Nov 13 10:02:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-89b42b59-0540-41de-8721-eb0f1b4e8051 req-039d9147-7036-4a58-a0ad-fd002075d3b4 service nova] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Received event network-vif-plugged-1a42c4f5-af22-43ef-be4b-960f27a17259 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-89b42b59-0540-41de-8721-eb0f1b4e8051 req-039d9147-7036-4a58-a0ad-fd002075d3b4 service nova] Acquiring lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-89b42b59-0540-41de-8721-eb0f1b4e8051 req-039d9147-7036-4a58-a0ad-fd002075d3b4 service nova] Lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-89b42b59-0540-41de-8721-eb0f1b4e8051 req-039d9147-7036-4a58-a0ad-fd002075d3b4 service nova] Lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-89b42b59-0540-41de-8721-eb0f1b4e8051 req-039d9147-7036-4a58-a0ad-fd002075d3b4 service nova] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] No waiting events found dispatching network-vif-plugged-1a42c4f5-af22-43ef-be4b-960f27a17259 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:20 user nova-compute[74611]: WARNING nova.compute.manager [req-89b42b59-0540-41de-8721-eb0f1b4e8051 req-039d9147-7036-4a58-a0ad-fd002075d3b4 service nova] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Received unexpected event network-vif-plugged-1a42c4f5-af22-43ef-be4b-960f27a17259 for instance with vm_state building and task_state spawning.
Nov 13 10:02:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-014b9b56-8a7a-442c-8420-791b52672069 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "23495073-10b7-4552-ad61-16fdf410956b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.341s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:21 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:02:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:02:21 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Instance spawned successfully.
Nov 13 10:02:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:02:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:21 user nova-compute[74611]: INFO nova.compute.manager [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 13 10:02:21 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:02:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "23495073-10b7-4552-ad61-16fdf410956b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "23495073-10b7-4552-ad61-16fdf410956b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:21 user nova-compute[74611]: INFO nova.compute.manager [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Took 7.00 seconds to build instance.
Nov 13 10:02:21 user nova-compute[74611]: INFO nova.compute.manager [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Detaching volume 5fc78390-5c44-4ddd-bc2d-299aba8e3535
Nov 13 10:02:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a77113ff-2826-4a25-a766-5cc9884ca6d6 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.118s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:21 user nova-compute[74611]: INFO nova.virt.block_device [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Attempting to driver detach volume 5fc78390-5c44-4ddd-bc2d-299aba8e3535 from mountpoint /dev/vdb
Nov 13 10:02:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Attempting to detach device vdb from instance 23495073-10b7-4552-ad61-16fdf410956b from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:02:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:02:21 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:02:21 user nova-compute[74611]:   <source dev="/dev/sdd"/>
Nov 13 10:02:21 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:02:21 user nova-compute[74611]:   <serial>5fc78390-5c44-4ddd-bc2d-299aba8e3535</serial>
Nov 13 10:02:21 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:02:21 user nova-compute[74611]: </disk>
Nov 13 10:02:21 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:02:21 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Successfully detached device vdb from instance 23495073-10b7-4552-ad61-16fdf410956b from the persistent domain config.
Nov 13 10:02:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 23495073-10b7-4552-ad61-16fdf410956b from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:02:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:02:21 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:02:21 user nova-compute[74611]:   <source dev="/dev/sdd"/>
Nov 13 10:02:21 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:02:21 user nova-compute[74611]:   <serial>5fc78390-5c44-4ddd-bc2d-299aba8e3535</serial>
Nov 13 10:02:21 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:02:21 user nova-compute[74611]: </disk>
Nov 13 10:02:21 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:02:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 23495073-10b7-4552-ad61-16fdf410956b {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:02:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQfyJOvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:02:24 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:02:24 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:02:24 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ab5bc0-ce35-42b1-b589-9f0a8b5e30a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:02:24 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4dc5ca-1bad-4da8-970e-dc5a8e190ad0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f] added
Nov 13 10:02:24 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[476126e9-019e-4c4f-923a-30ffa48a76f3]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[70409edc-c6e0-417f-879f-16aa085bb0dc]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQfyJOvn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQfyJOvn" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0920466-9648-4cf3-ad0a-bb50997df645]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eQfyJOvn'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a8be17-4d60-4310-9e93-33e60aa54295]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad0da98-2844-4bf3-b126-1e37fd03e404]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:24 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:02:24 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:24 user nova-compute[74611]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)
Nov 13 10:02:24 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:24 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:02:24 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:24 user nova-compute[74611]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)
Nov 13 10:02:24 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[455a1120-ead3-4c45-bd47-ee222f22bac4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260]
Nov 13 10:02:24 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260] successful.
Nov 13 10:02:24 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e22be85-77d6-4ba8-8628-ebb1c3c7bd50]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[585da23b-93a6-4ea3-b0dd-3fe033e62f3c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:24 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:02:24 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:24 user nova-compute[74611]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)
Nov 13 10:02:24 user nova-compute[74611]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:02:24 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:24 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:02:24 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:24 user nova-compute[74611]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)
Nov 13 10:02:24 user nova-compute[74611]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:02:24 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5a129f-cbb3-4acf-9e11-1170184a51f4]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:02:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQfyJOvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "1c66c8a8-abb5-4f60-8464-074627c213d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "1c66c8a8-abb5-4f60-8464-074627c213d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "1c66c8a8-abb5-4f60-8464-074627c213d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "1c66c8a8-abb5-4f60-8464-074627c213d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "1c66c8a8-abb5-4f60-8464-074627c213d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:25 user nova-compute[74611]: INFO nova.compute.manager [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Terminating instance
Nov 13 10:02:25 user nova-compute[74611]: DEBUG nova.compute.manager [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '26564353365666465', 'path': '/dev/sdf'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564353365666465', 'path': '/dev/sdf'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lazy-loading 'flavor' on Instance uuid 635636ea-96a0-4fdb-85a1-ca7a87b762f0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:02:25 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:02:25 user nova-compute[74611]:   <source dev="/dev/sdf"/>
Nov 13 10:02:25 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:02:25 user nova-compute[74611]:   <serial>c9fb42e8-06d6-42aa-a06c-142251173f9f</serial>
Nov 13 10:02:25 user nova-compute[74611]: </disk>
Nov 13 10:02:25 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG nova.compute.manager [req-7bc9fef1-5608-4efb-a892-b3bff69c007f req-cc9e8980-fa02-4ef9-9027-1f55a3a7e7e0 service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Received event network-vif-unplugged-af98cec6-7e77-428e-b0df-8901c45fafe5 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7bc9fef1-5608-4efb-a892-b3bff69c007f req-cc9e8980-fa02-4ef9-9027-1f55a3a7e7e0 service nova] Acquiring lock "1c66c8a8-abb5-4f60-8464-074627c213d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7bc9fef1-5608-4efb-a892-b3bff69c007f req-cc9e8980-fa02-4ef9-9027-1f55a3a7e7e0 service nova] Lock "1c66c8a8-abb5-4f60-8464-074627c213d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7bc9fef1-5608-4efb-a892-b3bff69c007f req-cc9e8980-fa02-4ef9-9027-1f55a3a7e7e0 service nova] Lock "1c66c8a8-abb5-4f60-8464-074627c213d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG nova.compute.manager [req-7bc9fef1-5608-4efb-a892-b3bff69c007f req-cc9e8980-fa02-4ef9-9027-1f55a3a7e7e0 service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] No waiting events found dispatching network-vif-unplugged-af98cec6-7e77-428e-b0df-8901c45fafe5 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:25 user nova-compute[74611]: DEBUG nova.compute.manager [req-7bc9fef1-5608-4efb-a892-b3bff69c007f req-cc9e8980-fa02-4ef9-9027-1f55a3a7e7e0 service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Received event network-vif-unplugged-af98cec6-7e77-428e-b0df-8901c45fafe5 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] No VIF found with MAC fa:16:3e:f5:e2:a3, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c321b49-04ef-46f7-bec8-03583886a48f tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.792s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:26 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Instance destroyed successfully.
Nov 13 10:02:26 user nova-compute[74611]: DEBUG nova.objects.instance [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lazy-loading 'resources' on Instance uuid 1c66c8a8-abb5-4f60-8464-074627c213d8 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-172245589',display_name='tempest-ServersNegativeTestJSON-server-172245589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-172245589',id=4,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:53:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='afd392465e2d4ff0b511c9e543972244',ramdisk_id='',reservation_id='r-9nnmj03v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1786337240',owner_user_name='tempest-ServersNegativeTestJSON-1786337240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:53:59Z,user_data=None,user_id='21adb30d68754dba856e5d0a3ae6727e',uuid=1c66c8a8-abb5-4f60-8464-074627c213d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af98cec6-7e77-428e-b0df-8901c45fafe5", "address": "fa:16:3e:49:ed:03", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98cec6-7e", "ovs_interfaceid": "af98cec6-7e77-428e-b0df-8901c45fafe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Converting VIF {"id": "af98cec6-7e77-428e-b0df-8901c45fafe5", "address": "fa:16:3e:49:ed:03", "network": {"id": "4d389398-6662-48ae-83f4-1db7fafb4ffe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-330234798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd392465e2d4ff0b511c9e543972244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98cec6-7e", "ovs_interfaceid": "af98cec6-7e77-428e-b0df-8901c45fafe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:ed:03,bridge_name='br-int',has_traffic_filtering=True,id=af98cec6-7e77-428e-b0df-8901c45fafe5,network=Network(4d389398-6662-48ae-83f4-1db7fafb4ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf98cec6-7e') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG os_vif [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:ed:03,bridge_name='br-int',has_traffic_filtering=True,id=af98cec6-7e77-428e-b0df-8901c45fafe5,network=Network(4d389398-6662-48ae-83f4-1db7fafb4ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf98cec6-7e') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf98cec6-7e, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b337b8dc-72f0-4efb-b5e5-4f2a4f5d7ca7) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:26 user nova-compute[74611]: INFO os_vif [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:ed:03,bridge_name='br-int',has_traffic_filtering=True,id=af98cec6-7e77-428e-b0df-8901c45fafe5,network=Network(4d389398-6662-48ae-83f4-1db7fafb4ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf98cec6-7e')
Nov 13 10:02:26 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Deleting instance files /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8_del
Nov 13 10:02:26 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Deletion of /opt/stack/data/nova/instances/1c66c8a8-abb5-4f60-8464-074627c213d8_del complete
Nov 13 10:02:26 user nova-compute[74611]: INFO nova.compute.manager [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 13 10:02:26 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:02:26 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:26 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Took 0.60 seconds to deallocate network for instance.
Nov 13 10:02:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-086c10f2-b33c-4705-b3d6-519411268888 req-a9230460-a72d-45de-a33b-391d31ed293f service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Received event network-vif-deleted-af98cec6-7e77-428e-b0df-8901c45fafe5 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:27 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:02:27 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:02:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:27 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Deleted allocations for instance 1c66c8a8-abb5-4f60-8464-074627c213d8
Nov 13 10:02:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-96ec2267-aeb9-4c10-a079-eb74abd5c0a9 tempest-ServersNegativeTestJSON-1786337240 tempest-ServersNegativeTestJSON-1786337240-project-member] Lock "1c66c8a8-abb5-4f60-8464-074627c213d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.305s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-daf5928f-13a0-46f8-b8af-a0c50ceb7837 req-20c98edd-c3e3-468e-ab7f-af57430c221f service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Received event network-vif-plugged-af98cec6-7e77-428e-b0df-8901c45fafe5 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-daf5928f-13a0-46f8-b8af-a0c50ceb7837 req-20c98edd-c3e3-468e-ab7f-af57430c221f service nova] Acquiring lock "1c66c8a8-abb5-4f60-8464-074627c213d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-daf5928f-13a0-46f8-b8af-a0c50ceb7837 req-20c98edd-c3e3-468e-ab7f-af57430c221f service nova] Lock "1c66c8a8-abb5-4f60-8464-074627c213d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-daf5928f-13a0-46f8-b8af-a0c50ceb7837 req-20c98edd-c3e3-468e-ab7f-af57430c221f service nova] Lock "1c66c8a8-abb5-4f60-8464-074627c213d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-daf5928f-13a0-46f8-b8af-a0c50ceb7837 req-20c98edd-c3e3-468e-ab7f-af57430c221f service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] No waiting events found dispatching network-vif-plugged-af98cec6-7e77-428e-b0df-8901c45fafe5 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:27 user nova-compute[74611]: WARNING nova.compute.manager [req-daf5928f-13a0-46f8-b8af-a0c50ceb7837 req-20c98edd-c3e3-468e-ab7f-af57430c221f service nova] [instance: 1c66c8a8-abb5-4f60-8464-074627c213d8] Received unexpected event network-vif-plugged-af98cec6-7e77-428e-b0df-8901c45fafe5 for instance with vm_state deleted and task_state None.
Nov 13 10:02:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Stashing vm_state: active {{(pid=74611) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 13 10:02:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:29 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:02:29 user nova-compute[74611]: INFO nova.compute.claims [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Claim successful on node user
Nov 13 10:02:29 user nova-compute[74611]: INFO nova.compute.resource_tracker [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updating resource usage from migration 4853187a-b106-42a3-9133-dece359c134e
Nov 13 10:02:29 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:02:29 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:02:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.613s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:29 user nova-compute[74611]: INFO nova.compute.manager [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Migrating
Nov 13 10:02:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:02:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:02:29 user nova-compute[74611]: INFO nova.compute.rpcapi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 13 10:02:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:02:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:02:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquired lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:02:29 user nova-compute[74611]: DEBUG nova.network.neutron [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:02:30 user nova-compute[74611]: DEBUG nova.network.neutron [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updating instance_info_cache with network_info: [{"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Releasing lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:02:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Starting migrate_disk_and_power_off {{(pid=74611) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 13 10:02:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-f0610b29-670d-407a-ad56-bbfa7b574d5e req-79a2970b-dcd4-444f-8a7d-59786ddcd6bc service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received event network-vif-unplugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f0610b29-670d-407a-ad56-bbfa7b574d5e req-79a2970b-dcd4-444f-8a7d-59786ddcd6bc service nova] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f0610b29-670d-407a-ad56-bbfa7b574d5e req-79a2970b-dcd4-444f-8a7d-59786ddcd6bc service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f0610b29-670d-407a-ad56-bbfa7b574d5e req-79a2970b-dcd4-444f-8a7d-59786ddcd6bc service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-f0610b29-670d-407a-ad56-bbfa7b574d5e req-79a2970b-dcd4-444f-8a7d-59786ddcd6bc service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] No waiting events found dispatching network-vif-unplugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:30 user nova-compute[74611]: WARNING nova.compute.manager [req-f0610b29-670d-407a-ad56-bbfa7b574d5e req-79a2970b-dcd4-444f-8a7d-59786ddcd6bc service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received unexpected event network-vif-unplugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d for instance with vm_state active and task_state resize_migrating.
Nov 13 10:02:31 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Instance destroyed successfully.
Nov 13 10:02:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1214168652',display_name='tempest-ServerActionsTestOtherB-server-1214168652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1214168652',id=21,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDWkg3C+Ons0/sduU7bCkNdUaQmui4Ar0pDJw7KSIbqtW1jWjrtKiyZ8w8dVwpvUbMKS1UF1ykPykLHc0hyTfyxEKKXaxiPgUkE/a0u6OsQxRK/HJgxNowuqXz8Zc+KMg==',key_name='tempest-keypair-1038082490',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:58:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1fb42835d7f49cbaad21eee295c7692',ramdisk_id='',reservation_id='r-yeac67tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-840608963',owner_user_name='tempest-ServerActionsTestOtherB-840608963-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:02:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='396adec28c0d44a0aefb1229090f90d5',uuid=635636ea-96a0-4fdb-85a1-ca7a87b762f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1498625862-network", "vif_mac": "fa:16:3e:f5:e2:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converting VIF {"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1498625862-network", "vif_mac": "fa:16:3e:f5:e2:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_vif [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ff4d9c6-a2, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=084d89a2-9a65-4c07-88cf-a22c531ed9ff) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:02:31 user nova-compute[74611]: INFO os_vif [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2')
Nov 13 10:02:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQfyJOvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:02:31 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7964dbe1-2a6a-4ad1-9176-18ac3671ef92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:02:31 user nova-compute[74611]: No targets found.
Nov 13 10:02:31 user nova-compute[74611]: iSNS:
Nov 13 10:02:31 user nova-compute[74611]: No targets found.
Nov 13 10:02:31 user nova-compute[74611]: STATIC:
Nov 13 10:02:31 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5
Nov 13 10:02:31 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:31 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:31 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f
Nov 13 10:02:31 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:31 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:31 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535
Nov 13 10:02:31 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:31 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:31 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425
Nov 13 10:02:31 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:31 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:31 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:02:31 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:31 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:31 user nova-compute[74611]: FIRMWARE:
Nov 13 10:02:31 user nova-compute[74611]: No targets found.
Nov 13 10:02:31 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:02:31 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:02:31 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09e01ab-1747-4adf-a589-86a796025fd4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05514af-e731-4b78-8e9d-0eb7231e9ae2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:31 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:02:31 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:31 user nova-compute[74611]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)
Nov 13 10:02:31 user nova-compute[74611]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:02:31 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:31 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:02:31 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:31 user nova-compute[74611]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)
Nov 13 10:02:31 user nova-compute[74611]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:02:31 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8409dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f'): ({'sdf'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Removing single pathed devices sdf {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[791200df-b791-4f58-ab00-47d98abeb104]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bc1b1c-73f4-4c68-8d73-e1d0c840a6af]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Flushing IO for device /dev/sdf {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d257bcbe-f0c0-4447-8e08-28ea6b21751e]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ea17ca-ee58-47a9-b538-70b0e4e3348a]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] SCSI volumes sdf have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c57257-872a-40a1-976e-301b06bba017]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eed152d-3990-4a65-8ca7-27679d45276a]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260]
Nov 13 10:02:31 user nova-compute[74611]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260] successful.
Nov 13 10:02:31 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0dbc8f-4819-4791-ace0-f6e9807d1c59]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] <== disconnect_volume: return (313ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:02:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0_resize/disk /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "7eff589b-8f0f-4e6e-ac04-567da455e579" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:02:32 user nova-compute[74611]: INFO nova.compute.claims [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Claim successful on node user
Nov 13 10:02:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CMD "cp -r /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0_resize/disk /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk" returned: 0 in 0.380s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0_resize/disk.info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk.info {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CMD "cp -r /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0_resize/disk.info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk.info" returned: 0 in 0.047s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:32 user nova-compute[74611]: INFO nova.compute.manager [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Terminating instance
Nov 13 10:02:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-a69f3110-c5c2-443b-907c-102fc1124ba0 req-d382af24-61a4-48f9-91be-91d1ecaa0c63 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a69f3110-c5c2-443b-907c-102fc1124ba0 req-d382af24-61a4-48f9-91be-91d1ecaa0c63 service nova] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a69f3110-c5c2-443b-907c-102fc1124ba0 req-d382af24-61a4-48f9-91be-91d1ecaa0c63 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a69f3110-c5c2-443b-907c-102fc1124ba0 req-d382af24-61a4-48f9-91be-91d1ecaa0c63 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-a69f3110-c5c2-443b-907c-102fc1124ba0 req-d382af24-61a4-48f9-91be-91d1ecaa0c63 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] No waiting events found dispatching network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:32 user nova-compute[74611]: WARNING nova.compute.manager [req-a69f3110-c5c2-443b-907c-102fc1124ba0 req-d382af24-61a4-48f9-91be-91d1ecaa0c63 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received unexpected event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d for instance with vm_state active and task_state resize_migrating.
Nov 13 10:02:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.681s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.network.neutron [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:02:33 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.policy [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f22322be2dd04410b6cd53c31e639b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a0b0a078bd44908cd7cd4593914eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:02:33 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Creating image(s)
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "/opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "/opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "/opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.network.neutron [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Port 9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d binding to destination host user is already ACTIVE {{(pid=74611) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-3285760c-d4a8-4d14-95a8-c9ce0c5a9132 req-9e87debc-cb91-4fc9-a236-b93becd49f85 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received event network-vif-unplugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3285760c-d4a8-4d14-95a8-c9ce0c5a9132 req-9e87debc-cb91-4fc9-a236-b93becd49f85 service nova] Acquiring lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3285760c-d4a8-4d14-95a8-c9ce0c5a9132 req-9e87debc-cb91-4fc9-a236-b93becd49f85 service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3285760c-d4a8-4d14-95a8-c9ce0c5a9132 req-9e87debc-cb91-4fc9-a236-b93becd49f85 service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-3285760c-d4a8-4d14-95a8-c9ce0c5a9132 req-9e87debc-cb91-4fc9-a236-b93becd49f85 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] No waiting events found dispatching network-vif-unplugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-3285760c-d4a8-4d14-95a8-c9ce0c5a9132 req-9e87debc-cb91-4fc9-a236-b93becd49f85 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received event network-vif-unplugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:02:33 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Instance destroyed successfully.
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.objects.instance [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lazy-loading 'resources' on Instance uuid f5cb6cf5-f915-4f50-bfc3-0112875dcfcc {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T09:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1536159384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-465100190',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrNP72z9qjgl53p8K4Bq3orZH32b25sB2UyTgN3g4YZuL8kyeCNBH2NEmQXzAxuUQN/0PlafPwvEzbRPMpZH1ceGTQGF5og7k+5PrFKOPlIKNIvC13wL7dsDh6vUOEajw==',key_name='tempest-keypair-152512823',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:01:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08875af299864cd9ac2d14fb5a9913fa',ramdisk_id='',reservation_id='r-i56vqppx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1007705503',owner_user_name='tempest-ServerActionsV293TestJSON-1007705503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:01:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aee5968a8214444f83974d536878aaa3',uuid=f5cb6cf5-f915-4f50-bfc3-0112875dcfcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Converting VIF {"id": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "address": "fa:16:3e:43:32:2b", "network": {"id": "0c40801f-e2b5-4b56-acc2-1e6d7cf133ed", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1687201124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08875af299864cd9ac2d14fb5a9913fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7f5a25-37", "ovs_interfaceid": "4e7f5a25-370f-4d77-a8e9-b29f90a337bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=4e7f5a25-370f-4d77-a8e9-b29f90a337bc,network=Network(0c40801f-e2b5-4b56-acc2-1e6d7cf133ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7f5a25-37') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG os_vif [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=4e7f5a25-370f-4d77-a8e9-b29f90a337bc,network=Network(0c40801f-e2b5-4b56-acc2-1e6d7cf133ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7f5a25-37') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e7f5a25-37, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.228s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=371e91ab-ad12-4288-97b5-496ae45c1863) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:02:33 user nova-compute[74611]: INFO os_vif [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=4e7f5a25-370f-4d77-a8e9-b29f90a337bc,network=Network(0c40801f-e2b5-4b56-acc2-1e6d7cf133ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7f5a25-37')
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk 1073741824" returned: 0 in 0.067s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnbdaUNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:02:33 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:02:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.network.neutron [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Successfully created port: a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7af0d6-3fff-49e6-a37f-5333ee72fa2b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:02:33 user nova-compute[74611]: No targets found.
Nov 13 10:02:33 user nova-compute[74611]: iSNS:
Nov 13 10:02:33 user nova-compute[74611]: No targets found.
Nov 13 10:02:33 user nova-compute[74611]: STATIC:
Nov 13 10:02:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5
Nov 13 10:02:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535
Nov 13 10:02:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425
Nov 13 10:02:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:02:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:33 user nova-compute[74611]: FIRMWARE:
Nov 13 10:02:33 user nova-compute[74611]: No targets found.
Nov 13 10:02:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:02:33 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:02:33 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0889faa0-f325-4efc-a99f-57e10454d5fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ab05c7-ba98-4d4b-9af2-eef77474b00d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:33 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:02:33 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:33 user nova-compute[74611]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)
Nov 13 10:02:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:33 user nova-compute[74611]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 (non-flash)
Nov 13 10:02:33 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:33 user nova-compute[74611]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)
Nov 13 10:02:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb646836d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5'): ({'sde'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Removing single pathed devices sde {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.211s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[434fc460-59db-4796-ba2c-c1d51a4ab925]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquired lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG nova.network.neutron [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b0d563-4284-40f1-8c90-cb9dacd531c5]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Flushing IO for device /dev/sde {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d187725-7d83-4d54-8656-659d7e95523b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7612ceb9-3130-40a0-97f1-0b6b7ee5af62]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] SCSI volumes sde have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[82452849-2304-4137-bcfa-cca559313c6f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Cannot resize image /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Ensure instance console log exists: /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[632e8629-8170-45be-92d5-e99e681f37ec]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5, portal: 172.16.0.220,3260]
Nov 13 10:02:34 user nova-compute[74611]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5, portal: 172.16.0.220,3260] successful.
Nov 13 10:02:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7437275-7b26-48c4-8727-b354462437e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dfaeab-5b0d-469d-ae20-f76aaca28516]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] <== disconnect_volume: return (404ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:02:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Deleting instance files /opt/stack/data/nova/instances/f5cb6cf5-f915-4f50-bfc3-0112875dcfcc_del
Nov 13 10:02:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Deletion of /opt/stack/data/nova/instances/f5cb6cf5-f915-4f50-bfc3-0112875dcfcc_del complete
Nov 13 10:02:34 user nova-compute[74611]: INFO nova.compute.manager [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.network.neutron [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updating instance_info_cache with network_info: [{"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Releasing lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.network.neutron [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Successfully updated port: a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "refresh_cache-7eff589b-8f0f-4e6e-ac04-567da455e579" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquired lock "refresh_cache-7eff589b-8f0f-4e6e-ac04-567da455e579" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.network.neutron [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG os_brick.utils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92785f1-0f19-4b50-81b2-fb3ba9a3f8c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.network.neutron [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[245f6420-80b5-4faf-af00-3770bc25981e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[382dfb66-c80a-4edf-839b-6f539df83e5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56348f6-2e5f-4a30-b31e-dc387fd4fb93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:02:34 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4b003a-7c92-40d9-9bad-fd26be061a18]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG os_brick.utils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.network.neutron [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Updating instance_info_cache with network_info: [{"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Releasing lock "refresh_cache-7eff589b-8f0f-4e6e-ac04-567da455e579" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Instance network_info: |[{"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Start _get_guest_xml network_info=[{"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:02:34 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:02:34 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-645946469',display_name='tempest-tempest.common.compute-instance-645946469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-645946469',id=30,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMgiZS8iDWJccUoJm8Cr1Cy30m8ExeWrxEP4qRo7zR0nLwbMSKbTx4l1ShW9U7NI1irrxVZ/xJYIVnbYASt5DAgSuA5M9ZDOJFAOj03z1hM3/11AHFBM2VNKmeseRl6Ng==',key_name='tempest-keypair-620803101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a0b0a078bd44908cd7cd4593914eef',ramdisk_id='',reservation_id='r-0cttspsb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2135577355',owner_user_name='tempest-ServerActionsTestOtherA-2135577355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:02:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22322be2dd04410b6cd53c31e639b3b',uuid=7eff589b-8f0f-4e6e-ac04-567da455e579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converting VIF {"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=a102bae6-0d19-44c8-9aed-ea01e72e4d11,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa102bae6-0d') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.objects.instance [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lazy-loading 'pci_devices' on Instance uuid 7eff589b-8f0f-4e6e-ac04-567da455e579 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-f330b4bf-0a99-4e8a-b0e1-221fb519a8a9 req-8e5ed1eb-cf33-4c3e-98bd-54a7cb42e3fd service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received event network-changed-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-f330b4bf-0a99-4e8a-b0e1-221fb519a8a9 req-8e5ed1eb-cf33-4c3e-98bd-54a7cb42e3fd service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Refreshing instance network info cache due to event network-changed-a102bae6-0d19-44c8-9aed-ea01e72e4d11. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f330b4bf-0a99-4e8a-b0e1-221fb519a8a9 req-8e5ed1eb-cf33-4c3e-98bd-54a7cb42e3fd service nova] Acquiring lock "refresh_cache-7eff589b-8f0f-4e6e-ac04-567da455e579" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f330b4bf-0a99-4e8a-b0e1-221fb519a8a9 req-8e5ed1eb-cf33-4c3e-98bd-54a7cb42e3fd service nova] Acquired lock "refresh_cache-7eff589b-8f0f-4e6e-ac04-567da455e579" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.network.neutron [req-f330b4bf-0a99-4e8a-b0e1-221fb519a8a9 req-8e5ed1eb-cf33-4c3e-98bd-54a7cb42e3fd service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Refreshing network info cache for port a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:02:34 user nova-compute[74611]:   <uuid>7eff589b-8f0f-4e6e-ac04-567da455e579</uuid>
Nov 13 10:02:34 user nova-compute[74611]:   <name>instance-0000001e</name>
Nov 13 10:02:34 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:02:34 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:02:34 user nova-compute[74611]:   <metadata>
Nov 13 10:02:34 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:02:34 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:02:34 user nova-compute[74611]:       <nova:name>tempest-tempest.common.compute-instance-645946469</nova:name>
Nov 13 10:02:34 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:02:34</nova:creationTime>
Nov 13 10:02:34 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:02:34 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:02:34 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:02:34 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:02:34 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:02:34 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:02:34 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:02:34 user nova-compute[74611]:       <nova:owner>
Nov 13 10:02:34 user nova-compute[74611]:         <nova:user uuid="f22322be2dd04410b6cd53c31e639b3b">tempest-ServerActionsTestOtherA-2135577355-project-member</nova:user>
Nov 13 10:02:34 user nova-compute[74611]:         <nova:project uuid="e6a0b0a078bd44908cd7cd4593914eef">tempest-ServerActionsTestOtherA-2135577355</nova:project>
Nov 13 10:02:34 user nova-compute[74611]:       </nova:owner>
Nov 13 10:02:34 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:02:34 user nova-compute[74611]:       <nova:ports>
Nov 13 10:02:34 user nova-compute[74611]:         <nova:port uuid="a102bae6-0d19-44c8-9aed-ea01e72e4d11">
Nov 13 10:02:34 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 10:02:34 user nova-compute[74611]:         </nova:port>
Nov 13 10:02:34 user nova-compute[74611]:       </nova:ports>
Nov 13 10:02:34 user nova-compute[74611]:     </nova:instance>
Nov 13 10:02:34 user nova-compute[74611]:   </metadata>
Nov 13 10:02:34 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:02:34 user nova-compute[74611]:     <system>
Nov 13 10:02:34 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:02:34 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:02:34 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:02:34 user nova-compute[74611]:       <entry name="serial">7eff589b-8f0f-4e6e-ac04-567da455e579</entry>
Nov 13 10:02:34 user nova-compute[74611]:       <entry name="uuid">7eff589b-8f0f-4e6e-ac04-567da455e579</entry>
Nov 13 10:02:34 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:02:34 user nova-compute[74611]:     </system>
Nov 13 10:02:34 user nova-compute[74611]:   </sysinfo>
Nov 13 10:02:34 user nova-compute[74611]:   <os>
Nov 13 10:02:34 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:02:34 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:02:34 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:02:34 user nova-compute[74611]:   </os>
Nov 13 10:02:34 user nova-compute[74611]:   <features>
Nov 13 10:02:34 user nova-compute[74611]:     <acpi/>
Nov 13 10:02:34 user nova-compute[74611]:     <apic/>
Nov 13 10:02:34 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:02:34 user nova-compute[74611]:   </features>
Nov 13 10:02:34 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:02:34 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:02:34 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:02:34 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:02:34 user nova-compute[74611]:   </clock>
Nov 13 10:02:34 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:02:34 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:02:34 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:02:34 user nova-compute[74611]:   </cpu>
Nov 13 10:02:34 user nova-compute[74611]:   <devices>
Nov 13 10:02:34 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:02:34 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:02:34 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk"/>
Nov 13 10:02:34 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:02:34 user nova-compute[74611]:     </disk>
Nov 13 10:02:34 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:02:34 user nova-compute[74611]:       <mac address="fa:16:3e:8b:04:f1"/>
Nov 13 10:02:34 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:02:34 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:02:34 user nova-compute[74611]:       <target dev="tapa102bae6-0d"/>
Nov 13 10:02:34 user nova-compute[74611]:     </interface>
Nov 13 10:02:34 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:02:34 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/console.log" append="off"/>
Nov 13 10:02:34 user nova-compute[74611]:     </serial>
Nov 13 10:02:34 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:02:34 user nova-compute[74611]:     <video>
Nov 13 10:02:34 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:02:34 user nova-compute[74611]:     </video>
Nov 13 10:02:34 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:02:34 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:02:34 user nova-compute[74611]:     </rng>
Nov 13 10:02:34 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:02:34 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:02:34 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:02:34 user nova-compute[74611]:     </memballoon>
Nov 13 10:02:34 user nova-compute[74611]:   </devices>
Nov 13 10:02:34 user nova-compute[74611]: </domain>
Nov 13 10:02:34 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-645946469',display_name='tempest-tempest.common.compute-instance-645946469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-645946469',id=30,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMgiZS8iDWJccUoJm8Cr1Cy30m8ExeWrxEP4qRo7zR0nLwbMSKbTx4l1ShW9U7NI1irrxVZ/xJYIVnbYASt5DAgSuA5M9ZDOJFAOj03z1hM3/11AHFBM2VNKmeseRl6Ng==',key_name='tempest-keypair-620803101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a0b0a078bd44908cd7cd4593914eef',ramdisk_id='',reservation_id='r-0cttspsb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2135577355',owner_user_name='tempest-ServerActionsTestOtherA-2135577355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:02:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22322be2dd04410b6cd53c31e639b3b',uuid=7eff589b-8f0f-4e6e-ac04-567da455e579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converting VIF {"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=a102bae6-0d19-44c8-9aed-ea01e72e4d11,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa102bae6-0d') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG os_vif [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=a102bae6-0d19-44c8-9aed-ea01e72e4d11,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa102bae6-0d') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b1c7aab-39c0-579c-842e-97d8212263d3', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa102bae6-0d, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa102bae6-0d, col_values=(('qos', UUID('c6f14531-9b51-4106-aebe-507faeee21dd')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa102bae6-0d, col_values=(('external_ids', {'iface-id': 'a102bae6-0d19-44c8-9aed-ea01e72e4d11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:04:f1', 'vm-uuid': '7eff589b-8f0f-4e6e-ac04-567da455e579'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:02:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:34 user nova-compute[74611]: INFO os_vif [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=a102bae6-0d19-44c8-9aed-ea01e72e4d11,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa102bae6-0d')
Nov 13 10:02:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:02:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] No VIF found with MAC fa:16:3e:8b:04:f1, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:02:35 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:35 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Took 0.91 seconds to deallocate network for instance.
Nov 13 10:02:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-e369f98c-775b-4330-9e25-32725f3235e6 req-246e720b-2071-4b20-83e4-045e803b2610 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received event network-vif-deleted-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:35 user nova-compute[74611]: INFO nova.compute.manager [req-e369f98c-775b-4330-9e25-32725f3235e6 req-246e720b-2071-4b20-83e4-045e803b2610 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Neutron deleted interface 4e7f5a25-370f-4d77-a8e9-b29f90a337bc; detaching it from the instance and deleting it from the info cache
Nov 13 10:02:35 user nova-compute[74611]: DEBUG nova.network.neutron [req-e369f98c-775b-4330-9e25-32725f3235e6 req-246e720b-2071-4b20-83e4-045e803b2610 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-e369f98c-775b-4330-9e25-32725f3235e6 req-246e720b-2071-4b20-83e4-045e803b2610 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Detach interface failed, port_id=4e7f5a25-370f-4d77-a8e9-b29f90a337bc, reason: Instance f5cb6cf5-f915-4f50-bfc3-0112875dcfcc could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 10:02:35 user nova-compute[74611]: DEBUG nova.network.neutron [req-f330b4bf-0a99-4e8a-b0e1-221fb519a8a9 req-8e5ed1eb-cf33-4c3e-98bd-54a7cb42e3fd service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Updated VIF entry in instance network info cache for port a102bae6-0d19-44c8-9aed-ea01e72e4d11. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:02:35 user nova-compute[74611]: DEBUG nova.network.neutron [req-f330b4bf-0a99-4e8a-b0e1-221fb519a8a9 req-8e5ed1eb-cf33-4c3e-98bd-54a7cb42e3fd service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Updating instance_info_cache with network_info: [{"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f330b4bf-0a99-4e8a-b0e1-221fb519a8a9 req-8e5ed1eb-cf33-4c3e-98bd-54a7cb42e3fd service nova] Releasing lock "refresh_cache-7eff589b-8f0f-4e6e-ac04-567da455e579" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:02:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-829472e7-8441-4b8f-9c96-f957e508b788 req-cf946ccf-7dfa-4df5-a395-06f30099fd69 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received event network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-829472e7-8441-4b8f-9c96-f957e508b788 req-cf946ccf-7dfa-4df5-a395-06f30099fd69 service nova] Acquiring lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-829472e7-8441-4b8f-9c96-f957e508b788 req-cf946ccf-7dfa-4df5-a395-06f30099fd69 service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-829472e7-8441-4b8f-9c96-f957e508b788 req-cf946ccf-7dfa-4df5-a395-06f30099fd69 service nova] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-829472e7-8441-4b8f-9c96-f957e508b788 req-cf946ccf-7dfa-4df5-a395-06f30099fd69 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] No waiting events found dispatching network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:35 user nova-compute[74611]: WARNING nova.compute.manager [req-829472e7-8441-4b8f-9c96-f957e508b788 req-cf946ccf-7dfa-4df5-a395-06f30099fd69 service nova] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Received unexpected event network-vif-plugged-4e7f5a25-370f-4d77-a8e9-b29f90a337bc for instance with vm_state active and task_state deleting.
Nov 13 10:02:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-82d2d5d2-b022-45b3-82a8-3f931830a1aa req-d3eac478-8a36-4fa6-8620-a95f2427bebb service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received event network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-82d2d5d2-b022-45b3-82a8-3f931830a1aa req-d3eac478-8a36-4fa6-8620-a95f2427bebb service nova] Acquiring lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-82d2d5d2-b022-45b3-82a8-3f931830a1aa req-d3eac478-8a36-4fa6-8620-a95f2427bebb service nova] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-82d2d5d2-b022-45b3-82a8-3f931830a1aa req-d3eac478-8a36-4fa6-8620-a95f2427bebb service nova] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-82d2d5d2-b022-45b3-82a8-3f931830a1aa req-d3eac478-8a36-4fa6-8620-a95f2427bebb service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] No waiting events found dispatching network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:37 user nova-compute[74611]: WARNING nova.compute.manager [req-82d2d5d2-b022-45b3-82a8-3f931830a1aa req-d3eac478-8a36-4fa6-8620-a95f2427bebb service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received unexpected event network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 for instance with vm_state building and task_state spawning.
Nov 13 10:02:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-82d2d5d2-b022-45b3-82a8-3f931830a1aa req-d3eac478-8a36-4fa6-8620-a95f2427bebb service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received event network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-82d2d5d2-b022-45b3-82a8-3f931830a1aa req-d3eac478-8a36-4fa6-8620-a95f2427bebb service nova] Acquiring lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-82d2d5d2-b022-45b3-82a8-3f931830a1aa req-d3eac478-8a36-4fa6-8620-a95f2427bebb service nova] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-82d2d5d2-b022-45b3-82a8-3f931830a1aa req-d3eac478-8a36-4fa6-8620-a95f2427bebb service nova] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-82d2d5d2-b022-45b3-82a8-3f931830a1aa req-d3eac478-8a36-4fa6-8620-a95f2427bebb service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] No waiting events found dispatching network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:37 user nova-compute[74611]: WARNING nova.compute.manager [req-82d2d5d2-b022-45b3-82a8-3f931830a1aa req-d3eac478-8a36-4fa6-8620-a95f2427bebb service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received unexpected event network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 for instance with vm_state building and task_state spawning.
Nov 13 10:02:38 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:02:38 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:02:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-85cb3adb-b2b3-49ec-92ab-c2b7a028241a" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:02:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-85cb3adb-b2b3-49ec-92ab-c2b7a028241a" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:02:38 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:02:38 user nova-compute[74611]: DEBUG nova.compute.manager [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:02:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:02:38 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Instance spawned successfully.
Nov 13 10:02:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:02:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:02:38 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Updating instance_info_cache with network_info: [{"id": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "address": "fa:16:3e:ea:e8:de", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e875b56-fd", "ovs_interfaceid": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-85cb3adb-b2b3-49ec-92ab-c2b7a028241a" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:02:38 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:02:38 user nova-compute[74611]: INFO nova.compute.manager [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 13 10:02:38 user nova-compute[74611]: DEBUG nova.compute.manager [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:02:38 user nova-compute[74611]: INFO nova.compute.manager [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Took 6.66 seconds to build instance.
Nov 13 10:02:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-465abe49-55b3-448c-8259-631aca458e47 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.761s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:39 user nova-compute[74611]: INFO nova.compute.manager [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Took 4.00 seconds to detach 1 volumes for instance.
Nov 13 10:02:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] [instance: f5cb6cf5-f915-4f50-bfc3-0112875dcfcc] Deleting volume: a7437275-7b26-48c4-8727-b354462437e5 {{(pid=74611) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:39 user nova-compute[74611]: INFO nova.compute.manager [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Terminating instance
Nov 13 10:02:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Starting finish_migration {{(pid=74611) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Instance directory exists: not creating {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 10:02:39 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Creating image(s)
Nov 13 10:02:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-d72e984b-a8f0-41b5-b0fb-cda36b193aa2 req-516f58e6-d0a0-4b2d-b690-8ccf55bb2c9a service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Received event network-vif-unplugged-9c9a6625-758d-4420-996a-b18045a7e123 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d72e984b-a8f0-41b5-b0fb-cda36b193aa2 req-516f58e6-d0a0-4b2d-b690-8ccf55bb2c9a service nova] Acquiring lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d72e984b-a8f0-41b5-b0fb-cda36b193aa2 req-516f58e6-d0a0-4b2d-b690-8ccf55bb2c9a service nova] Lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d72e984b-a8f0-41b5-b0fb-cda36b193aa2 req-516f58e6-d0a0-4b2d-b690-8ccf55bb2c9a service nova] Lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-d72e984b-a8f0-41b5-b0fb-cda36b193aa2 req-516f58e6-d0a0-4b2d-b690-8ccf55bb2c9a service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] No waiting events found dispatching network-vif-unplugged-9c9a6625-758d-4420-996a-b18045a7e123 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-d72e984b-a8f0-41b5-b0fb-cda36b193aa2 req-516f58e6-d0a0-4b2d-b690-8ccf55bb2c9a service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Received event network-vif-unplugged-9c9a6625-758d-4420-996a-b18045a7e123 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.254s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Checking if we can resize image /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk. size=21474836480 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:02:40 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Instance destroyed successfully.
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.objects.instance [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lazy-loading 'resources' on Instance uuid ceabff0f-7be5-4fdc-9ac0-f49bc053be49 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:00:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-840872283',display_name='tempest-VolumesAdminNegativeTest-server-840872283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-840872283',id=26,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:00:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ca1b2857119419e8d4cd65f6d77d9ba',ramdisk_id='',reservation_id='r-ucnr0009',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1382146762',owner_user_name='tempest-VolumesAdminNegativeTest-1382146762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:00:55Z,user_data=None,user_id='3227fb32ab644865880e5354d1306941',uuid=ceabff0f-7be5-4fdc-9ac0-f49bc053be49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c9a6625-758d-4420-996a-b18045a7e123", "address": "fa:16:3e:9f:35:61", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c9a6625-75", "ovs_interfaceid": "9c9a6625-758d-4420-996a-b18045a7e123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Converting VIF {"id": "9c9a6625-758d-4420-996a-b18045a7e123", "address": "fa:16:3e:9f:35:61", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c9a6625-75", "ovs_interfaceid": "9c9a6625-758d-4420-996a-b18045a7e123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:35:61,bridge_name='br-int',has_traffic_filtering=True,id=9c9a6625-758d-4420-996a-b18045a7e123,network=Network(ca1cd594-c2c0-41e4-92dc-f828ce2b5423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c9a6625-75') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_vif [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:35:61,bridge_name='br-int',has_traffic_filtering=True,id=9c9a6625-758d-4420-996a-b18045a7e123,network=Network(ca1cd594-c2c0-41e4-92dc-f828ce2b5423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c9a6625-75') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c9a6625-75, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1055b080-375d-478e-afd1-3fee2e8de8af) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:40 user nova-compute[74611]: INFO os_vif [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:35:61,bridge_name='br-int',has_traffic_filtering=True,id=9c9a6625-758d-4420-996a-b18045a7e123,network=Network(ca1cd594-c2c0-41e4-92dc-f828ce2b5423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c9a6625-75')
Nov 13 10:02:40 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Deleting instance files /opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49_del
Nov 13 10:02:40 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Deletion of /opt/stack/data/nova/instances/ceabff0f-7be5-4fdc-9ac0-f49bc053be49_del complete
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk 21474836480 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.849s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk 21474836480" returned: 0 in 0.061s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Ensure instance console log exists: /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Start _get_guest_xml network_info=[{"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1498625862-network", "vif_mac": "fa:16:3e:f5:e2:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': '09dcc59a-ab45-41ba-bc83-2f611d450209', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQfyJOvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '635636ea-96a0-4fdb-85a1-ca7a87b762f0', 'attached_at': '2023-11-13T10:02:39.000000', 'detached_at': '', 'volume_id': 'c9fb42e8-06d6-42aa-a06c-142251173f9f', 'serial': 'c9fb42e8-06d6-42aa-a06c-142251173f9f'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:02:40 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Deleted allocations for instance f5cb6cf5-f915-4f50-bfc3-0112875dcfcc
Nov 13 10:02:40 user nova-compute[74611]: INFO nova.compute.manager [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Took 0.81 seconds to destroy the instance on the hypervisor.
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:02:40 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:02:40 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQfyJOvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:02:40 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:02:40 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:02:40 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-697f0db0-5343-4dbe-a394-c95b81dbdd56 tempest-ServerActionsV293TestJSON-1007705503 tempest-ServerActionsV293TestJSON-1007705503-project-member] Lock "f5cb6cf5-f915-4f50-bfc3-0112875dcfcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.595s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c99ba0-ebee-4aba-8b5d-b82027d7a453]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:02:40 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0825b936-da88-46ec-bff6-4892d699e695]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f] added
Nov 13 10:02:40 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd86a1e3-f1c6-48f2-96a0-a8c2f7ea7fdd]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1161216e-d1d5-4001-802f-61500a6266c8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQfyJOvn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQfyJOvn" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[153e3e01-4c91-4632-b006-f28863e112c0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eQfyJOvn'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d917eea9-c69b-41f1-9c0c-14cf0bf0afc0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6c901b-dbed-49bd-8ff2-c3aa2185530c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:40 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:40 user nova-compute[74611]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)
Nov 13 10:02:40 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:40 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:40 user nova-compute[74611]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)
Nov 13 10:02:40 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf076c82-03a0-49bd-98da-1bbd9b97ae28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260]
Nov 13 10:02:40 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260] successful.
Nov 13 10:02:40 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e06b8cf-56ad-4aed-ae8b-271c1740b42d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36ea0c1-3ad0-4d52-842f-95c59d39a95a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:40 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:40 user nova-compute[74611]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)
Nov 13 10:02:40 user nova-compute[74611]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:02:40 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:40 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:40 user nova-compute[74611]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)
Nov 13 10:02:40 user nova-compute[74611]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:02:40 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b573264-dc85-4ab1-83b2-305efe10de47]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQfyJOvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:40 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Took 0.49 seconds to deallocate network for instance.
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-eb2e356d-d1e8-4199-8906-14efcc3f1519 req-de75fa66-4cd6-4333-89b8-0a7b37e1171e service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Received event network-vif-deleted-9c9a6625-758d-4420-996a-b18045a7e123 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:40 user nova-compute[74611]: INFO nova.compute.manager [req-eb2e356d-d1e8-4199-8906-14efcc3f1519 req-de75fa66-4cd6-4333-89b8-0a7b37e1171e service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Neutron deleted interface 9c9a6625-758d-4420-996a-b18045a7e123; detaching it from the instance and deleting it from the info cache
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.network.neutron [req-eb2e356d-d1e8-4199-8906-14efcc3f1519 req-de75fa66-4cd6-4333-89b8-0a7b37e1171e service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-eb2e356d-d1e8-4199-8906-14efcc3f1519 req-de75fa66-4cd6-4333-89b8-0a7b37e1171e service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Detach interface failed, port_id=9c9a6625-758d-4420-996a-b18045a7e123, reason: Instance ceabff0f-7be5-4fdc-9ac0-f49bc053be49 could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:41 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Deleted allocations for instance ceabff0f-7be5-4fdc-9ac0-f49bc053be49
Nov 13 10:02:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-10888e1b-c76d-4340-b81f-b9b85681e7fc tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.004s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26564353365666465', 'path': '/dev/sde'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564353365666465', 'path': '/dev/sde'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1214168652',display_name='tempest-ServerActionsTestOtherB-server-1214168652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1214168652',id=21,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDWkg3C+Ons0/sduU7bCkNdUaQmui4Ar0pDJw7KSIbqtW1jWjrtKiyZ8w8dVwpvUbMKS1UF1ykPykLHc0hyTfyxEKKXaxiPgUkE/a0u6OsQxRK/HJgxNowuqXz8Zc+KMg==',key_name='tempest-keypair-1038082490',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:58:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1fb42835d7f49cbaad21eee295c7692',ramdisk_id='',reservation_id='r-yeac67tm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-840608963',owner_user_name='tempest-ServerActionsTestOtherB-840608963-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:02:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='396adec28c0d44a0aefb1229090f90d5',uuid=635636ea-96a0-4fdb-85a1-ca7a87b762f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1498625862-network", "vif_mac": "fa:16:3e:f5:e2:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converting VIF {"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1498625862-network", "vif_mac": "fa:16:3e:f5:e2:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:02:41 user nova-compute[74611]:   <uuid>635636ea-96a0-4fdb-85a1-ca7a87b762f0</uuid>
Nov 13 10:02:41 user nova-compute[74611]:   <name>instance-00000015</name>
Nov 13 10:02:41 user nova-compute[74611]:   <memory>2097152</memory>
Nov 13 10:02:41 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:02:41 user nova-compute[74611]:   <metadata>
Nov 13 10:02:41 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:02:41 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:02:41 user nova-compute[74611]:       <nova:name>tempest-ServerActionsTestOtherB-server-1214168652</nova:name>
Nov 13 10:02:41 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:02:40</nova:creationTime>
Nov 13 10:02:41 user nova-compute[74611]:       <nova:flavor name="m1.small">
Nov 13 10:02:41 user nova-compute[74611]:         <nova:memory>2048</nova:memory>
Nov 13 10:02:41 user nova-compute[74611]:         <nova:disk>20</nova:disk>
Nov 13 10:02:41 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:02:41 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:02:41 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:02:41 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:02:41 user nova-compute[74611]:       <nova:owner>
Nov 13 10:02:41 user nova-compute[74611]:         <nova:user uuid="396adec28c0d44a0aefb1229090f90d5">tempest-ServerActionsTestOtherB-840608963-project-member</nova:user>
Nov 13 10:02:41 user nova-compute[74611]:         <nova:project uuid="a1fb42835d7f49cbaad21eee295c7692">tempest-ServerActionsTestOtherB-840608963</nova:project>
Nov 13 10:02:41 user nova-compute[74611]:       </nova:owner>
Nov 13 10:02:41 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:02:41 user nova-compute[74611]:       <nova:ports>
Nov 13 10:02:41 user nova-compute[74611]:         <nova:port uuid="9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d">
Nov 13 10:02:41 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 10:02:41 user nova-compute[74611]:         </nova:port>
Nov 13 10:02:41 user nova-compute[74611]:       </nova:ports>
Nov 13 10:02:41 user nova-compute[74611]:     </nova:instance>
Nov 13 10:02:41 user nova-compute[74611]:   </metadata>
Nov 13 10:02:41 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:02:41 user nova-compute[74611]:     <system>
Nov 13 10:02:41 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:02:41 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:02:41 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:02:41 user nova-compute[74611]:       <entry name="serial">635636ea-96a0-4fdb-85a1-ca7a87b762f0</entry>
Nov 13 10:02:41 user nova-compute[74611]:       <entry name="uuid">635636ea-96a0-4fdb-85a1-ca7a87b762f0</entry>
Nov 13 10:02:41 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:02:41 user nova-compute[74611]:     </system>
Nov 13 10:02:41 user nova-compute[74611]:   </sysinfo>
Nov 13 10:02:41 user nova-compute[74611]:   <os>
Nov 13 10:02:41 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:02:41 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:02:41 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:02:41 user nova-compute[74611]:   </os>
Nov 13 10:02:41 user nova-compute[74611]:   <features>
Nov 13 10:02:41 user nova-compute[74611]:     <acpi/>
Nov 13 10:02:41 user nova-compute[74611]:     <apic/>
Nov 13 10:02:41 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:02:41 user nova-compute[74611]:   </features>
Nov 13 10:02:41 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:02:41 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:02:41 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:02:41 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:02:41 user nova-compute[74611]:   </clock>
Nov 13 10:02:41 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:02:41 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:02:41 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:02:41 user nova-compute[74611]:   </cpu>
Nov 13 10:02:41 user nova-compute[74611]:   <devices>
Nov 13 10:02:41 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:02:41 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:02:41 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk"/>
Nov 13 10:02:41 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:02:41 user nova-compute[74611]:     </disk>
Nov 13 10:02:41 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:02:41 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:02:41 user nova-compute[74611]:       <source dev="/dev/sde"/>
Nov 13 10:02:41 user nova-compute[74611]:       <target dev="vdb" bus="virtio"/>
Nov 13 10:02:41 user nova-compute[74611]:       <serial>c9fb42e8-06d6-42aa-a06c-142251173f9f</serial>
Nov 13 10:02:41 user nova-compute[74611]:     </disk>
Nov 13 10:02:41 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:02:41 user nova-compute[74611]:       <mac address="fa:16:3e:f5:e2:a3"/>
Nov 13 10:02:41 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:02:41 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:02:41 user nova-compute[74611]:       <target dev="tap9ff4d9c6-a2"/>
Nov 13 10:02:41 user nova-compute[74611]:     </interface>
Nov 13 10:02:41 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:02:41 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/console.log" append="off"/>
Nov 13 10:02:41 user nova-compute[74611]:     </serial>
Nov 13 10:02:41 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:02:41 user nova-compute[74611]:     <video>
Nov 13 10:02:41 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:02:41 user nova-compute[74611]:     </video>
Nov 13 10:02:41 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:02:41 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:02:41 user nova-compute[74611]:     </rng>
Nov 13 10:02:41 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:02:41 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:02:41 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:02:41 user nova-compute[74611]:     </memballoon>
Nov 13 10:02:41 user nova-compute[74611]:   </devices>
Nov 13 10:02:41 user nova-compute[74611]: </domain>
Nov 13 10:02:41 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1214168652',display_name='tempest-ServerActionsTestOtherB-server-1214168652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1214168652',id=21,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDWkg3C+Ons0/sduU7bCkNdUaQmui4Ar0pDJw7KSIbqtW1jWjrtKiyZ8w8dVwpvUbMKS1UF1ykPykLHc0hyTfyxEKKXaxiPgUkE/a0u6OsQxRK/HJgxNowuqXz8Zc+KMg==',key_name='tempest-keypair-1038082490',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:58:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1fb42835d7f49cbaad21eee295c7692',ramdisk_id='',reservation_id='r-yeac67tm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-840608963',owner_user_name='tempest-ServerActionsTestOtherB-840608963-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:02:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='396adec28c0d44a0aefb1229090f90d5',uuid=635636ea-96a0-4fdb-85a1-ca7a87b762f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1498625862-network", "vif_mac": "fa:16:3e:f5:e2:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converting VIF {"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1498625862-network", "vif_mac": "fa:16:3e:f5:e2:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG os_vif [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab36b041-07a0-547b-b4c0-73d2ad864388', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ff4d9c6-a2, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ff4d9c6-a2, col_values=(('qos', UUID('8cb9ae7e-76d2-4cdc-a7f9-50eaaecefa67')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ff4d9c6-a2, col_values=(('external_ids', {'iface-id': '9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:e2:a3', 'vm-uuid': '635636ea-96a0-4fdb-85a1-ca7a87b762f0'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:41 user nova-compute[74611]: INFO os_vif [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2')
Nov 13 10:02:41 user nova-compute[74611]: DEBUG nova.compute.manager [req-5ce8c44b-594c-453f-8622-6fda072e3dd2 req-2ae832ba-49e9-4b86-90db-a146174412ed service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Received event network-vif-plugged-9c9a6625-758d-4420-996a-b18045a7e123 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5ce8c44b-594c-453f-8622-6fda072e3dd2 req-2ae832ba-49e9-4b86-90db-a146174412ed service nova] Acquiring lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5ce8c44b-594c-453f-8622-6fda072e3dd2 req-2ae832ba-49e9-4b86-90db-a146174412ed service nova] Lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5ce8c44b-594c-453f-8622-6fda072e3dd2 req-2ae832ba-49e9-4b86-90db-a146174412ed service nova] Lock "ceabff0f-7be5-4fdc-9ac0-f49bc053be49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG nova.compute.manager [req-5ce8c44b-594c-453f-8622-6fda072e3dd2 req-2ae832ba-49e9-4b86-90db-a146174412ed service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] No waiting events found dispatching network-vif-plugged-9c9a6625-758d-4420-996a-b18045a7e123 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:41 user nova-compute[74611]: WARNING nova.compute.manager [req-5ce8c44b-594c-453f-8622-6fda072e3dd2 req-2ae832ba-49e9-4b86-90db-a146174412ed service nova] [instance: ceabff0f-7be5-4fdc-9ac0-f49bc053be49] Received unexpected event network-vif-plugged-9c9a6625-758d-4420-996a-b18045a7e123 for instance with vm_state deleted and task_state None.
Nov 13 10:02:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:02:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] No VIF found with MAC fa:16:3e:f5:e2:a3, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:02:42 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 23495073-10b7-4552-ad61-16fdf410956b is timed out.
Nov 13 10:02:42 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Successfully detached device vdb from instance 23495073-10b7-4552-ad61-16fdf410956b from the live domain config.
Nov 13 10:02:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvIVEDHj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:02:42 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3785cf7-08bc-47a9-8bda-7b0d13331b6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:02:42 user nova-compute[74611]: No targets found.
Nov 13 10:02:42 user nova-compute[74611]: iSNS:
Nov 13 10:02:42 user nova-compute[74611]: No targets found.
Nov 13 10:02:42 user nova-compute[74611]: STATIC:
Nov 13 10:02:42 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f
Nov 13 10:02:42 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:42 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:42 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535
Nov 13 10:02:42 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:42 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:42 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425
Nov 13 10:02:42 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:42 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:42 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:02:42 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:02:42 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:02:42 user nova-compute[74611]: FIRMWARE:
Nov 13 10:02:42 user nova-compute[74611]: No targets found.
Nov 13 10:02:42 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:02:42 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:02:42 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacc731f-00ae-422a-b093-54510ba53d30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[332f64f0-71ea-40d1-bcf3-7abb7ba434af]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:42 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:42 user nova-compute[74611]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)
Nov 13 10:02:42 user nova-compute[74611]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:02:42 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:02:42 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:02:42 user nova-compute[74611]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 (non-flash)
Nov 13 10:02:42 user nova-compute[74611]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:02:42 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64681a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535'): ({'sdd'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Removing single pathed devices sdd {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ada408f-6f4a-4935-9524-160cdb1916d0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1f94fa-197e-4fdf-b5ca-a485edeeae54]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Flushing IO for device /dev/sdd {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[db31285b-f799-4c68-8d1a-fe62fcd43e86]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06daf25-802a-4f33-ba01-e438bfaaf4be]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] SCSI volumes sdd have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0057f620-6f4b-494c-8cdc-b815a353be73]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57873db-7dcf-4d05-bdd7-d3bf2eb309a1]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535, portal: 172.16.0.220,3260]
Nov 13 10:02:42 user nova-compute[74611]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535, portal: 172.16.0.220,3260] successful.
Nov 13 10:02:42 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc78390-5c44-4ddd-bc2d-299aba8e3535 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfa6cdf-729c-4e06-8dc0-b0778cb84536]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] <== disconnect_volume: return (299ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:02:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:02:43 user nova-compute[74611]: DEBUG nova.objects.instance [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'flavor' on Instance uuid 23495073-10b7-4552-ad61-16fdf410956b {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:02:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5545671d-91e9-42ca-860c-127849b04be8 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "23495073-10b7-4552-ad61-16fdf410956b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.675s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-13fa1358-4a63-48cb-8e9d-d6b239d29845 req-751bf2ee-9771-4095-8187-b884afe2128d service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-13fa1358-4a63-48cb-8e9d-d6b239d29845 req-751bf2ee-9771-4095-8187-b884afe2128d service nova] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-13fa1358-4a63-48cb-8e9d-d6b239d29845 req-751bf2ee-9771-4095-8187-b884afe2128d service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-13fa1358-4a63-48cb-8e9d-d6b239d29845 req-751bf2ee-9771-4095-8187-b884afe2128d service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-13fa1358-4a63-48cb-8e9d-d6b239d29845 req-751bf2ee-9771-4095-8187-b884afe2128d service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] No waiting events found dispatching network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:43 user nova-compute[74611]: WARNING nova.compute.manager [req-13fa1358-4a63-48cb-8e9d-d6b239d29845 req-751bf2ee-9771-4095-8187-b884afe2128d service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received unexpected event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d for instance with vm_state active and task_state resize_finish.
Nov 13 10:02:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:44 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:02:44 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:02:44 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:02:44 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:02:45 user nova-compute[74611]: DEBUG nova.compute.manager [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:02:45 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Instance running successfully.
Nov 13 10:02:45 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Failed to set time: agent not configured {{(pid=74611) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 13 10:02:45 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fdd25a65-0d43-41b6-a649-0b5d459fa4b9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] finish_migration finished successfully. {{(pid=74611) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 13 10:02:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-656e4f75-d9cf-4941-ad60-653dee134eab req-a3ea456c-e75f-4c96-b8a0-606155e59560 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-656e4f75-d9cf-4941-ad60-653dee134eab req-a3ea456c-e75f-4c96-b8a0-606155e59560 service nova] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-656e4f75-d9cf-4941-ad60-653dee134eab req-a3ea456c-e75f-4c96-b8a0-606155e59560 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-656e4f75-d9cf-4941-ad60-653dee134eab req-a3ea456c-e75f-4c96-b8a0-606155e59560 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-656e4f75-d9cf-4941-ad60-653dee134eab req-a3ea456c-e75f-4c96-b8a0-606155e59560 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] No waiting events found dispatching network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:02:45 user nova-compute[74611]: WARNING nova.compute.manager [req-656e4f75-d9cf-4941-ad60-653dee134eab req-a3ea456c-e75f-4c96-b8a0-606155e59560 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received unexpected event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d for instance with vm_state active and task_state resize_finish.
Nov 13 10:02:46 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:02:46 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:02:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:46 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:02:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:02:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:02:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:02:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:51 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:02:51 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:02:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=7022MB free_disk=25.23577117919922GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:02:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Applying migration context for instance 635636ea-96a0-4fdb-85a1-ca7a87b762f0 as it has an incoming, in-progress migration 4853187a-b106-42a3-9133-dece359c134e. Migration status is finished {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 10:02:52 user nova-compute[74611]: INFO nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updating resource usage from migration 4853187a-b106-42a3-9133-dece359c134e
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 85cb3adb-b2b3-49ec-92ab-c2b7a028241a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance e99e1557-500f-407e-aefc-3b5cde9ceba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4970bd6b-69a6-479c-9f5f-bc5fc6021407 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 23495073-10b7-4552-ad61-16fdf410956b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 261e3e34-7a30-42f5-ae31-c3d3a76d0d67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4fa9e23b-30f2-41ae-83ed-86145389d474 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Migration 4853187a-b106-42a3-9133-dece359c134e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 635636ea-96a0-4fdb-85a1-ca7a87b762f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7eff589b-8f0f-4e6e-ac04-567da455e579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:02:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:53 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:02:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "16e43d20-bcae-4813-9e4b-55099e23d370" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "16e43d20-bcae-4813-9e4b-55099e23d370" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:58 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:02:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:02:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:02:58 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:02:58 user nova-compute[74611]: INFO nova.compute.claims [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Claim successful on node user
Nov 13 10:02:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-4c824a58-4725-4cb6-a9c0-039ca5e776d5 req-5683d5ee-8de1-4669-be0f-3ec2ba04a246 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received event network-changed-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-4c824a58-4725-4cb6-a9c0-039ca5e776d5 req-5683d5ee-8de1-4669-be0f-3ec2ba04a246 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Refreshing instance network info cache due to event network-changed-a2a9d4c3-0ad3-48b0-a588-65a18320392a. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4c824a58-4725-4cb6-a9c0-039ca5e776d5 req-5683d5ee-8de1-4669-be0f-3ec2ba04a246 service nova] Acquiring lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4c824a58-4725-4cb6-a9c0-039ca5e776d5 req-5683d5ee-8de1-4669-be0f-3ec2ba04a246 service nova] Acquired lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG nova.network.neutron [req-4c824a58-4725-4cb6-a9c0-039ca5e776d5 req-5683d5ee-8de1-4669-be0f-3ec2ba04a246 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Refreshing network info cache for port a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.676s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG nova.network.neutron [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:02:59 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:02:59 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG nova.network.neutron [req-4c824a58-4725-4cb6-a9c0-039ca5e776d5 req-5683d5ee-8de1-4669-be0f-3ec2ba04a246 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Updated VIF entry in instance network info cache for port a2a9d4c3-0ad3-48b0-a588-65a18320392a. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG nova.network.neutron [req-4c824a58-4725-4cb6-a9c0-039ca5e776d5 req-5683d5ee-8de1-4669-be0f-3ec2ba04a246 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Updating instance_info_cache with network_info: [{"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4c824a58-4725-4cb6-a9c0-039ca5e776d5 req-5683d5ee-8de1-4669-be0f-3ec2ba04a246 service nova] Releasing lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:02:59 user nova-compute[74611]: INFO nova.virt.block_device [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Booting with volume 187e682d-b203-4996-8b12-6a3d1c4447fd at /dev/vda
Nov 13 10:02:59 user nova-compute[74611]: DEBUG nova.policy [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91e7d88000c1476abfb0df6bfca4e0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12e0c04622143f2a0c24258ab90e153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG os_brick.utils [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd6a66a-90dd-4d24-9153-754dcbd697bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2922bf-157f-498c-8155-badc9dcbd60e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[df917be8-2d2f-465b-82bb-d5698cea3e33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22aeee8-1db7-45d3-a8d1-5c1f00396762]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:02:59 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:02:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb9a35e-15ad-4431-a4ea-a136bcab8439]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG os_brick.utils [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:02:59 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Updating existing volume attachment record: 027e606b-b903-454c-a7ce-13a683cded1f {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:03:01 user nova-compute[74611]: DEBUG nova.network.neutron [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Successfully created port: 605834a6-1df6-4bb7-b277-461f53392466 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:03:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:01 user nova-compute[74611]: INFO nova.compute.manager [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Shelving
Nov 13 10:03:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-6acafacd-427e-4894-be62-3911d42e83f7 req-fdc2bf50-5dce-4364-b597-6f03ef98ba33 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received event network-vif-unplugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:03:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6acafacd-427e-4894-be62-3911d42e83f7 req-fdc2bf50-5dce-4364-b597-6f03ef98ba33 service nova] Acquiring lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6acafacd-427e-4894-be62-3911d42e83f7 req-fdc2bf50-5dce-4364-b597-6f03ef98ba33 service nova] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6acafacd-427e-4894-be62-3911d42e83f7 req-fdc2bf50-5dce-4364-b597-6f03ef98ba33 service nova] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-6acafacd-427e-4894-be62-3911d42e83f7 req-fdc2bf50-5dce-4364-b597-6f03ef98ba33 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] No waiting events found dispatching network-vif-unplugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:03:02 user nova-compute[74611]: WARNING nova.compute.manager [req-6acafacd-427e-4894-be62-3911d42e83f7 req-fdc2bf50-5dce-4364-b597-6f03ef98ba33 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received unexpected event network-vif-unplugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a for instance with vm_state active and task_state shelving.
Nov 13 10:03:02 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Instance destroyed successfully.
Nov 13 10:03:02 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Beginning cold snapshot process
Nov 13 10:03:02 user nova-compute[74611]: DEBUG nova.network.neutron [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Successfully updated port: 605834a6-1df6-4bb7-b277-461f53392466 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:03:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "refresh_cache-16e43d20-bcae-4813-9e4b-55099e23d370" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:03:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquired lock "refresh_cache-16e43d20-bcae-4813-9e4b-55099e23d370" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:03:02 user nova-compute[74611]: DEBUG nova.network.neutron [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:03:02 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 10:03:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk /opt/stack/data/nova/instances/snapshots/tmpaxv26121/a24142f5a6eb4695b22541f69567e555 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:02 user nova-compute[74611]: DEBUG nova.network.neutron [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:03:03 user nova-compute[74611]: DEBUG nova.network.neutron [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Updating instance_info_cache with network_info: [{"id": "605834a6-1df6-4bb7-b277-461f53392466", "address": "fa:16:3e:10:8c:53", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605834a6-1d", "ovs_interfaceid": "605834a6-1df6-4bb7-b277-461f53392466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:03:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Releasing lock "refresh_cache-16e43d20-bcae-4813-9e4b-55099e23d370" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:03:03 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Instance network_info: |[{"id": "605834a6-1df6-4bb7-b277-461f53392466", "address": "fa:16:3e:10:8c:53", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605834a6-1d", "ovs_interfaceid": "605834a6-1df6-4bb7-b277-461f53392466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:03:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk /opt/stack/data/nova/instances/snapshots/tmpaxv26121/a24142f5a6eb4695b22541f69567e555" returned: 0 in 0.686s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:03 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Snapshot extracted, beginning image upload
Nov 13 10:03:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:03:04 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Creating image(s)
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Ensure instance console log exists: /opt/stack/data/nova/instances/16e43d20-bcae-4813-9e4b-55099e23d370/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Start _get_guest_xml network_info=[{"id": "605834a6-1df6-4bb7-b277-461f53392466", "address": "fa:16:3e:10:8c:53", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605834a6-1d", "ovs_interfaceid": "605834a6-1df6-4bb7-b277-461f53392466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '027e606b-b903-454c-a7ce-13a683cded1f', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbIUounm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '16e43d20-bcae-4813-9e4b-55099e23d370', 'attached_at': '', 'detached_at': '', 'volume_id': '187e682d-b203-4996-8b12-6a3d1c4447fd', 'serial': '187e682d-b203-4996-8b12-6a3d1c4447fd'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:03:04 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:03:04 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbIUounm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:03:04 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:03:04 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:03:04 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4936cccb-5aec-4c8f-931c-c0427d8b7188]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:03:04 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dfb635-d2bc-4130-b3ac-6300c70910bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd] added
Nov 13 10:03:04 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0fbf9f-c6cb-4d77-93c9-e1382f5662d0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74e489b-1a99-4ad7-bce5-f4f5ed582ca0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HbIUounm {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HbIUounm" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f25a32a-61a4-45e6-9508-2da15debbb98]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HbIUounm'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7ea25b-ebca-481d-9064-4f93cdd4aa42]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc6546a-5960-430e-8271-8929b089b1b1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:03:04 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:03:04 user nova-compute[74611]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:03:04 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:03:04 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:03:04 user nova-compute[74611]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:03:04 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-dc73c4dd-766d-45d9-95c2-871296b53c4a req-e1a7a17d-5df4-4a23-932e-e069845f2447 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Received event network-changed-605834a6-1df6-4bb7-b277-461f53392466 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-dc73c4dd-766d-45d9-95c2-871296b53c4a req-e1a7a17d-5df4-4a23-932e-e069845f2447 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Refreshing instance network info cache due to event network-changed-605834a6-1df6-4bb7-b277-461f53392466. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dc73c4dd-766d-45d9-95c2-871296b53c4a req-e1a7a17d-5df4-4a23-932e-e069845f2447 service nova] Acquiring lock "refresh_cache-16e43d20-bcae-4813-9e4b-55099e23d370" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dc73c4dd-766d-45d9-95c2-871296b53c4a req-e1a7a17d-5df4-4a23-932e-e069845f2447 service nova] Acquired lock "refresh_cache-16e43d20-bcae-4813-9e4b-55099e23d370" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG nova.network.neutron [req-dc73c4dd-766d-45d9-95c2-871296b53c4a req-e1a7a17d-5df4-4a23-932e-e069845f2447 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Refreshing network info cache for port 605834a6-1df6-4bb7-b277-461f53392466 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefa681c-e703-41c9-8966-72a4fe194033]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd, portal: 172.16.0.220,3260]
Nov 13 10:03:04 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd, portal: 172.16.0.220,3260] successful.
Nov 13 10:03:04 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4041e6d4-57e9-49ae-b10d-82cfc98741e7]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[29463a02-8885-46c1-a4c0-e469c7b15abe]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:03:04 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:03:04 user nova-compute[74611]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:03:04 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:03:04 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:03:04 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:03:04 user nova-compute[74611]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:03:04 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:03:04 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[399ec4da-bb01-450e-9353-c53f554d2e06]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:03:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbIUounm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG nova.network.neutron [req-dc73c4dd-766d-45d9-95c2-871296b53c4a req-e1a7a17d-5df4-4a23-932e-e069845f2447 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Updated VIF entry in instance network info cache for port 605834a6-1df6-4bb7-b277-461f53392466. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG nova.network.neutron [req-dc73c4dd-766d-45d9-95c2-871296b53c4a req-e1a7a17d-5df4-4a23-932e-e069845f2447 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Updating instance_info_cache with network_info: [{"id": "605834a6-1df6-4bb7-b277-461f53392466", "address": "fa:16:3e:10:8c:53", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605834a6-1d", "ovs_interfaceid": "605834a6-1df6-4bb7-b277-461f53392466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dc73c4dd-766d-45d9-95c2-871296b53c4a req-e1a7a17d-5df4-4a23-932e-e069845f2447 service nova] Releasing lock "refresh_cache-16e43d20-bcae-4813-9e4b-55099e23d370" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-dc73c4dd-766d-45d9-95c2-871296b53c4a req-e1a7a17d-5df4-4a23-932e-e069845f2447 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received event network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dc73c4dd-766d-45d9-95c2-871296b53c4a req-e1a7a17d-5df4-4a23-932e-e069845f2447 service nova] Acquiring lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dc73c4dd-766d-45d9-95c2-871296b53c4a req-e1a7a17d-5df4-4a23-932e-e069845f2447 service nova] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dc73c4dd-766d-45d9-95c2-871296b53c4a req-e1a7a17d-5df4-4a23-932e-e069845f2447 service nova] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-dc73c4dd-766d-45d9-95c2-871296b53c4a req-e1a7a17d-5df4-4a23-932e-e069845f2447 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] No waiting events found dispatching network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:03:05 user nova-compute[74611]: WARNING nova.compute.manager [req-dc73c4dd-766d-45d9-95c2-871296b53c4a req-e1a7a17d-5df4-4a23-932e-e069845f2447 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received unexpected event network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a for instance with vm_state active and task_state shelving_image_uploading.
Nov 13 10:03:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23334636639333832', 'path': '/dev/sdd'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334636639333832', 'path': '/dev/sdd'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-950576607',display_name='tempest-TestVolumeBootPattern-server-950576607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-950576607',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjRXcM+iAZvLJco7tBubak1kGHq/45jJ2KKO6E3tr61cFQKM/YqE/xURoOe/LdnL01vr4FH+cPhy0FHq1+WQre34a6xvIem5nHqznPEd2v959ht3Wgct9dv/En52XotjA==',key_name='tempest-TestVolumeBootPattern-1763350711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-ktdojwi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:03:00Z,user_data=None,user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=16e43d20-bcae-4813-9e4b-55099e23d370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "605834a6-1df6-4bb7-b277-461f53392466", "address": "fa:16:3e:10:8c:53", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605834a6-1d", "ovs_interfaceid": "605834a6-1df6-4bb7-b277-461f53392466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "605834a6-1df6-4bb7-b277-461f53392466", "address": "fa:16:3e:10:8c:53", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605834a6-1d", "ovs_interfaceid": "605834a6-1df6-4bb7-b277-461f53392466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:8c:53,bridge_name='br-int',has_traffic_filtering=True,id=605834a6-1df6-4bb7-b277-461f53392466,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605834a6-1d') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lazy-loading 'pci_devices' on Instance uuid 16e43d20-bcae-4813-9e4b-55099e23d370 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:03:05 user nova-compute[74611]:   <uuid>16e43d20-bcae-4813-9e4b-55099e23d370</uuid>
Nov 13 10:03:05 user nova-compute[74611]:   <name>instance-0000001f</name>
Nov 13 10:03:05 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:03:05 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:03:05 user nova-compute[74611]:   <metadata>
Nov 13 10:03:05 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:03:05 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:03:05 user nova-compute[74611]:       <nova:name>tempest-TestVolumeBootPattern-server-950576607</nova:name>
Nov 13 10:03:05 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:03:04</nova:creationTime>
Nov 13 10:03:05 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:03:05 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:03:05 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:03:05 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:03:05 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:03:05 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:03:05 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:03:05 user nova-compute[74611]:       <nova:owner>
Nov 13 10:03:05 user nova-compute[74611]:         <nova:user uuid="91e7d88000c1476abfb0df6bfca4e0fb">tempest-TestVolumeBootPattern-633061604-project-member</nova:user>
Nov 13 10:03:05 user nova-compute[74611]:         <nova:project uuid="f12e0c04622143f2a0c24258ab90e153">tempest-TestVolumeBootPattern-633061604</nova:project>
Nov 13 10:03:05 user nova-compute[74611]:       </nova:owner>
Nov 13 10:03:05 user nova-compute[74611]:       <nova:ports>
Nov 13 10:03:05 user nova-compute[74611]:         <nova:port uuid="605834a6-1df6-4bb7-b277-461f53392466">
Nov 13 10:03:05 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 10:03:05 user nova-compute[74611]:         </nova:port>
Nov 13 10:03:05 user nova-compute[74611]:       </nova:ports>
Nov 13 10:03:05 user nova-compute[74611]:     </nova:instance>
Nov 13 10:03:05 user nova-compute[74611]:   </metadata>
Nov 13 10:03:05 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:03:05 user nova-compute[74611]:     <system>
Nov 13 10:03:05 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:03:05 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:03:05 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:03:05 user nova-compute[74611]:       <entry name="serial">16e43d20-bcae-4813-9e4b-55099e23d370</entry>
Nov 13 10:03:05 user nova-compute[74611]:       <entry name="uuid">16e43d20-bcae-4813-9e4b-55099e23d370</entry>
Nov 13 10:03:05 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:03:05 user nova-compute[74611]:     </system>
Nov 13 10:03:05 user nova-compute[74611]:   </sysinfo>
Nov 13 10:03:05 user nova-compute[74611]:   <os>
Nov 13 10:03:05 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:03:05 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:03:05 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:03:05 user nova-compute[74611]:   </os>
Nov 13 10:03:05 user nova-compute[74611]:   <features>
Nov 13 10:03:05 user nova-compute[74611]:     <acpi/>
Nov 13 10:03:05 user nova-compute[74611]:     <apic/>
Nov 13 10:03:05 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:03:05 user nova-compute[74611]:   </features>
Nov 13 10:03:05 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:03:05 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:03:05 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:03:05 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:03:05 user nova-compute[74611]:   </clock>
Nov 13 10:03:05 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:03:05 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:03:05 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:03:05 user nova-compute[74611]:   </cpu>
Nov 13 10:03:05 user nova-compute[74611]:   <devices>
Nov 13 10:03:05 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:03:05 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:03:05 user nova-compute[74611]:       <source dev="/dev/sdd"/>
Nov 13 10:03:05 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:03:05 user nova-compute[74611]:       <serial>187e682d-b203-4996-8b12-6a3d1c4447fd</serial>
Nov 13 10:03:05 user nova-compute[74611]:     </disk>
Nov 13 10:03:05 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:03:05 user nova-compute[74611]:       <mac address="fa:16:3e:10:8c:53"/>
Nov 13 10:03:05 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:03:05 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:03:05 user nova-compute[74611]:       <target dev="tap605834a6-1d"/>
Nov 13 10:03:05 user nova-compute[74611]:     </interface>
Nov 13 10:03:05 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:03:05 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/16e43d20-bcae-4813-9e4b-55099e23d370/console.log" append="off"/>
Nov 13 10:03:05 user nova-compute[74611]:     </serial>
Nov 13 10:03:05 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:03:05 user nova-compute[74611]:     <video>
Nov 13 10:03:05 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:03:05 user nova-compute[74611]:     </video>
Nov 13 10:03:05 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:03:05 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:03:05 user nova-compute[74611]:     </rng>
Nov 13 10:03:05 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:03:05 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:03:05 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:03:05 user nova-compute[74611]:     </memballoon>
Nov 13 10:03:05 user nova-compute[74611]:   </devices>
Nov 13 10:03:05 user nova-compute[74611]: </domain>
Nov 13 10:03:05 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-950576607',display_name='tempest-TestVolumeBootPattern-server-950576607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-950576607',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjRXcM+iAZvLJco7tBubak1kGHq/45jJ2KKO6E3tr61cFQKM/YqE/xURoOe/LdnL01vr4FH+cPhy0FHq1+WQre34a6xvIem5nHqznPEd2v959ht3Wgct9dv/En52XotjA==',key_name='tempest-TestVolumeBootPattern-1763350711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-ktdojwi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:03:00Z,user_data=None,user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=16e43d20-bcae-4813-9e4b-55099e23d370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "605834a6-1df6-4bb7-b277-461f53392466", "address": "fa:16:3e:10:8c:53", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605834a6-1d", "ovs_interfaceid": "605834a6-1df6-4bb7-b277-461f53392466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "605834a6-1df6-4bb7-b277-461f53392466", "address": "fa:16:3e:10:8c:53", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605834a6-1d", "ovs_interfaceid": "605834a6-1df6-4bb7-b277-461f53392466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:8c:53,bridge_name='br-int',has_traffic_filtering=True,id=605834a6-1df6-4bb7-b277-461f53392466,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605834a6-1d') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG os_vif [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:8c:53,bridge_name='br-int',has_traffic_filtering=True,id=605834a6-1df6-4bb7-b277-461f53392466,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605834a6-1d') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '357a0033-93e8-523e-89f8-8c9cc6f85696', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap605834a6-1d, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap605834a6-1d, col_values=(('qos', UUID('86196f13-4f58-4962-80ec-b176a74bc627')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap605834a6-1d, col_values=(('external_ids', {'iface-id': '605834a6-1df6-4bb7-b277-461f53392466', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:8c:53', 'vm-uuid': '16e43d20-bcae-4813-9e4b-55099e23d370'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:05 user nova-compute[74611]: INFO os_vif [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:8c:53,bridge_name='br-int',has_traffic_filtering=True,id=605834a6-1df6-4bb7-b277-461f53392466,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605834a6-1d')
Nov 13 10:03:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:03:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] No VIF found with MAC fa:16:3e:10:8c:53, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:03:06 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Snapshot image upload complete
Nov 13 10:03:06 user nova-compute[74611]: DEBUG nova.compute.manager [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:03:06 user nova-compute[74611]: INFO nova.compute.manager [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Shelve offloading
Nov 13 10:03:06 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Instance destroyed successfully.
Nov 13 10:03:06 user nova-compute[74611]: DEBUG nova.compute.manager [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:03:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:03:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquired lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:03:06 user nova-compute[74611]: DEBUG nova.network.neutron [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:03:06 user nova-compute[74611]: DEBUG nova.network.neutron [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Updating instance_info_cache with network_info: [{"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:03:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Releasing lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:07 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Instance destroyed successfully.
Nov 13 10:03:07 user nova-compute[74611]: DEBUG nova.objects.instance [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'resources' on Instance uuid 261e3e34-7a30-42f5-ae31-c3d3a76d0d67 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:01:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-524802819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-524802819',id=27,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRrlMzFCuFCjqjYKCH+sueVQQbVqfjjNW/9j7fYfIOLB3UnjpV/tuyjC6WhmLe9LgwBS7VJ9bdKHTWsQ3e9xHMYL0Gm98yNrPr+71s8aupumxioGndh4CUCrqKGTpqA2w==',key_name='tempest-keypair-399446396',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d5a6f570a7e7404680bd5809be8b0378',ramdisk_id='',reservation_id='r-fk8bipxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-55203260',owner_user_name='tempest-AttachVolumeShelveTestJSON-55203260-project-member',shelved_at='2023-11-13T10:03:06.049626',shelved_host='user',shelved_image_id='170174c7-22d7-4d47-b4ca-83186bf8fe3c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:03:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008616dff48b4bdeb2ea0f2be72a2934',uuid=261e3e34-7a30-42f5-ae31-c3d3a76d0d67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converting VIF {"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9c:83,bridge_name='br-int',has_traffic_filtering=True,id=a2a9d4c3-0ad3-48b0-a588-65a18320392a,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a9d4c3-0a') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG os_vif [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9c:83,bridge_name='br-int',has_traffic_filtering=True,id=a2a9d4c3-0ad3-48b0-a588-65a18320392a,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a9d4c3-0a') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2a9d4c3-0a, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-e49f8301-8cdd-4b10-886e-e54a6b790016 req-4272c890-af57-4177-b745-8c7de1fb3fe8 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received event network-changed-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-e49f8301-8cdd-4b10-886e-e54a6b790016 req-4272c890-af57-4177-b745-8c7de1fb3fe8 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Refreshing instance network info cache due to event network-changed-a2a9d4c3-0ad3-48b0-a588-65a18320392a. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e49f8301-8cdd-4b10-886e-e54a6b790016 req-4272c890-af57-4177-b745-8c7de1fb3fe8 service nova] Acquiring lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e49f8301-8cdd-4b10-886e-e54a6b790016 req-4272c890-af57-4177-b745-8c7de1fb3fe8 service nova] Acquired lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG nova.network.neutron [req-e49f8301-8cdd-4b10-886e-e54a6b790016 req-4272c890-af57-4177-b745-8c7de1fb3fe8 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Refreshing network info cache for port a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d9f347e-4356-47fd-92b2-931cdcdcecf8) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:03:07 user nova-compute[74611]: INFO os_vif [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9c:83,bridge_name='br-int',has_traffic_filtering=True,id=a2a9d4c3-0ad3-48b0-a588-65a18320392a,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a9d4c3-0a')
Nov 13 10:03:07 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Deleting instance files /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67_del
Nov 13 10:03:07 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Deletion of /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67_del complete
Nov 13 10:03:07 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Deleted allocations for instance 261e3e34-7a30-42f5-ae31-c3d3a76d0d67
Nov 13 10:03:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-dab8a736-355a-42c5-a3c9-757ddc58741f req-2941dcb1-aa9b-4e61-91db-42581d1648ec service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Received event network-vif-plugged-605834a6-1df6-4bb7-b277-461f53392466 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dab8a736-355a-42c5-a3c9-757ddc58741f req-2941dcb1-aa9b-4e61-91db-42581d1648ec service nova] Acquiring lock "16e43d20-bcae-4813-9e4b-55099e23d370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dab8a736-355a-42c5-a3c9-757ddc58741f req-2941dcb1-aa9b-4e61-91db-42581d1648ec service nova] Lock "16e43d20-bcae-4813-9e4b-55099e23d370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dab8a736-355a-42c5-a3c9-757ddc58741f req-2941dcb1-aa9b-4e61-91db-42581d1648ec service nova] Lock "16e43d20-bcae-4813-9e4b-55099e23d370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-dab8a736-355a-42c5-a3c9-757ddc58741f req-2941dcb1-aa9b-4e61-91db-42581d1648ec service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] No waiting events found dispatching network-vif-plugged-605834a6-1df6-4bb7-b277-461f53392466 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:03:07 user nova-compute[74611]: WARNING nova.compute.manager [req-dab8a736-355a-42c5-a3c9-757ddc58741f req-2941dcb1-aa9b-4e61-91db-42581d1648ec service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Received unexpected event network-vif-plugged-605834a6-1df6-4bb7-b277-461f53392466 for instance with vm_state building and task_state spawning.
Nov 13 10:03:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG nova.objects.instance [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'numa_topology' on Instance uuid 261e3e34-7a30-42f5-ae31-c3d3a76d0d67 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG nova.objects.base [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Object Instance<261e3e34-7a30-42f5-ae31-c3d3a76d0d67> lazy-loaded attributes: resources,numa_topology {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:03:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.488s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-51b9014d-2d62-432a-8d8b-5c61b7ef06a0 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.286s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:08 user nova-compute[74611]: DEBUG nova.network.neutron [req-e49f8301-8cdd-4b10-886e-e54a6b790016 req-4272c890-af57-4177-b745-8c7de1fb3fe8 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Updated VIF entry in instance network info cache for port a2a9d4c3-0ad3-48b0-a588-65a18320392a. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:03:08 user nova-compute[74611]: DEBUG nova.network.neutron [req-e49f8301-8cdd-4b10-886e-e54a6b790016 req-4272c890-af57-4177-b745-8c7de1fb3fe8 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Updating instance_info_cache with network_info: [{"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:03:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e49f8301-8cdd-4b10-886e-e54a6b790016 req-4272c890-af57-4177-b745-8c7de1fb3fe8 service nova] Releasing lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:03:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:09 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:03:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:03:09 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Instance spawned successfully.
Nov 13 10:03:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:03:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:03:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:03:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:03:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:03:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:03:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:03:09 user nova-compute[74611]: INFO nova.compute.manager [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 13 10:03:09 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:03:09 user nova-compute[74611]: INFO nova.compute.manager [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Took 10.71 seconds to build instance.
Nov 13 10:03:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd440641-c82f-4434-916a-c8b44d12501d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "16e43d20-bcae-4813-9e4b-55099e23d370" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.820s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:09 user nova-compute[74611]: DEBUG nova.compute.manager [req-c34a5df8-407d-443f-a3b8-caba0c018a29 req-6d0b39df-b78d-4ba0-9308-e4622a3eecc7 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Received event network-vif-plugged-605834a6-1df6-4bb7-b277-461f53392466 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:03:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c34a5df8-407d-443f-a3b8-caba0c018a29 req-6d0b39df-b78d-4ba0-9308-e4622a3eecc7 service nova] Acquiring lock "16e43d20-bcae-4813-9e4b-55099e23d370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c34a5df8-407d-443f-a3b8-caba0c018a29 req-6d0b39df-b78d-4ba0-9308-e4622a3eecc7 service nova] Lock "16e43d20-bcae-4813-9e4b-55099e23d370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c34a5df8-407d-443f-a3b8-caba0c018a29 req-6d0b39df-b78d-4ba0-9308-e4622a3eecc7 service nova] Lock "16e43d20-bcae-4813-9e4b-55099e23d370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:09 user nova-compute[74611]: DEBUG nova.compute.manager [req-c34a5df8-407d-443f-a3b8-caba0c018a29 req-6d0b39df-b78d-4ba0-9308-e4622a3eecc7 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] No waiting events found dispatching network-vif-plugged-605834a6-1df6-4bb7-b277-461f53392466 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:03:09 user nova-compute[74611]: WARNING nova.compute.manager [req-c34a5df8-407d-443f-a3b8-caba0c018a29 req-6d0b39df-b78d-4ba0-9308-e4622a3eecc7 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Received unexpected event network-vif-plugged-605834a6-1df6-4bb7-b277-461f53392466 for instance with vm_state active and task_state None.
Nov 13 10:03:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "23495073-10b7-4552-ad61-16fdf410956b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "23495073-10b7-4552-ad61-16fdf410956b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "23495073-10b7-4552-ad61-16fdf410956b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "23495073-10b7-4552-ad61-16fdf410956b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "23495073-10b7-4552-ad61-16fdf410956b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:11 user nova-compute[74611]: INFO nova.compute.manager [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Terminating instance
Nov 13 10:03:11 user nova-compute[74611]: DEBUG nova.compute.manager [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-89797037-50c1-4f59-b04f-db8d433d0ecb req-1281fc58-1a94-4446-93a3-6b9cf98f84df service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Received event network-vif-unplugged-cc222aae-de55-44ac-be3c-38b357e4c811 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-89797037-50c1-4f59-b04f-db8d433d0ecb req-1281fc58-1a94-4446-93a3-6b9cf98f84df service nova] Acquiring lock "23495073-10b7-4552-ad61-16fdf410956b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-89797037-50c1-4f59-b04f-db8d433d0ecb req-1281fc58-1a94-4446-93a3-6b9cf98f84df service nova] Lock "23495073-10b7-4552-ad61-16fdf410956b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-89797037-50c1-4f59-b04f-db8d433d0ecb req-1281fc58-1a94-4446-93a3-6b9cf98f84df service nova] Lock "23495073-10b7-4552-ad61-16fdf410956b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-89797037-50c1-4f59-b04f-db8d433d0ecb req-1281fc58-1a94-4446-93a3-6b9cf98f84df service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] No waiting events found dispatching network-vif-unplugged-cc222aae-de55-44ac-be3c-38b357e4c811 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-89797037-50c1-4f59-b04f-db8d433d0ecb req-1281fc58-1a94-4446-93a3-6b9cf98f84df service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Received event network-vif-unplugged-cc222aae-de55-44ac-be3c-38b357e4c811 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:03:12 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Instance destroyed successfully.
Nov 13 10:03:12 user nova-compute[74611]: DEBUG nova.objects.instance [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'resources' on Instance uuid 23495073-10b7-4552-ad61-16fdf410956b {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1594226373',display_name='tempest-AttachVolumeNegativeTest-server-1594226373',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1594226373',id=25,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZPQk0MTmTuMo6ZDGI7e1+m8rmvipmL5Wo9gydeghixMTXlxDwR44lh+flgDoj9nx6NiluTf+5F1FmwhG84lcEdODV37F+bPUe+W3g3tZlg98smjVBGYJeBsmBsrpskxw==',key_name='tempest-keypair-2145589996',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:00:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1384599c1e484e54ae29b024377dbd04',ramdisk_id='',reservation_id='r-vcsghs1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1307038303',owner_user_name='tempest-AttachVolumeNegativeTest-1307038303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d93cfc3fb54b41ceb9f9657de0059043',uuid=23495073-10b7-4552-ad61-16fdf410956b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc222aae-de55-44ac-be3c-38b357e4c811", "address": "fa:16:3e:56:8b:98", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc222aae-de", "ovs_interfaceid": "cc222aae-de55-44ac-be3c-38b357e4c811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converting VIF {"id": "cc222aae-de55-44ac-be3c-38b357e4c811", "address": "fa:16:3e:56:8b:98", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc222aae-de", "ovs_interfaceid": "cc222aae-de55-44ac-be3c-38b357e4c811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:8b:98,bridge_name='br-int',has_traffic_filtering=True,id=cc222aae-de55-44ac-be3c-38b357e4c811,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc222aae-de') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG os_vif [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:8b:98,bridge_name='br-int',has_traffic_filtering=True,id=cc222aae-de55-44ac-be3c-38b357e4c811,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc222aae-de') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc222aae-de, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f90bbc5b-ab6e-4a9f-b61b-cf0e0fa76ce2) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:03:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:03:13 user nova-compute[74611]: INFO os_vif [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:8b:98,bridge_name='br-int',has_traffic_filtering=True,id=cc222aae-de55-44ac-be3c-38b357e4c811,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc222aae-de')
Nov 13 10:03:13 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Deleting instance files /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b_del
Nov 13 10:03:13 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Deletion of /opt/stack/data/nova/instances/23495073-10b7-4552-ad61-16fdf410956b_del complete
Nov 13 10:03:13 user nova-compute[74611]: INFO nova.compute.manager [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 13 10:03:13 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:03:13 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:03:13 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 23495073-10b7-4552-ad61-16fdf410956b] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:03:13 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:03:13 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Took 0.72 seconds to deallocate network for instance.
Nov 13 10:03:13 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1ebd2c7-2997-4058-b573-7538f9f16af0 req-2f4f6f10-8d50-4674-a25d-5c6ec299e007 service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Received event network-vif-deleted-cc222aae-de55-44ac-be3c-38b357e4c811 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:03:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:14 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:03:14 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:03:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.515s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:14 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Deleted allocations for instance 23495073-10b7-4552-ad61-16fdf410956b
Nov 13 10:03:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73b3ef54-d031-4897-81fb-54108a9d8d2d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "23495073-10b7-4552-ad61-16fdf410956b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.648s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-b6610c01-f7d3-4911-8442-c25300bb25be req-58ed468a-5ba5-40ff-a7fb-af91b2238d3b service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Received event network-vif-plugged-cc222aae-de55-44ac-be3c-38b357e4c811 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:03:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b6610c01-f7d3-4911-8442-c25300bb25be req-58ed468a-5ba5-40ff-a7fb-af91b2238d3b service nova] Acquiring lock "23495073-10b7-4552-ad61-16fdf410956b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b6610c01-f7d3-4911-8442-c25300bb25be req-58ed468a-5ba5-40ff-a7fb-af91b2238d3b service nova] Lock "23495073-10b7-4552-ad61-16fdf410956b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b6610c01-f7d3-4911-8442-c25300bb25be req-58ed468a-5ba5-40ff-a7fb-af91b2238d3b service nova] Lock "23495073-10b7-4552-ad61-16fdf410956b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-b6610c01-f7d3-4911-8442-c25300bb25be req-58ed468a-5ba5-40ff-a7fb-af91b2238d3b service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] No waiting events found dispatching network-vif-plugged-cc222aae-de55-44ac-be3c-38b357e4c811 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:03:14 user nova-compute[74611]: WARNING nova.compute.manager [req-b6610c01-f7d3-4911-8442-c25300bb25be req-58ed468a-5ba5-40ff-a7fb-af91b2238d3b service nova] [instance: 23495073-10b7-4552-ad61-16fdf410956b] Received unexpected event network-vif-plugged-cc222aae-de55-44ac-be3c-38b357e4c811 for instance with vm_state deleted and task_state None.
Nov 13 10:03:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:31 user nova-compute[74611]: INFO nova.compute.manager [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Terminating instance
Nov 13 10:03:31 user nova-compute[74611]: DEBUG nova.compute.manager [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:03:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:31 user nova-compute[74611]: DEBUG nova.compute.manager [req-85d3cc9b-7229-4811-a70f-155163a0184c req-0c45039d-c506-41ee-b8a5-274d391f357c service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Received event network-vif-unplugged-c33be124-9528-4fb1-8fbe-9fc2d55395b8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:03:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-85d3cc9b-7229-4811-a70f-155163a0184c req-0c45039d-c506-41ee-b8a5-274d391f357c service nova] Acquiring lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-85d3cc9b-7229-4811-a70f-155163a0184c req-0c45039d-c506-41ee-b8a5-274d391f357c service nova] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-85d3cc9b-7229-4811-a70f-155163a0184c req-0c45039d-c506-41ee-b8a5-274d391f357c service nova] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:31 user nova-compute[74611]: DEBUG nova.compute.manager [req-85d3cc9b-7229-4811-a70f-155163a0184c req-0c45039d-c506-41ee-b8a5-274d391f357c service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] No waiting events found dispatching network-vif-unplugged-c33be124-9528-4fb1-8fbe-9fc2d55395b8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:03:31 user nova-compute[74611]: DEBUG nova.compute.manager [req-85d3cc9b-7229-4811-a70f-155163a0184c req-0c45039d-c506-41ee-b8a5-274d391f357c service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Received event network-vif-unplugged-c33be124-9528-4fb1-8fbe-9fc2d55395b8 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:03:32 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Instance destroyed successfully.
Nov 13 10:03:32 user nova-compute[74611]: DEBUG nova.objects.instance [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lazy-loading 'resources' on Instance uuid 4970bd6b-69a6-479c-9f5f-bc5fc6021407 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:03:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1064435824',display_name='tempest-VolumesAdminNegativeTest-server-1064435824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1064435824',id=19,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERbTG75IHOHsbkK8+ChCk3hnM5YeJ4mAge3LhNvqiP5N4F0Yom72WbhHksKeP+/lM+Ukru81fapV4keR2CmUiUewqe2hZCEgMrEcgj/8zjvCJCQzpyJtPULGpGauMkehg==',key_name='tempest-keypair-279808170',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:58:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ca1b2857119419e8d4cd65f6d77d9ba',ramdisk_id='',reservation_id='r-x110vuf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1382146762',owner_user_name='tempest-VolumesAdminNegativeTest-1382146762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:58:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3227fb32ab644865880e5354d1306941',uuid=4970bd6b-69a6-479c-9f5f-bc5fc6021407,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "address": "fa:16:3e:29:ae:2e", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33be124-95", "ovs_interfaceid": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:03:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Converting VIF {"id": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "address": "fa:16:3e:29:ae:2e", "network": {"id": "ca1cd594-c2c0-41e4-92dc-f828ce2b5423", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1795647108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ca1b2857119419e8d4cd65f6d77d9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33be124-95", "ovs_interfaceid": "c33be124-9528-4fb1-8fbe-9fc2d55395b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:03:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:ae:2e,bridge_name='br-int',has_traffic_filtering=True,id=c33be124-9528-4fb1-8fbe-9fc2d55395b8,network=Network(ca1cd594-c2c0-41e4-92dc-f828ce2b5423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33be124-95') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:03:32 user nova-compute[74611]: DEBUG os_vif [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:ae:2e,bridge_name='br-int',has_traffic_filtering=True,id=c33be124-9528-4fb1-8fbe-9fc2d55395b8,network=Network(ca1cd594-c2c0-41e4-92dc-f828ce2b5423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33be124-95') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:03:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc33be124-95, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:03:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:03:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec12e01a-da46-4ad6-a87a-c223851c8ffa) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:03:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:03:32 user nova-compute[74611]: INFO os_vif [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:ae:2e,bridge_name='br-int',has_traffic_filtering=True,id=c33be124-9528-4fb1-8fbe-9fc2d55395b8,network=Network(ca1cd594-c2c0-41e4-92dc-f828ce2b5423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33be124-95')
Nov 13 10:03:32 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Deleting instance files /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407_del
Nov 13 10:03:32 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Deletion of /opt/stack/data/nova/instances/4970bd6b-69a6-479c-9f5f-bc5fc6021407_del complete
Nov 13 10:03:32 user nova-compute[74611]: INFO nova.compute.manager [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 10:03:32 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:03:32 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:03:32 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:03:33 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:03:33 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Took 0.86 seconds to deallocate network for instance.
Nov 13 10:03:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-39e428d4-88ff-4264-8973-954a5ceeab69 req-69b3372f-80e1-4f43-b853-cccc1faea39d service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Received event network-vif-deleted-c33be124-9528-4fb1-8fbe-9fc2d55395b8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:03:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:33 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:03:33 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:03:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:33 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Deleted allocations for instance 4970bd6b-69a6-479c-9f5f-bc5fc6021407
Nov 13 10:03:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-15f7d8f9-0093-40a4-8052-9ae08376b445 tempest-VolumesAdminNegativeTest-1382146762 tempest-VolumesAdminNegativeTest-1382146762-project-member] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.375s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-349347d1-f1dd-4daa-94a3-71f346c561a0 req-0f1a3a9c-869c-4749-bd9f-437771513c87 service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Received event network-vif-plugged-c33be124-9528-4fb1-8fbe-9fc2d55395b8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:03:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-349347d1-f1dd-4daa-94a3-71f346c561a0 req-0f1a3a9c-869c-4749-bd9f-437771513c87 service nova] Acquiring lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-349347d1-f1dd-4daa-94a3-71f346c561a0 req-0f1a3a9c-869c-4749-bd9f-437771513c87 service nova] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-349347d1-f1dd-4daa-94a3-71f346c561a0 req-0f1a3a9c-869c-4749-bd9f-437771513c87 service nova] Lock "4970bd6b-69a6-479c-9f5f-bc5fc6021407-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-349347d1-f1dd-4daa-94a3-71f346c561a0 req-0f1a3a9c-869c-4749-bd9f-437771513c87 service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] No waiting events found dispatching network-vif-plugged-c33be124-9528-4fb1-8fbe-9fc2d55395b8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:03:33 user nova-compute[74611]: WARNING nova.compute.manager [req-349347d1-f1dd-4daa-94a3-71f346c561a0 req-0f1a3a9c-869c-4749-bd9f-437771513c87 service nova] [instance: 4970bd6b-69a6-479c-9f5f-bc5fc6021407] Received unexpected event network-vif-plugged-c33be124-9528-4fb1-8fbe-9fc2d55395b8 for instance with vm_state deleted and task_state None.
Nov 13 10:03:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:35 user nova-compute[74611]: INFO nova.compute.manager [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Detaching volume 921d5d4b-260c-4d54-80c6-24610845e425
Nov 13 10:03:35 user nova-compute[74611]: INFO nova.virt.block_device [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Attempting to driver detach volume 921d5d4b-260c-4d54-80c6-24610845e425 from mountpoint /dev/vdb
Nov 13 10:03:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Attempting to detach device vdb from instance e99e1557-500f-407e-aefc-3b5cde9ceba0 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:03:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:03:35 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:03:35 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:03:35 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:03:35 user nova-compute[74611]:   <serial>921d5d4b-260c-4d54-80c6-24610845e425</serial>
Nov 13 10:03:35 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 10:03:35 user nova-compute[74611]: </disk>
Nov 13 10:03:35 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:03:35 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Successfully detached device vdb from instance e99e1557-500f-407e-aefc-3b5cde9ceba0 from the persistent domain config.
Nov 13 10:03:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e99e1557-500f-407e-aefc-3b5cde9ceba0 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:03:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:03:35 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:03:35 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:03:35 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:03:35 user nova-compute[74611]:   <serial>921d5d4b-260c-4d54-80c6-24610845e425</serial>
Nov 13 10:03:35 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 10:03:35 user nova-compute[74611]: </disk>
Nov 13 10:03:35 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:03:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:03:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:39 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:03:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:03:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:03:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:03:39 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:03:39 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Updating instance_info_cache with network_info: [{"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:03:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:03:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:03:41 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:03:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:43 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:03:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:44 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:03:44 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:03:44 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:03:45 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:03:46 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:03:46 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:03:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:46 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:03:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:03:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:03:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:03:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:50 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:03:50 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:03:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=7245MB free_disk=25.22797393798828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Applying migration context for instance 635636ea-96a0-4fdb-85a1-ca7a87b762f0 as it has an incoming, in-progress migration 4853187a-b106-42a3-9133-dece359c134e. Migration status is finished {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 10:03:50 user nova-compute[74611]: INFO nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updating resource usage from migration 4853187a-b106-42a3-9133-dece359c134e
Nov 13 10:03:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 85cb3adb-b2b3-49ec-92ab-c2b7a028241a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance e99e1557-500f-407e-aefc-3b5cde9ceba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4fa9e23b-30f2-41ae-83ed-86145389d474 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Migration 4853187a-b106-42a3-9133-dece359c134e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 635636ea-96a0-4fdb-85a1-ca7a87b762f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7eff589b-8f0f-4e6e-ac04-567da455e579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 16e43d20-bcae-4813-9e4b-55099e23d370 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:03:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:03:51 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:03:51 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:03:51 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:03:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:52 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:03:52 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:03:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:55 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e99e1557-500f-407e-aefc-3b5cde9ceba0 is timed out.
Nov 13 10:03:55 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Successfully detached device vdb from instance e99e1557-500f-407e-aefc-3b5cde9ceba0 from the live domain config.
Nov 13 10:03:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:03:55 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtITMiZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:03:55 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:03:55 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:03:55 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:03:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:55 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3050b58-5bd7-43ae-8740-1dbd6cc54ae9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:03:56 user nova-compute[74611]: No targets found.
Nov 13 10:03:56 user nova-compute[74611]: iSNS:
Nov 13 10:03:56 user nova-compute[74611]: No targets found.
Nov 13 10:03:56 user nova-compute[74611]: STATIC:
Nov 13 10:03:56 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f
Nov 13 10:03:56 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:03:56 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:03:56 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425
Nov 13 10:03:56 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:03:56 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:03:56 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd
Nov 13 10:03:56 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:03:56 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:03:56 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:03:56 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:03:56 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:03:56 user nova-compute[74611]: FIRMWARE:
Nov 13 10:03:56 user nova-compute[74611]: No targets found.
Nov 13 10:03:56 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:03:56 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:03:56 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[336a9f0e-e861-40b1-9ed3-bc6bb68c0349]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7181d48-0358-4081-9e91-f530d8a85600]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:03:56 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:03:56 user nova-compute[74611]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:03:56 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:03:56 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:03:56 user nova-compute[74611]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 (non-flash)
Nov 13 10:03:56 user nova-compute[74611]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:03:56 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:03:56 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8c24a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51a6586-8b82-494d-b09b-c1c17dfc848e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5960c1-d81e-47b1-9cc0-b9f8faffd24b]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f77b483-8fb7-45ba-b0d5-7972b2b302b3]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fb56da-3219-42ad-8b37-e758cc558e0d]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4374be37-b360-4711-8744-78b04a2fe6af]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2df6d26-24e6-4e2f-bbc1-0050108a81bc]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425, portal: 172.16.0.220,3260]
Nov 13 10:03:56 user nova-compute[74611]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425, portal: 172.16.0.220,3260] successful.
Nov 13 10:03:56 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921d5d4b-260c-4d54-80c6-24610845e425 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c9b254-e7c6-4fcf-a3a1-b2da5684bae0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] <== disconnect_volume: return (299ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:03:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:57 user nova-compute[74611]: DEBUG nova.objects.instance [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'flavor' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:03:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c7959577-7062-43bb-8a44-436578fc5020 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.852s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ba68102-56c2-4569-9dfb-2ceaef2ddbb9 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ba68102-56c2-4569-9dfb-2ceaef2ddbb9 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:57 user nova-compute[74611]: DEBUG nova.compute.manager [None req-3ba68102-56c2-4569-9dfb-2ceaef2ddbb9 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:03:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:57 user nova-compute[74611]: DEBUG nova.compute.manager [None req-3ba68102-56c2-4569-9dfb-2ceaef2ddbb9 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74611) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 13 10:03:57 user nova-compute[74611]: DEBUG nova.objects.instance [None req-3ba68102-56c2-4569-9dfb-2ceaef2ddbb9 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'flavor' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:03:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:03:58 user nova-compute[74611]: DEBUG nova.compute.manager [req-f7ce8615-4ae4-4dd6-b48b-5ba713362ab9 req-506aec3e-bf39-410b-9f8d-d2a4e4e7bc7c service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received event network-vif-unplugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:03:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f7ce8615-4ae4-4dd6-b48b-5ba713362ab9 req-506aec3e-bf39-410b-9f8d-d2a4e4e7bc7c service nova] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:03:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f7ce8615-4ae4-4dd6-b48b-5ba713362ab9 req-506aec3e-bf39-410b-9f8d-d2a4e4e7bc7c service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:03:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f7ce8615-4ae4-4dd6-b48b-5ba713362ab9 req-506aec3e-bf39-410b-9f8d-d2a4e4e7bc7c service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:58 user nova-compute[74611]: DEBUG nova.compute.manager [req-f7ce8615-4ae4-4dd6-b48b-5ba713362ab9 req-506aec3e-bf39-410b-9f8d-d2a4e4e7bc7c service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] No waiting events found dispatching network-vif-unplugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:03:58 user nova-compute[74611]: WARNING nova.compute.manager [req-f7ce8615-4ae4-4dd6-b48b-5ba713362ab9 req-506aec3e-bf39-410b-9f8d-d2a4e4e7bc7c service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received unexpected event network-vif-unplugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b for instance with vm_state active and task_state powering-off.
Nov 13 10:03:58 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Instance destroyed successfully.
Nov 13 10:03:58 user nova-compute[74611]: DEBUG nova.compute.manager [None req-3ba68102-56c2-4569-9dfb-2ceaef2ddbb9 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:03:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ba68102-56c2-4569-9dfb-2ceaef2ddbb9 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.843s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:03:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:00 user nova-compute[74611]: DEBUG nova.compute.manager [req-a9c2fc90-1e20-48d2-96d1-7369fc1541fd req-b2b51b72-1894-4683-a027-399fa2bcfc46 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a9c2fc90-1e20-48d2-96d1-7369fc1541fd req-b2b51b72-1894-4683-a027-399fa2bcfc46 service nova] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a9c2fc90-1e20-48d2-96d1-7369fc1541fd req-b2b51b72-1894-4683-a027-399fa2bcfc46 service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a9c2fc90-1e20-48d2-96d1-7369fc1541fd req-b2b51b72-1894-4683-a027-399fa2bcfc46 service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:00 user nova-compute[74611]: DEBUG nova.compute.manager [req-a9c2fc90-1e20-48d2-96d1-7369fc1541fd req-b2b51b72-1894-4683-a027-399fa2bcfc46 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] No waiting events found dispatching network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:00 user nova-compute[74611]: WARNING nova.compute.manager [req-a9c2fc90-1e20-48d2-96d1-7369fc1541fd req-b2b51b72-1894-4683-a027-399fa2bcfc46 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received unexpected event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b for instance with vm_state stopped and task_state None.
Nov 13 10:04:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Acquiring lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:00 user nova-compute[74611]: DEBUG nova.compute.manager [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:04:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:00 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:04:00 user nova-compute[74611]: INFO nova.compute.claims [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Claim successful on node user
Nov 13 10:04:01 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG nova.compute.manager [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG nova.compute.manager [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG nova.network.neutron [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:04:01 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:04:01 user nova-compute[74611]: DEBUG nova.compute.manager [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG nova.policy [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '690f5c2eb45b4704aa7e1faf9927173a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c95f07c1a7a432ba2c8ed8aaa12604f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG nova.compute.manager [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:04:01 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Creating image(s)
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "/opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "/opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG nova.objects.instance [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'flavor' on Instance uuid 4fa9e23b-30f2-41ae-83ed-86145389d474 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:01 user nova-compute[74611]: INFO nova.compute.manager [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Attaching volume 6e42a395-a96a-419b-8acf-a49518f1ed1d to /dev/vdb
Nov 13 10:04:01 user nova-compute[74611]: DEBUG os_brick.utils [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[76539815-d0e3-43de-9bc4-c7e58c4df341]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.190s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[05700fc4-2731-4a69-9be9-da10f03ca659]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk 1073741824" returned: 0 in 0.056s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[961af1a0-6cfc-4400-a891-21316a4ab34b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b70dd4d-f00b-4d0d-980a-0d9388e827b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:04:01 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[57208d22-602d-42ce-b16c-9cd382fbc93a]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG os_brick.utils [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] <== get_connector_properties: return (207ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Updating existing volume attachment record: e60c9af5-b5f9-4266-84ca-eed2f3bf357f {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG nova.network.neutron [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Successfully created port: 69d461bc-84ce-46b4-949d-6d54d9a4454c {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:04:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Cannot resize image /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Ensure instance console log exists: /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-d85859a5-59ab-4e41-88af-aec249113e58 req-b429fe5b-a130-4cbc-8732-d06ba10a5037 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-changed-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-d85859a5-59ab-4e41-88af-aec249113e58 req-b429fe5b-a130-4cbc-8732-d06ba10a5037 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Refreshing instance network info cache due to event network-changed-ffb1eb13-f028-447f-a01d-45bae2d17edd. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d85859a5-59ab-4e41-88af-aec249113e58 req-b429fe5b-a130-4cbc-8732-d06ba10a5037 service nova] Acquiring lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d85859a5-59ab-4e41-88af-aec249113e58 req-b429fe5b-a130-4cbc-8732-d06ba10a5037 service nova] Acquired lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG nova.network.neutron [req-d85859a5-59ab-4e41-88af-aec249113e58 req-b429fe5b-a130-4cbc-8732-d06ba10a5037 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Refreshing network info cache for port ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG nova.network.neutron [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Successfully updated port: 69d461bc-84ce-46b4-949d-6d54d9a4454c {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Acquiring lock "refresh_cache-d3c21984-13a9-422c-b9e7-f9ca79b62d81" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Acquired lock "refresh_cache-d3c21984-13a9-422c-b9e7-f9ca79b62d81" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG nova.network.neutron [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG nova.network.neutron [req-d85859a5-59ab-4e41-88af-aec249113e58 req-b429fe5b-a130-4cbc-8732-d06ba10a5037 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Updated VIF entry in instance network info cache for port ffb1eb13-f028-447f-a01d-45bae2d17edd. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG nova.network.neutron [req-d85859a5-59ab-4e41-88af-aec249113e58 req-b429fe5b-a130-4cbc-8732-d06ba10a5037 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Updating instance_info_cache with network_info: [{"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG nova.network.neutron [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-f5e815ef-cab9-4656-a883-660eb25b13de req-601c7d70-03df-4830-afcb-92acb9fcb1fe service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Received event network-changed-69d461bc-84ce-46b4-949d-6d54d9a4454c {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-f5e815ef-cab9-4656-a883-660eb25b13de req-601c7d70-03df-4830-afcb-92acb9fcb1fe service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Refreshing instance network info cache due to event network-changed-69d461bc-84ce-46b4-949d-6d54d9a4454c. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f5e815ef-cab9-4656-a883-660eb25b13de req-601c7d70-03df-4830-afcb-92acb9fcb1fe service nova] Acquiring lock "refresh_cache-d3c21984-13a9-422c-b9e7-f9ca79b62d81" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:04:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d85859a5-59ab-4e41-88af-aec249113e58 req-b429fe5b-a130-4cbc-8732-d06ba10a5037 service nova] Releasing lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.network.neutron [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Updating instance_info_cache with network_info: [{"id": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "address": "fa:16:3e:85:87:60", "network": {"id": "329a000f-5d8c-46fe-943f-3e8a7b854140", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392102660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c95f07c1a7a432ba2c8ed8aaa12604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d461bc-84", "ovs_interfaceid": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Releasing lock "refresh_cache-d3c21984-13a9-422c-b9e7-f9ca79b62d81" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.compute.manager [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Instance network_info: |[{"id": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "address": "fa:16:3e:85:87:60", "network": {"id": "329a000f-5d8c-46fe-943f-3e8a7b854140", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392102660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c95f07c1a7a432ba2c8ed8aaa12604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d461bc-84", "ovs_interfaceid": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f5e815ef-cab9-4656-a883-660eb25b13de req-601c7d70-03df-4830-afcb-92acb9fcb1fe service nova] Acquired lock "refresh_cache-d3c21984-13a9-422c-b9e7-f9ca79b62d81" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.network.neutron [req-f5e815ef-cab9-4656-a883-660eb25b13de req-601c7d70-03df-4830-afcb-92acb9fcb1fe service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Refreshing network info cache for port 69d461bc-84ce-46b4-949d-6d54d9a4454c {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Start _get_guest_xml network_info=[{"id": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "address": "fa:16:3e:85:87:60", "network": {"id": "329a000f-5d8c-46fe-943f-3e8a7b854140", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392102660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c95f07c1a7a432ba2c8ed8aaa12604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d461bc-84", "ovs_interfaceid": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:04:03 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:04:03 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-288261506',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-288261506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2882615',id=32,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGX90AONFZNWuKQy6iHfVSSck3PWOZgqhIYct3cEpZHZBe0WXxg+jfiwjJuUHrrvB0S+XFoZOl/Lkw/WnS6DAm4bUJUhHgpcDMbvJ0HqpJhZgJrehnGrdcC2GGfHiq983g==',key_name='tempest-keypair-645812607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c95f07c1a7a432ba2c8ed8aaa12604f',ramdisk_id='',reservation_id='r-4qxdgqlj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1504114640',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:04:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='690f5c2eb45b4704aa7e1faf9927173a',uuid=d3c21984-13a9-422c-b9e7-f9ca79b62d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "address": "fa:16:3e:85:87:60", "network": {"id": "329a000f-5d8c-46fe-943f-3e8a7b854140", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392102660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c95f07c1a7a432ba2c8ed8aaa12604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d461bc-84", "ovs_interfaceid": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Converting VIF {"id": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "address": "fa:16:3e:85:87:60", "network": {"id": "329a000f-5d8c-46fe-943f-3e8a7b854140", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392102660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c95f07c1a7a432ba2c8ed8aaa12604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d461bc-84", "ovs_interfaceid": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:87:60,bridge_name='br-int',has_traffic_filtering=True,id=69d461bc-84ce-46b4-949d-6d54d9a4454c,network=Network(329a000f-5d8c-46fe-943f-3e8a7b854140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69d461bc-84') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.objects.instance [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lazy-loading 'pci_devices' on Instance uuid d3c21984-13a9-422c-b9e7-f9ca79b62d81 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:04:03 user nova-compute[74611]:   <uuid>d3c21984-13a9-422c-b9e7-f9ca79b62d81</uuid>
Nov 13 10:04:03 user nova-compute[74611]:   <name>instance-00000020</name>
Nov 13 10:04:03 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:04:03 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:04:03 user nova-compute[74611]:   <metadata>
Nov 13 10:04:03 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:04:03 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:04:03 user nova-compute[74611]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-288261506</nova:name>
Nov 13 10:04:03 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:04:03</nova:creationTime>
Nov 13 10:04:03 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:04:03 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:04:03 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:04:03 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:04:03 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:04:03 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:04:03 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:04:03 user nova-compute[74611]:       <nova:owner>
Nov 13 10:04:03 user nova-compute[74611]:         <nova:user uuid="690f5c2eb45b4704aa7e1faf9927173a">tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member</nova:user>
Nov 13 10:04:03 user nova-compute[74611]:         <nova:project uuid="5c95f07c1a7a432ba2c8ed8aaa12604f">tempest-TestServerVolumeAttachScenarioOldVersion-1504114640</nova:project>
Nov 13 10:04:03 user nova-compute[74611]:       </nova:owner>
Nov 13 10:04:03 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:04:03 user nova-compute[74611]:       <nova:ports>
Nov 13 10:04:03 user nova-compute[74611]:         <nova:port uuid="69d461bc-84ce-46b4-949d-6d54d9a4454c">
Nov 13 10:04:03 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 10:04:03 user nova-compute[74611]:         </nova:port>
Nov 13 10:04:03 user nova-compute[74611]:       </nova:ports>
Nov 13 10:04:03 user nova-compute[74611]:     </nova:instance>
Nov 13 10:04:03 user nova-compute[74611]:   </metadata>
Nov 13 10:04:03 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:04:03 user nova-compute[74611]:     <system>
Nov 13 10:04:03 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:04:03 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:04:03 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:04:03 user nova-compute[74611]:       <entry name="serial">d3c21984-13a9-422c-b9e7-f9ca79b62d81</entry>
Nov 13 10:04:03 user nova-compute[74611]:       <entry name="uuid">d3c21984-13a9-422c-b9e7-f9ca79b62d81</entry>
Nov 13 10:04:03 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:04:03 user nova-compute[74611]:     </system>
Nov 13 10:04:03 user nova-compute[74611]:   </sysinfo>
Nov 13 10:04:03 user nova-compute[74611]:   <os>
Nov 13 10:04:03 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:04:03 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:04:03 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:04:03 user nova-compute[74611]:   </os>
Nov 13 10:04:03 user nova-compute[74611]:   <features>
Nov 13 10:04:03 user nova-compute[74611]:     <acpi/>
Nov 13 10:04:03 user nova-compute[74611]:     <apic/>
Nov 13 10:04:03 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:04:03 user nova-compute[74611]:   </features>
Nov 13 10:04:03 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:04:03 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:04:03 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:04:03 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:04:03 user nova-compute[74611]:   </clock>
Nov 13 10:04:03 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:04:03 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:04:03 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:04:03 user nova-compute[74611]:   </cpu>
Nov 13 10:04:03 user nova-compute[74611]:   <devices>
Nov 13 10:04:03 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:04:03 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:04:03 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk"/>
Nov 13 10:04:03 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:04:03 user nova-compute[74611]:     </disk>
Nov 13 10:04:03 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:04:03 user nova-compute[74611]:       <mac address="fa:16:3e:85:87:60"/>
Nov 13 10:04:03 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:04:03 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:04:03 user nova-compute[74611]:       <target dev="tap69d461bc-84"/>
Nov 13 10:04:03 user nova-compute[74611]:     </interface>
Nov 13 10:04:03 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:04:03 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/console.log" append="off"/>
Nov 13 10:04:03 user nova-compute[74611]:     </serial>
Nov 13 10:04:03 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:04:03 user nova-compute[74611]:     <video>
Nov 13 10:04:03 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:04:03 user nova-compute[74611]:     </video>
Nov 13 10:04:03 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:04:03 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:04:03 user nova-compute[74611]:     </rng>
Nov 13 10:04:03 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:04:03 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:04:03 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:04:03 user nova-compute[74611]:     </memballoon>
Nov 13 10:04:03 user nova-compute[74611]:   </devices>
Nov 13 10:04:03 user nova-compute[74611]: </domain>
Nov 13 10:04:03 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-288261506',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-288261506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2882615',id=32,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGX90AONFZNWuKQy6iHfVSSck3PWOZgqhIYct3cEpZHZBe0WXxg+jfiwjJuUHrrvB0S+XFoZOl/Lkw/WnS6DAm4bUJUhHgpcDMbvJ0HqpJhZgJrehnGrdcC2GGfHiq983g==',key_name='tempest-keypair-645812607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c95f07c1a7a432ba2c8ed8aaa12604f',ramdisk_id='',reservation_id='r-4qxdgqlj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1504114640',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:04:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='690f5c2eb45b4704aa7e1faf9927173a',uuid=d3c21984-13a9-422c-b9e7-f9ca79b62d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "address": "fa:16:3e:85:87:60", "network": {"id": "329a000f-5d8c-46fe-943f-3e8a7b854140", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392102660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c95f07c1a7a432ba2c8ed8aaa12604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d461bc-84", "ovs_interfaceid": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Converting VIF {"id": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "address": "fa:16:3e:85:87:60", "network": {"id": "329a000f-5d8c-46fe-943f-3e8a7b854140", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392102660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c95f07c1a7a432ba2c8ed8aaa12604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d461bc-84", "ovs_interfaceid": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:87:60,bridge_name='br-int',has_traffic_filtering=True,id=69d461bc-84ce-46b4-949d-6d54d9a4454c,network=Network(329a000f-5d8c-46fe-943f-3e8a7b854140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69d461bc-84') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG os_vif [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:87:60,bridge_name='br-int',has_traffic_filtering=True,id=69d461bc-84ce-46b4-949d-6d54d9a4454c,network=Network(329a000f-5d8c-46fe-943f-3e8a7b854140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69d461bc-84') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33c3624b-e55c-5bfd-9abb-0ecacf9a6841', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69d461bc-84, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69d461bc-84, col_values=(('qos', UUID('27ae93b6-c056-454e-a2c6-0d952c31cf12')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69d461bc-84, col_values=(('external_ids', {'iface-id': '69d461bc-84ce-46b4-949d-6d54d9a4454c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:87:60', 'vm-uuid': 'd3c21984-13a9-422c-b9e7-f9ca79b62d81'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:03 user nova-compute[74611]: INFO os_vif [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:87:60,bridge_name='br-int',has_traffic_filtering=True,id=69d461bc-84ce-46b4-949d-6d54d9a4454c,network=Network(329a000f-5d8c-46fe-943f-3e8a7b854140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69d461bc-84')
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] No VIF found with MAC fa:16:3e:85:87:60, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.network.neutron [req-f5e815ef-cab9-4656-a883-660eb25b13de req-601c7d70-03df-4830-afcb-92acb9fcb1fe service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Updated VIF entry in instance network info cache for port 69d461bc-84ce-46b4-949d-6d54d9a4454c. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG nova.network.neutron [req-f5e815ef-cab9-4656-a883-660eb25b13de req-601c7d70-03df-4830-afcb-92acb9fcb1fe service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Updating instance_info_cache with network_info: [{"id": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "address": "fa:16:3e:85:87:60", "network": {"id": "329a000f-5d8c-46fe-943f-3e8a7b854140", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392102660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c95f07c1a7a432ba2c8ed8aaa12604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d461bc-84", "ovs_interfaceid": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f5e815ef-cab9-4656-a883-660eb25b13de req-601c7d70-03df-4830-afcb-92acb9fcb1fe service nova] Releasing lock "refresh_cache-d3c21984-13a9-422c-b9e7-f9ca79b62d81" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:04:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-b46f3b70-1bf0-4d6a-88f5-f025430bfd4b req-a5afbe70-facf-41aa-82ca-831c7afdc976 service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Received event network-vif-plugged-69d461bc-84ce-46b4-949d-6d54d9a4454c {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b46f3b70-1bf0-4d6a-88f5-f025430bfd4b req-a5afbe70-facf-41aa-82ca-831c7afdc976 service nova] Acquiring lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b46f3b70-1bf0-4d6a-88f5-f025430bfd4b req-a5afbe70-facf-41aa-82ca-831c7afdc976 service nova] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b46f3b70-1bf0-4d6a-88f5-f025430bfd4b req-a5afbe70-facf-41aa-82ca-831c7afdc976 service nova] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-b46f3b70-1bf0-4d6a-88f5-f025430bfd4b req-a5afbe70-facf-41aa-82ca-831c7afdc976 service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] No waiting events found dispatching network-vif-plugged-69d461bc-84ce-46b4-949d-6d54d9a4454c {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:05 user nova-compute[74611]: WARNING nova.compute.manager [req-b46f3b70-1bf0-4d6a-88f5-f025430bfd4b req-a5afbe70-facf-41aa-82ca-831c7afdc976 service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Received unexpected event network-vif-plugged-69d461bc-84ce-46b4-949d-6d54d9a4454c for instance with vm_state building and task_state spawning.
Nov 13 10:04:05 user nova-compute[74611]: DEBUG nova.compute.manager [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:04:05 user nova-compute[74611]: INFO nova.compute.manager [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] instance snapshotting
Nov 13 10:04:05 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Beginning live snapshot process
Nov 13 10:04:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json -f qcow2 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json -f qcow2 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgNWIkqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:04:06 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:04:06 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:04:06 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9351fdc2-cf29-43ce-9d6c-f4b160ce4e8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:04:06 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c72edc1-9870-4811-89a7-54c1858d4de2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d] added
Nov 13 10:04:06 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6306f22-6286-41fb-8f1b-cfe026ba5635]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c67b45-ef5e-4325-8d01-9efef23a68a5]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgNWIkqO {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgNWIkqO" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df53a30-ba86-4370-9d50-28d63db89338]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xgNWIkqO'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy3d38wu3/015572431c904f42ada8b95ace6ede08.delta 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0109dcc-7a13-4e39-be37-5d2d86bc59ac]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae11cde-4ff9-4cea-a312-c5b865b8c44a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:06 user nova-compute[74611]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:06 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:06 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:06 user nova-compute[74611]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:06 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:06 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a11a3d4-ec7a-4c28-95e5-6de37eef4763]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d, portal: 172.16.0.220,3260]
Nov 13 10:04:06 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d, portal: 172.16.0.220,3260] successful.
Nov 13 10:04:06 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b8151d-5155-4b86-be32-cb4a61f1bdd4]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7640c786-be05-49b9-a129-2a2c1dda20a8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:06 user nova-compute[74611]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:06 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:06 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:06 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:06 user nova-compute[74611]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:06 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:06 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:06 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0ef165-b65d-42d2-8444-69d3051ae0c4]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgNWIkqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy3d38wu3/015572431c904f42ada8b95ace6ede08.delta 1073741824" returned: 0 in 0.274s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:06 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:06 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:04:06 user nova-compute[74611]: INFO nova.compute.claims [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Claim successful on node user
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:04:07 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Instance spawned successfully.
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-79ca1a80-1b3b-4be3-9ff6-4bcf591074a5 req-ab3f4a72-f6e0-488c-a2cd-45a1b1f7e58d service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Received event network-vif-plugged-69d461bc-84ce-46b4-949d-6d54d9a4454c {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-79ca1a80-1b3b-4be3-9ff6-4bcf591074a5 req-ab3f4a72-f6e0-488c-a2cd-45a1b1f7e58d service nova] Acquiring lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-79ca1a80-1b3b-4be3-9ff6-4bcf591074a5 req-ab3f4a72-f6e0-488c-a2cd-45a1b1f7e58d service nova] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-79ca1a80-1b3b-4be3-9ff6-4bcf591074a5 req-ab3f4a72-f6e0-488c-a2cd-45a1b1f7e58d service nova] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-79ca1a80-1b3b-4be3-9ff6-4bcf591074a5 req-ab3f4a72-f6e0-488c-a2cd-45a1b1f7e58d service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] No waiting events found dispatching network-vif-plugged-69d461bc-84ce-46b4-949d-6d54d9a4454c {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:07 user nova-compute[74611]: WARNING nova.compute.manager [req-79ca1a80-1b3b-4be3-9ff6-4bcf591074a5 req-ab3f4a72-f6e0-488c-a2cd-45a1b1f7e58d service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Received unexpected event network-vif-plugged-69d461bc-84ce-46b4-949d-6d54d9a4454c for instance with vm_state building and task_state spawning.
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:04:07 user nova-compute[74611]: INFO nova.compute.manager [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:04:07 user nova-compute[74611]: INFO nova.compute.manager [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Took 6.86 seconds to build instance.
Nov 13 10:04:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23337376662626165', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337376662626165', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fef7292f-bc09-475e-a352-d92dcb982710 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.970s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.objects.instance [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'flavor' on Instance uuid 4fa9e23b-30f2-41ae-83ed-86145389d474 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.network.neutron [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:04:07 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:04:07 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:04:07 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:04:07 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:04:07 user nova-compute[74611]:   <serial>6e42a395-a96a-419b-8acf-a49518f1ed1d</serial>
Nov 13 10:04:07 user nova-compute[74611]: </disk>
Nov 13 10:04:07 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.policy [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd93cfc3fb54b41ceb9f9657de0059043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1384599c1e484e54ae29b024377dbd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:04:07 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Creating image(s)
Nov 13 10:04:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "/opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "/opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 10:04:07 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 10:04:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 10:04:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy3d38wu3/015572431c904f42ada8b95ace6ede08.delta /opt/stack/data/nova/instances/snapshots/tmpy3d38wu3/015572431c904f42ada8b95ace6ede08 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No VIF found with MAC fa:16:3e:39:0a:26, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk 1073741824" returned: 0 in 0.083s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3b70a12a-c588-4f41-ab3c-ee273e448f6f tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.628s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy3d38wu3/015572431c904f42ada8b95ace6ede08.delta /opt/stack/data/nova/instances/snapshots/tmpy3d38wu3/015572431c904f42ada8b95ace6ede08" returned: 0 in 0.536s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:08 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Snapshot extracted, beginning image upload
Nov 13 10:04:08 user nova-compute[74611]: DEBUG nova.network.neutron [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Successfully created port: 9bde4c80-c890-47fb-9e43-db74946b103b {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Cannot resize image /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Ensure instance console log exists: /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.network.neutron [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Successfully updated port: 9bde4c80-c890-47fb-9e43-db74946b103b {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "refresh_cache-ad645ec3-086e-4bfe-b10e-b0a2ff32720d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquired lock "refresh_cache-ad645ec3-086e-4bfe-b10e-b0a2ff32720d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.network.neutron [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.compute.manager [req-0dc4cc47-ec15-4f4d-958c-ff49ae9d47cb req-19aec496-823e-40b4-b374-bed98a8086b5 service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Received event network-changed-9bde4c80-c890-47fb-9e43-db74946b103b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.compute.manager [req-0dc4cc47-ec15-4f4d-958c-ff49ae9d47cb req-19aec496-823e-40b4-b374-bed98a8086b5 service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Refreshing instance network info cache due to event network-changed-9bde4c80-c890-47fb-9e43-db74946b103b. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0dc4cc47-ec15-4f4d-958c-ff49ae9d47cb req-19aec496-823e-40b4-b374-bed98a8086b5 service nova] Acquiring lock "refresh_cache-ad645ec3-086e-4bfe-b10e-b0a2ff32720d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.network.neutron [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:04:09 user nova-compute[74611]: INFO nova.compute.manager [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Rescuing
Nov 13 10:04:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquired lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.network.neutron [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.network.neutron [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Updating instance_info_cache with network_info: [{"id": "9bde4c80-c890-47fb-9e43-db74946b103b", "address": "fa:16:3e:86:8d:ba", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bde4c80-c8", "ovs_interfaceid": "9bde4c80-c890-47fb-9e43-db74946b103b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Releasing lock "refresh_cache-ad645ec3-086e-4bfe-b10e-b0a2ff32720d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Instance network_info: |[{"id": "9bde4c80-c890-47fb-9e43-db74946b103b", "address": "fa:16:3e:86:8d:ba", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bde4c80-c8", "ovs_interfaceid": "9bde4c80-c890-47fb-9e43-db74946b103b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0dc4cc47-ec15-4f4d-958c-ff49ae9d47cb req-19aec496-823e-40b4-b374-bed98a8086b5 service nova] Acquired lock "refresh_cache-ad645ec3-086e-4bfe-b10e-b0a2ff32720d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.network.neutron [req-0dc4cc47-ec15-4f4d-958c-ff49ae9d47cb req-19aec496-823e-40b4-b374-bed98a8086b5 service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Refreshing network info cache for port 9bde4c80-c890-47fb-9e43-db74946b103b {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Start _get_guest_xml network_info=[{"id": "9bde4c80-c890-47fb-9e43-db74946b103b", "address": "fa:16:3e:86:8d:ba", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bde4c80-c8", "ovs_interfaceid": "9bde4c80-c890-47fb-9e43-db74946b103b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:04:09 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:04:09 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1325850666',display_name='tempest-AttachVolumeNegativeTest-server-1325850666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1325850666',id=33,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObCHLVp+hvZZ0HtfbRh0HeUhWR1r3rxiv4ljXlyTD+BNyEu/kdlAqUXL8rWbYVd7Zbrcmhm+wO9106EmE4KnJYDqzmCYLl2a2Da71CK6OSsW/ZDNgoiXi+71JK4Vh4ICw==',key_name='tempest-keypair-1544061739',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1384599c1e484e54ae29b024377dbd04',ramdisk_id='',reservation_id='r-prvwrast',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1307038303',owner_user_name='tempest-AttachVolumeNegativeTest-1307038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d93cfc3fb54b41ceb9f9657de0059043',uuid=ad645ec3-086e-4bfe-b10e-b0a2ff32720d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bde4c80-c890-47fb-9e43-db74946b103b", "address": "fa:16:3e:86:8d:ba", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bde4c80-c8", "ovs_interfaceid": "9bde4c80-c890-47fb-9e43-db74946b103b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converting VIF {"id": "9bde4c80-c890-47fb-9e43-db74946b103b", "address": "fa:16:3e:86:8d:ba", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bde4c80-c8", "ovs_interfaceid": "9bde4c80-c890-47fb-9e43-db74946b103b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:8d:ba,bridge_name='br-int',has_traffic_filtering=True,id=9bde4c80-c890-47fb-9e43-db74946b103b,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bde4c80-c8') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.objects.instance [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'pci_devices' on Instance uuid ad645ec3-086e-4bfe-b10e-b0a2ff32720d {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:04:09 user nova-compute[74611]:   <uuid>ad645ec3-086e-4bfe-b10e-b0a2ff32720d</uuid>
Nov 13 10:04:09 user nova-compute[74611]:   <name>instance-00000021</name>
Nov 13 10:04:09 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:04:09 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:04:09 user nova-compute[74611]:   <metadata>
Nov 13 10:04:09 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:04:09 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:04:09 user nova-compute[74611]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1325850666</nova:name>
Nov 13 10:04:09 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:04:09</nova:creationTime>
Nov 13 10:04:09 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:04:09 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:04:09 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:04:09 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:04:09 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:04:09 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:04:09 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:04:09 user nova-compute[74611]:       <nova:owner>
Nov 13 10:04:09 user nova-compute[74611]:         <nova:user uuid="d93cfc3fb54b41ceb9f9657de0059043">tempest-AttachVolumeNegativeTest-1307038303-project-member</nova:user>
Nov 13 10:04:09 user nova-compute[74611]:         <nova:project uuid="1384599c1e484e54ae29b024377dbd04">tempest-AttachVolumeNegativeTest-1307038303</nova:project>
Nov 13 10:04:09 user nova-compute[74611]:       </nova:owner>
Nov 13 10:04:09 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:04:09 user nova-compute[74611]:       <nova:ports>
Nov 13 10:04:09 user nova-compute[74611]:         <nova:port uuid="9bde4c80-c890-47fb-9e43-db74946b103b">
Nov 13 10:04:09 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 10:04:09 user nova-compute[74611]:         </nova:port>
Nov 13 10:04:09 user nova-compute[74611]:       </nova:ports>
Nov 13 10:04:09 user nova-compute[74611]:     </nova:instance>
Nov 13 10:04:09 user nova-compute[74611]:   </metadata>
Nov 13 10:04:09 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:04:09 user nova-compute[74611]:     <system>
Nov 13 10:04:09 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:04:09 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:04:09 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:04:09 user nova-compute[74611]:       <entry name="serial">ad645ec3-086e-4bfe-b10e-b0a2ff32720d</entry>
Nov 13 10:04:09 user nova-compute[74611]:       <entry name="uuid">ad645ec3-086e-4bfe-b10e-b0a2ff32720d</entry>
Nov 13 10:04:09 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:04:09 user nova-compute[74611]:     </system>
Nov 13 10:04:09 user nova-compute[74611]:   </sysinfo>
Nov 13 10:04:09 user nova-compute[74611]:   <os>
Nov 13 10:04:09 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:04:09 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:04:09 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:04:09 user nova-compute[74611]:   </os>
Nov 13 10:04:09 user nova-compute[74611]:   <features>
Nov 13 10:04:09 user nova-compute[74611]:     <acpi/>
Nov 13 10:04:09 user nova-compute[74611]:     <apic/>
Nov 13 10:04:09 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:04:09 user nova-compute[74611]:   </features>
Nov 13 10:04:09 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:04:09 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:04:09 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:04:09 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:04:09 user nova-compute[74611]:   </clock>
Nov 13 10:04:09 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:04:09 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:04:09 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:04:09 user nova-compute[74611]:   </cpu>
Nov 13 10:04:09 user nova-compute[74611]:   <devices>
Nov 13 10:04:09 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:04:09 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:04:09 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk"/>
Nov 13 10:04:09 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:04:09 user nova-compute[74611]:     </disk>
Nov 13 10:04:09 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:04:09 user nova-compute[74611]:       <mac address="fa:16:3e:86:8d:ba"/>
Nov 13 10:04:09 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:04:09 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:04:09 user nova-compute[74611]:       <target dev="tap9bde4c80-c8"/>
Nov 13 10:04:09 user nova-compute[74611]:     </interface>
Nov 13 10:04:09 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:04:09 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/console.log" append="off"/>
Nov 13 10:04:09 user nova-compute[74611]:     </serial>
Nov 13 10:04:09 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:04:09 user nova-compute[74611]:     <video>
Nov 13 10:04:09 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:04:09 user nova-compute[74611]:     </video>
Nov 13 10:04:09 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:04:09 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:04:09 user nova-compute[74611]:     </rng>
Nov 13 10:04:09 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:04:09 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:04:09 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:04:09 user nova-compute[74611]:     </memballoon>
Nov 13 10:04:09 user nova-compute[74611]:   </devices>
Nov 13 10:04:09 user nova-compute[74611]: </domain>
Nov 13 10:04:09 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1325850666',display_name='tempest-AttachVolumeNegativeTest-server-1325850666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1325850666',id=33,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObCHLVp+hvZZ0HtfbRh0HeUhWR1r3rxiv4ljXlyTD+BNyEu/kdlAqUXL8rWbYVd7Zbrcmhm+wO9106EmE4KnJYDqzmCYLl2a2Da71CK6OSsW/ZDNgoiXi+71JK4Vh4ICw==',key_name='tempest-keypair-1544061739',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1384599c1e484e54ae29b024377dbd04',ramdisk_id='',reservation_id='r-prvwrast',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1307038303',owner_user_name='tempest-AttachVolumeNegativeTest-1307038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d93cfc3fb54b41ceb9f9657de0059043',uuid=ad645ec3-086e-4bfe-b10e-b0a2ff32720d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bde4c80-c890-47fb-9e43-db74946b103b", "address": "fa:16:3e:86:8d:ba", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bde4c80-c8", "ovs_interfaceid": "9bde4c80-c890-47fb-9e43-db74946b103b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converting VIF {"id": "9bde4c80-c890-47fb-9e43-db74946b103b", "address": "fa:16:3e:86:8d:ba", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bde4c80-c8", "ovs_interfaceid": "9bde4c80-c890-47fb-9e43-db74946b103b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:8d:ba,bridge_name='br-int',has_traffic_filtering=True,id=9bde4c80-c890-47fb-9e43-db74946b103b,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bde4c80-c8') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG os_vif [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:8d:ba,bridge_name='br-int',has_traffic_filtering=True,id=9bde4c80-c890-47fb-9e43-db74946b103b,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bde4c80-c8') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3851b17-087d-54dc-8205-2c443e622ea4', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bde4c80-c8, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9bde4c80-c8, col_values=(('qos', UUID('200c22f9-11f0-40bd-9bc4-861b4755d35d')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9bde4c80-c8, col_values=(('external_ids', {'iface-id': '9bde4c80-c890-47fb-9e43-db74946b103b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:8d:ba', 'vm-uuid': 'ad645ec3-086e-4bfe-b10e-b0a2ff32720d'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:09 user nova-compute[74611]: INFO os_vif [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:8d:ba,bridge_name='br-int',has_traffic_filtering=True,id=9bde4c80-c890-47fb-9e43-db74946b103b,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bde4c80-c8')
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:04:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No VIF found with MAC fa:16:3e:86:8d:ba, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:04:10 user nova-compute[74611]: DEBUG nova.network.neutron [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Updating instance_info_cache with network_info: [{"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Releasing lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:04:10 user nova-compute[74611]: DEBUG nova.network.neutron [req-0dc4cc47-ec15-4f4d-958c-ff49ae9d47cb req-19aec496-823e-40b4-b374-bed98a8086b5 service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Updated VIF entry in instance network info cache for port 9bde4c80-c890-47fb-9e43-db74946b103b. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:04:10 user nova-compute[74611]: DEBUG nova.network.neutron [req-0dc4cc47-ec15-4f4d-958c-ff49ae9d47cb req-19aec496-823e-40b4-b374-bed98a8086b5 service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Updating instance_info_cache with network_info: [{"id": "9bde4c80-c890-47fb-9e43-db74946b103b", "address": "fa:16:3e:86:8d:ba", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bde4c80-c8", "ovs_interfaceid": "9bde4c80-c890-47fb-9e43-db74946b103b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0dc4cc47-ec15-4f4d-958c-ff49ae9d47cb req-19aec496-823e-40b4-b374-bed98a8086b5 service nova] Releasing lock "refresh_cache-ad645ec3-086e-4bfe-b10e-b0a2ff32720d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:04:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:10 user nova-compute[74611]: DEBUG nova.compute.manager [req-1b491486-e1b1-403d-b542-6ff85e29e4fe req-1edc7a33-1af9-447b-bcb2-135909f011d8 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-vif-unplugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1b491486-e1b1-403d-b542-6ff85e29e4fe req-1edc7a33-1af9-447b-bcb2-135909f011d8 service nova] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1b491486-e1b1-403d-b542-6ff85e29e4fe req-1edc7a33-1af9-447b-bcb2-135909f011d8 service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1b491486-e1b1-403d-b542-6ff85e29e4fe req-1edc7a33-1af9-447b-bcb2-135909f011d8 service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:10 user nova-compute[74611]: DEBUG nova.compute.manager [req-1b491486-e1b1-403d-b542-6ff85e29e4fe req-1edc7a33-1af9-447b-bcb2-135909f011d8 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] No waiting events found dispatching network-vif-unplugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:10 user nova-compute[74611]: WARNING nova.compute.manager [req-1b491486-e1b1-403d-b542-6ff85e29e4fe req-1edc7a33-1af9-447b-bcb2-135909f011d8 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received unexpected event network-vif-unplugged-ffb1eb13-f028-447f-a01d-45bae2d17edd for instance with vm_state active and task_state rescuing.
Nov 13 10:04:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:11 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Snapshot image upload complete
Nov 13 10:04:11 user nova-compute[74611]: INFO nova.compute.manager [None req-68dc99dc-d6af-4dcd-811a-b5806dbf8e04 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Took 5.99 seconds to snapshot the instance on the hypervisor.
Nov 13 10:04:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:11 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Instance destroyed successfully.
Nov 13 10:04:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:11 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Attempting rescue
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74611) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Instance directory exists: not creating {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 10:04:11 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Creating image(s)
Nov 13 10:04:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "/opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "/opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.objects.instance [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4fa9e23b-30f2-41ae-83ed-86145389d474 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.186s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.rescue {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.rescue" returned: 0 in 0.060s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.objects.instance [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'migration_context' on Instance uuid 4fa9e23b-30f2-41ae-83ed-86145389d474 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.objects.base [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Object Instance<4fa9e23b-30f2-41ae-83ed-86145389d474> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Start _get_guest_xml network_info=[{"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "vif_mac": "fa:16:3e:39:0a:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.objects.instance [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'resources' on Instance uuid 4fa9e23b-30f2-41ae-83ed-86145389d474 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.objects.base [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Object Instance<4fa9e23b-30f2-41ae-83ed-86145389d474> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.objects.instance [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'numa_topology' on Instance uuid 4fa9e23b-30f2-41ae-83ed-86145389d474 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.objects.base [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Object Instance<4fa9e23b-30f2-41ae-83ed-86145389d474> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:04:11 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:04:11 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.objects.instance [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4fa9e23b-30f2-41ae-83ed-86145389d474 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.objects.base [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Object Instance<4fa9e23b-30f2-41ae-83ed-86145389d474> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-444308231',display_name='tempest-ServerRescueNegativeTestJSON-server-444308231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-444308231',id=28,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIRCQ9tYBQJ2Euvs7EpBOn3hJTaw2Vrx9tlGYc3FTElAI39JHbVLOxgQPucNZb3Ubif7cKCIZtlfjaxGMqTy7zAtScYXSjAUwAvWJc8/a4aSJoP6GFgfWY4Zy4/89qcIA==',key_name='tempest-keypair-1249039539',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:02:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae9ab18bb67e4db19e6c3366771ad218',ramdisk_id='',reservation_id='r-3wrgft7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-961432289',owner_user_name='tempest-ServerRescueNegativeTestJSON-961432289-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863471360be04ab5acb07ef3e99007c4',uuid=4fa9e23b-30f2-41ae-83ed-86145389d474,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "vif_mac": "fa:16:3e:39:0a:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converting VIF {"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "vif_mac": "fa:16:3e:39:0a:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:0a:26,bridge_name='br-int',has_traffic_filtering=True,id=ffb1eb13-f028-447f-a01d-45bae2d17edd,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb1eb13-f0') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.objects.instance [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fa9e23b-30f2-41ae-83ed-86145389d474 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.objects.base [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Object Instance<4fa9e23b-30f2-41ae-83ed-86145389d474> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:04:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:04:11 user nova-compute[74611]:   <uuid>4fa9e23b-30f2-41ae-83ed-86145389d474</uuid>
Nov 13 10:04:11 user nova-compute[74611]:   <name>instance-0000001c</name>
Nov 13 10:04:11 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:04:11 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:04:11 user nova-compute[74611]:   <metadata>
Nov 13 10:04:11 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:04:11 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:04:11 user nova-compute[74611]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-444308231</nova:name>
Nov 13 10:04:11 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:04:11</nova:creationTime>
Nov 13 10:04:11 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:04:11 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:04:11 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:04:11 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:04:11 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:04:11 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:04:11 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:04:11 user nova-compute[74611]:       <nova:owner>
Nov 13 10:04:11 user nova-compute[74611]:         <nova:user uuid="863471360be04ab5acb07ef3e99007c4">tempest-ServerRescueNegativeTestJSON-961432289-project-member</nova:user>
Nov 13 10:04:11 user nova-compute[74611]:         <nova:project uuid="ae9ab18bb67e4db19e6c3366771ad218">tempest-ServerRescueNegativeTestJSON-961432289</nova:project>
Nov 13 10:04:11 user nova-compute[74611]:       </nova:owner>
Nov 13 10:04:11 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:04:11 user nova-compute[74611]:       <nova:ports>
Nov 13 10:04:11 user nova-compute[74611]:         <nova:port uuid="ffb1eb13-f028-447f-a01d-45bae2d17edd">
Nov 13 10:04:11 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 10:04:11 user nova-compute[74611]:         </nova:port>
Nov 13 10:04:11 user nova-compute[74611]:       </nova:ports>
Nov 13 10:04:11 user nova-compute[74611]:     </nova:instance>
Nov 13 10:04:11 user nova-compute[74611]:   </metadata>
Nov 13 10:04:11 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:04:11 user nova-compute[74611]:     <system>
Nov 13 10:04:11 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:04:11 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:04:11 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:04:11 user nova-compute[74611]:       <entry name="serial">4fa9e23b-30f2-41ae-83ed-86145389d474</entry>
Nov 13 10:04:11 user nova-compute[74611]:       <entry name="uuid">4fa9e23b-30f2-41ae-83ed-86145389d474</entry>
Nov 13 10:04:11 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:04:11 user nova-compute[74611]:     </system>
Nov 13 10:04:11 user nova-compute[74611]:   </sysinfo>
Nov 13 10:04:11 user nova-compute[74611]:   <os>
Nov 13 10:04:11 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:04:11 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:04:11 user nova-compute[74611]:   </os>
Nov 13 10:04:11 user nova-compute[74611]:   <features>
Nov 13 10:04:11 user nova-compute[74611]:     <acpi/>
Nov 13 10:04:11 user nova-compute[74611]:     <apic/>
Nov 13 10:04:11 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:04:11 user nova-compute[74611]:   </features>
Nov 13 10:04:11 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:04:11 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:04:11 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:04:11 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:04:11 user nova-compute[74611]:   </clock>
Nov 13 10:04:11 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:04:11 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:04:11 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:04:11 user nova-compute[74611]:   </cpu>
Nov 13 10:04:11 user nova-compute[74611]:   <devices>
Nov 13 10:04:11 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:04:11 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:04:11 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.rescue"/>
Nov 13 10:04:11 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:04:11 user nova-compute[74611]:     </disk>
Nov 13 10:04:11 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:04:11 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:04:11 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk"/>
Nov 13 10:04:11 user nova-compute[74611]:       <target dev="vdb" bus="virtio"/>
Nov 13 10:04:11 user nova-compute[74611]:     </disk>
Nov 13 10:04:11 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:04:11 user nova-compute[74611]:       <mac address="fa:16:3e:39:0a:26"/>
Nov 13 10:04:11 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:04:11 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:04:11 user nova-compute[74611]:       <target dev="tapffb1eb13-f0"/>
Nov 13 10:04:11 user nova-compute[74611]:     </interface>
Nov 13 10:04:11 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:04:11 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/console.log" append="off"/>
Nov 13 10:04:11 user nova-compute[74611]:     </serial>
Nov 13 10:04:11 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:04:11 user nova-compute[74611]:     <video>
Nov 13 10:04:11 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:04:11 user nova-compute[74611]:     </video>
Nov 13 10:04:11 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:04:11 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:04:11 user nova-compute[74611]:     </rng>
Nov 13 10:04:11 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:04:11 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:04:11 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:04:11 user nova-compute[74611]:     </memballoon>
Nov 13 10:04:11 user nova-compute[74611]:   </devices>
Nov 13 10:04:11 user nova-compute[74611]: </domain>
Nov 13 10:04:11 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:04:12 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Instance destroyed successfully.
Nov 13 10:04:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] No VIF found with MAC fa:16:3e:39:0a:26, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] No waiting events found dispatching network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:12 user nova-compute[74611]: WARNING nova.compute.manager [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received unexpected event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd for instance with vm_state active and task_state rescuing.
Nov 13 10:04:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Received event network-vif-plugged-9bde4c80-c890-47fb-9e43-db74946b103b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] Acquiring lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] No waiting events found dispatching network-vif-plugged-9bde4c80-c890-47fb-9e43-db74946b103b {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:12 user nova-compute[74611]: WARNING nova.compute.manager [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Received unexpected event network-vif-plugged-9bde4c80-c890-47fb-9e43-db74946b103b for instance with vm_state building and task_state spawning.
Nov 13 10:04:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Received event network-vif-plugged-9bde4c80-c890-47fb-9e43-db74946b103b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] Acquiring lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] No waiting events found dispatching network-vif-plugged-9bde4c80-c890-47fb-9e43-db74946b103b {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:12 user nova-compute[74611]: WARNING nova.compute.manager [req-a7c8e3cb-905b-40e7-a696-4f4ef1cefb9b req-86b55524-b488-4835-84ce-0c99e275e553 service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Received unexpected event network-vif-plugged-9bde4c80-c890-47fb-9e43-db74946b103b for instance with vm_state building and task_state spawning.
Nov 13 10:04:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:04:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:04:13 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Instance spawned successfully.
Nov 13 10:04:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:04:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:13 user nova-compute[74611]: INFO nova.compute.manager [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Took 6.21 seconds to spawn the instance on the hypervisor.
Nov 13 10:04:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:04:13 user nova-compute[74611]: INFO nova.compute.manager [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Took 7.15 seconds to build instance.
Nov 13 10:04:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ffcab9d5-5260-4bba-a8c7-515846536574 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.273s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-f6c9a5e5-0b5f-41cb-a923-1947d454d9cc req-46b2799e-4a7d-4d9d-a2fd-0aac122bf849 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f6c9a5e5-0b5f-41cb-a923-1947d454d9cc req-46b2799e-4a7d-4d9d-a2fd-0aac122bf849 service nova] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f6c9a5e5-0b5f-41cb-a923-1947d454d9cc req-46b2799e-4a7d-4d9d-a2fd-0aac122bf849 service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f6c9a5e5-0b5f-41cb-a923-1947d454d9cc req-46b2799e-4a7d-4d9d-a2fd-0aac122bf849 service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-f6c9a5e5-0b5f-41cb-a923-1947d454d9cc req-46b2799e-4a7d-4d9d-a2fd-0aac122bf849 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] No waiting events found dispatching network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:14 user nova-compute[74611]: WARNING nova.compute.manager [req-f6c9a5e5-0b5f-41cb-a923-1947d454d9cc req-46b2799e-4a7d-4d9d-a2fd-0aac122bf849 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received unexpected event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd for instance with vm_state active and task_state rescuing.
Nov 13 10:04:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-f6c9a5e5-0b5f-41cb-a923-1947d454d9cc req-46b2799e-4a7d-4d9d-a2fd-0aac122bf849 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f6c9a5e5-0b5f-41cb-a923-1947d454d9cc req-46b2799e-4a7d-4d9d-a2fd-0aac122bf849 service nova] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f6c9a5e5-0b5f-41cb-a923-1947d454d9cc req-46b2799e-4a7d-4d9d-a2fd-0aac122bf849 service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f6c9a5e5-0b5f-41cb-a923-1947d454d9cc req-46b2799e-4a7d-4d9d-a2fd-0aac122bf849 service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-f6c9a5e5-0b5f-41cb-a923-1947d454d9cc req-46b2799e-4a7d-4d9d-a2fd-0aac122bf849 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] No waiting events found dispatching network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:14 user nova-compute[74611]: WARNING nova.compute.manager [req-f6c9a5e5-0b5f-41cb-a923-1947d454d9cc req-46b2799e-4a7d-4d9d-a2fd-0aac122bf849 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received unexpected event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd for instance with vm_state active and task_state rescuing.
Nov 13 10:04:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:15 user nova-compute[74611]: DEBUG nova.compute.manager [None req-df7eacd8-c34b-4161-a148-7150df602187 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG nova.network.neutron [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Port 9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d binding to destination host user is already ACTIVE {{(pid=74611) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquired lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG nova.network.neutron [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG nova.network.neutron [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updating instance_info_cache with network_info: [{"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Releasing lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Creating tmpfile /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/tmpre3zvbgk to verify with other compute node that the instance is on the same shared storage. {{(pid=74611) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-05ea4541-4788-4e6f-8fb8-b779db0fe027 req-ccfb39f2-7ef2-4fe9-9ce5-114bfe54c6c1 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received event network-vif-unplugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-05ea4541-4788-4e6f-8fb8-b779db0fe027 req-ccfb39f2-7ef2-4fe9-9ce5-114bfe54c6c1 service nova] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-05ea4541-4788-4e6f-8fb8-b779db0fe027 req-ccfb39f2-7ef2-4fe9-9ce5-114bfe54c6c1 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-05ea4541-4788-4e6f-8fb8-b779db0fe027 req-ccfb39f2-7ef2-4fe9-9ce5-114bfe54c6c1 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-05ea4541-4788-4e6f-8fb8-b779db0fe027 req-ccfb39f2-7ef2-4fe9-9ce5-114bfe54c6c1 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] No waiting events found dispatching network-vif-unplugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:19 user nova-compute[74611]: WARNING nova.compute.manager [req-05ea4541-4788-4e6f-8fb8-b779db0fe027 req-ccfb39f2-7ef2-4fe9-9ce5-114bfe54c6c1 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received unexpected event network-vif-unplugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d for instance with vm_state resized and task_state resize_reverting.
Nov 13 10:04:20 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Instance destroyed successfully.
Nov 13 10:04:20 user nova-compute[74611]: DEBUG nova.objects.instance [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lazy-loading 'resources' on Instance uuid 635636ea-96a0-4fdb-85a1-ca7a87b762f0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1214168652',display_name='tempest-ServerActionsTestOtherB-server-1214168652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1214168652',id=21,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDWkg3C+Ons0/sduU7bCkNdUaQmui4Ar0pDJw7KSIbqtW1jWjrtKiyZ8w8dVwpvUbMKS1UF1ykPykLHc0hyTfyxEKKXaxiPgUkE/a0u6OsQxRK/HJgxNowuqXz8Zc+KMg==',key_name='tempest-keypair-1038082490',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:02:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1fb42835d7f49cbaad21eee295c7692',ramdisk_id='',reservation_id='r-yeac67tm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-840608963',owner_user_name='tempest-ServerActionsTestOtherB-840608963-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:02:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='396adec28c0d44a0aefb1229090f90d5',uuid=635636ea-96a0-4fdb-85a1-ca7a87b762f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converting VIF {"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_vif [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ff4d9c6-a2, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8cb9ae7e-76d2-4cdc-a7f9-50eaaecefa67) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:20 user nova-compute[74611]: INFO os_vif [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2')
Nov 13 10:04:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQfyJOvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:04:20 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[008c0ede-2ada-4e53-8505-4edbe83d700e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:04:20 user nova-compute[74611]: No targets found.
Nov 13 10:04:20 user nova-compute[74611]: iSNS:
Nov 13 10:04:20 user nova-compute[74611]: No targets found.
Nov 13 10:04:20 user nova-compute[74611]: STATIC:
Nov 13 10:04:20 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f
Nov 13 10:04:20 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:20 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:20 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d
Nov 13 10:04:20 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:20 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:20 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd
Nov 13 10:04:20 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:20 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:20 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:04:20 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:20 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:20 user nova-compute[74611]: FIRMWARE:
Nov 13 10:04:20 user nova-compute[74611]: No targets found.
Nov 13 10:04:20 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:04:20 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:04:20 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7679d74-03b4-4302-bbcc-12d9d5517b0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36515ef-5c31-4cc7-9694-8f878f1d7934]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:20 user nova-compute[74611]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:20 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:20 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:20 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:20 user nova-compute[74611]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:20 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:20 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:20 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7c2b6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f'): ({'sde'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Removing single pathed devices sde {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b7475e-2efb-4403-b22d-e4fdf3ce26f1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bbadd3-a285-495e-b164-543900a936b6]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Flushing IO for device /dev/sde {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[956b8ff0-635d-4ab6-9876-32448756373f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[af082a57-a4a4-45aa-bccb-34884a02531a]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] SCSI volumes sde have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8380f82c-e17a-4134-9360-2466a43f15df]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9ca9ff-b500-4a5e-986e-64e8b41e03b8]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260]
Nov 13 10:04:20 user nova-compute[74611]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260] successful.
Nov 13 10:04:20 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f83ff26-d117-4578-8020-c30b905db4c4]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] <== disconnect_volume: return (338ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:04:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:04:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:21 user nova-compute[74611]: DEBUG nova.objects.instance [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lazy-loading 'migration_context' on Instance uuid 635636ea-96a0-4fdb-85a1-ca7a87b762f0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:21 user nova-compute[74611]: DEBUG nova.objects.base [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Object Instance<635636ea-96a0-4fdb-85a1-ca7a87b762f0> lazy-loaded attributes: resources,migration_context {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:04:21 user nova-compute[74611]: DEBUG nova.compute.manager [req-e8a9d1ae-317b-4512-ab2e-cfd40c4e7a0f req-5908f808-b061-4022-8e6a-a9b32af2c215 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e8a9d1ae-317b-4512-ab2e-cfd40c4e7a0f req-5908f808-b061-4022-8e6a-a9b32af2c215 service nova] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e8a9d1ae-317b-4512-ab2e-cfd40c4e7a0f req-5908f808-b061-4022-8e6a-a9b32af2c215 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e8a9d1ae-317b-4512-ab2e-cfd40c4e7a0f req-5908f808-b061-4022-8e6a-a9b32af2c215 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:21 user nova-compute[74611]: DEBUG nova.compute.manager [req-e8a9d1ae-317b-4512-ab2e-cfd40c4e7a0f req-5908f808-b061-4022-8e6a-a9b32af2c215 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] No waiting events found dispatching network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:21 user nova-compute[74611]: WARNING nova.compute.manager [req-e8a9d1ae-317b-4512-ab2e-cfd40c4e7a0f req-5908f808-b061-4022-8e6a-a9b32af2c215 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received unexpected event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d for instance with vm_state resized and task_state resize_reverting.
Nov 13 10:04:22 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:04:22 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:04:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.565s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:22 user nova-compute[74611]: INFO nova.compute.manager [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Swapping old allocation on dict_keys(['f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a']) held by migration 4853187a-b106-42a3-9133-dece359c134e for instance
Nov 13 10:04:22 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Overwriting current allocation {'allocations': {'f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 38}}, 'project_id': 'a1fb42835d7f49cbaad21eee295c7692', 'user_id': '396adec28c0d44a0aefb1229090f90d5', 'consumer_generation': 1} on consumer 635636ea-96a0-4fdb-85a1-ca7a87b762f0 {{(pid=74611) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 13 10:04:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:04:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquired lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:04:22 user nova-compute[74611]: DEBUG nova.network.neutron [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG nova.compute.manager [req-6154c84d-c158-483e-9caa-a161759159ab req-d62ec56e-1401-4e14-b6f1-90d5c28e9806 service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received event network-changed-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG nova.compute.manager [req-6154c84d-c158-483e-9caa-a161759159ab req-d62ec56e-1401-4e14-b6f1-90d5c28e9806 service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Refreshing instance network info cache due to event network-changed-a102bae6-0d19-44c8-9aed-ea01e72e4d11. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6154c84d-c158-483e-9caa-a161759159ab req-d62ec56e-1401-4e14-b6f1-90d5c28e9806 service nova] Acquiring lock "refresh_cache-7eff589b-8f0f-4e6e-ac04-567da455e579" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6154c84d-c158-483e-9caa-a161759159ab req-d62ec56e-1401-4e14-b6f1-90d5c28e9806 service nova] Acquired lock "refresh_cache-7eff589b-8f0f-4e6e-ac04-567da455e579" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG nova.network.neutron [req-6154c84d-c158-483e-9caa-a161759159ab req-d62ec56e-1401-4e14-b6f1-90d5c28e9806 service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Refreshing network info cache for port a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG nova.network.neutron [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updating instance_info_cache with network_info: [{"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Releasing lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG os_brick.utils [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e98d81-1f7e-40a3-a844-01698595f7c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4290e8-33ba-4042-9339-c510b5a48e5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2e029f-e6c8-42d4-a9b7-a4730c927eb4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a8b241-87f3-48d7-bc0a-edc06225c120]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:04:23 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e925baf1-16ff-4bee-aac4-49547041bf27]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG os_brick.utils [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG nova.network.neutron [req-6154c84d-c158-483e-9caa-a161759159ab req-d62ec56e-1401-4e14-b6f1-90d5c28e9806 service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Updated VIF entry in instance network info cache for port a102bae6-0d19-44c8-9aed-ea01e72e4d11. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG nova.network.neutron [req-6154c84d-c158-483e-9caa-a161759159ab req-d62ec56e-1401-4e14-b6f1-90d5c28e9806 service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Updating instance_info_cache with network_info: [{"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "7eff589b-8f0f-4e6e-ac04-567da455e579" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG nova.objects.instance [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lazy-loading 'flavor' on Instance uuid 7eff589b-8f0f-4e6e-ac04-567da455e579 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6154c84d-c158-483e-9caa-a161759159ab req-d62ec56e-1401-4e14-b6f1-90d5c28e9806 service nova] Releasing lock "refresh_cache-7eff589b-8f0f-4e6e-ac04-567da455e579" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:04:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.179s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "7eff589b-8f0f-4e6e-ac04-567da455e579" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:24 user nova-compute[74611]: INFO nova.compute.manager [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Attaching volume 850f4d3b-4cca-4326-8997-caaaaf606a40 to /dev/vdb
Nov 13 10:04:24 user nova-compute[74611]: DEBUG os_brick.utils [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[540a96be-5af9-4905-9d9a-5b4df37daab4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a21101c-3327-4c6e-936c-813b509886e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[277abd8c-90d4-4cba-91f6-5d8368a80f23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd5ad8c-15d1-4b30-89b4-55c3549d87be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:04:24 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:04:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5855248a-5ab3-453f-a1e9-62c5bbb88007]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG os_brick.utils [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Updating existing volume attachment record: 9eb6bd9c-47bb-44e7-9c1f-1b7e163137b7 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:04:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Starting finish_revert_migration {{(pid=74611) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Start _get_guest_xml network_info=[{"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': '03ab35ae-0c56-4931-b89f-63f0520df8ea', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQfyJOvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '635636ea-96a0-4fdb-85a1-ca7a87b762f0', 'attached_at': '2023-11-13T10:04:27.000000', 'detached_at': '', 'volume_id': 'c9fb42e8-06d6-42aa-a06c-142251173f9f', 'serial': 'c9fb42e8-06d6-42aa-a06c-142251173f9f'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:04:27 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:04:27 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.objects.instance [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lazy-loading 'vcpu_model' on Instance uuid 635636ea-96a0-4fdb-85a1-ca7a87b762f0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQfyJOvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:04:27 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:04:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:04:27 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:04:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:04:27 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec68665-4113-4e0d-80a7-433287388b73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:04:27 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[effc7d91-bc16-458a-8ee2-a4be4c2d2ad3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f] added
Nov 13 10:04:27 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de832c5-7074-481a-a294-db39a335a391]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f03ce69-4170-4751-8336-931db6dec312]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQfyJOvn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQfyJOvn" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95b47b6-ec09-4816-859a-42a9f10925ae]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eQfyJOvn'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7097ada5-19c3-4e04-a623-83befdf3652f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee6fd62-362a-4fa4-b2be-e7975bd57dc5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:27 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:27 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:27 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:04:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:27 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:27 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:27 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --login" returned: 0 in 0.180s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f494fd79-0741-47a7-aaa8-e1b8774c9aae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260]
Nov 13 10:04:28 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260] successful.
Nov 13 10:04:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[346ad2a7-8b2d-4e0d-a16e-e7aee3fd1abf]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61fc2ba-3b7d-4007-8f3e-0ec6802de797]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:28 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:28 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:28 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:28 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:28 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:28 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d67bb7c-041b-4daf-8a92-93fffa577d68]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQfyJOvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:04:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yusMKrpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:04:28 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:04:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.519s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] <== connect_volume: return (1521ms) {'type': 'block', 'scsi_wwn': '26564353365666465', 'path': '/dev/sde'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564353365666465', 'path': '/dev/sde'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.666s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:04:29 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:04:29 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81b6c61-5083-4882-a422-b4e3f60176ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:04:29 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1214168652',display_name='tempest-ServerActionsTestOtherB-server-1214168652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1214168652',id=21,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDWkg3C+Ons0/sduU7bCkNdUaQmui4Ar0pDJw7KSIbqtW1jWjrtKiyZ8w8dVwpvUbMKS1UF1ykPykLHc0hyTfyxEKKXaxiPgUkE/a0u6OsQxRK/HJgxNowuqXz8Zc+KMg==',key_name='tempest-keypair-1038082490',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:02:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1fb42835d7f49cbaad21eee295c7692',ramdisk_id='',reservation_id='r-yeac67tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-840608963',owner_user_name='tempest-ServerActionsTestOtherB-840608963-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='396adec28c0d44a0aefb1229090f90d5',uuid=635636ea-96a0-4fdb-85a1-ca7a87b762f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converting VIF {"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:04:29 user nova-compute[74611]:   <uuid>635636ea-96a0-4fdb-85a1-ca7a87b762f0</uuid>
Nov 13 10:04:29 user nova-compute[74611]:   <name>instance-00000015</name>
Nov 13 10:04:29 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:04:29 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:04:29 user nova-compute[74611]:   <metadata>
Nov 13 10:04:29 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:04:29 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:04:29 user nova-compute[74611]:       <nova:name>tempest-ServerActionsTestOtherB-server-1214168652</nova:name>
Nov 13 10:04:29 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:04:27</nova:creationTime>
Nov 13 10:04:29 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:04:29 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:04:29 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:04:29 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:04:29 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:04:29 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:04:29 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:04:29 user nova-compute[74611]:       <nova:owner>
Nov 13 10:04:29 user nova-compute[74611]:         <nova:user uuid="396adec28c0d44a0aefb1229090f90d5">tempest-ServerActionsTestOtherB-840608963-project-member</nova:user>
Nov 13 10:04:29 user nova-compute[74611]:         <nova:project uuid="a1fb42835d7f49cbaad21eee295c7692">tempest-ServerActionsTestOtherB-840608963</nova:project>
Nov 13 10:04:29 user nova-compute[74611]:       </nova:owner>
Nov 13 10:04:29 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:04:29 user nova-compute[74611]:       <nova:ports>
Nov 13 10:04:29 user nova-compute[74611]:         <nova:port uuid="9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d">
Nov 13 10:04:29 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 10:04:29 user nova-compute[74611]:         </nova:port>
Nov 13 10:04:29 user nova-compute[74611]:       </nova:ports>
Nov 13 10:04:29 user nova-compute[74611]:     </nova:instance>
Nov 13 10:04:29 user nova-compute[74611]:   </metadata>
Nov 13 10:04:29 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:04:29 user nova-compute[74611]:     <system>
Nov 13 10:04:29 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:04:29 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:04:29 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:04:29 user nova-compute[74611]:       <entry name="serial">635636ea-96a0-4fdb-85a1-ca7a87b762f0</entry>
Nov 13 10:04:29 user nova-compute[74611]:       <entry name="uuid">635636ea-96a0-4fdb-85a1-ca7a87b762f0</entry>
Nov 13 10:04:29 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:04:29 user nova-compute[74611]:     </system>
Nov 13 10:04:29 user nova-compute[74611]:   </sysinfo>
Nov 13 10:04:29 user nova-compute[74611]:   <os>
Nov 13 10:04:29 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:04:29 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:04:29 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:04:29 user nova-compute[74611]:   </os>
Nov 13 10:04:29 user nova-compute[74611]:   <features>
Nov 13 10:04:29 user nova-compute[74611]:     <acpi/>
Nov 13 10:04:29 user nova-compute[74611]:     <apic/>
Nov 13 10:04:29 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:04:29 user nova-compute[74611]:   </features>
Nov 13 10:04:29 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:04:29 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:04:29 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:04:29 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:04:29 user nova-compute[74611]:   </clock>
Nov 13 10:04:29 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:04:29 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:04:29 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:04:29 user nova-compute[74611]:   </cpu>
Nov 13 10:04:29 user nova-compute[74611]:   <devices>
Nov 13 10:04:29 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:04:29 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:04:29 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk"/>
Nov 13 10:04:29 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:04:29 user nova-compute[74611]:     </disk>
Nov 13 10:04:29 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:04:29 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:04:29 user nova-compute[74611]:       <source dev="/dev/sde"/>
Nov 13 10:04:29 user nova-compute[74611]:       <target dev="vdb" bus="virtio"/>
Nov 13 10:04:29 user nova-compute[74611]:       <serial>c9fb42e8-06d6-42aa-a06c-142251173f9f</serial>
Nov 13 10:04:29 user nova-compute[74611]:     </disk>
Nov 13 10:04:29 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:04:29 user nova-compute[74611]:       <mac address="fa:16:3e:f5:e2:a3"/>
Nov 13 10:04:29 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:04:29 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:04:29 user nova-compute[74611]:       <target dev="tap9ff4d9c6-a2"/>
Nov 13 10:04:29 user nova-compute[74611]:     </interface>
Nov 13 10:04:29 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:04:29 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/console.log" append="off"/>
Nov 13 10:04:29 user nova-compute[74611]:     </serial>
Nov 13 10:04:29 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:04:29 user nova-compute[74611]:     <video>
Nov 13 10:04:29 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:04:29 user nova-compute[74611]:     </video>
Nov 13 10:04:29 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:04:29 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:04:29 user nova-compute[74611]:     </rng>
Nov 13 10:04:29 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:04:29 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:04:29 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:04:29 user nova-compute[74611]:     </memballoon>
Nov 13 10:04:29 user nova-compute[74611]:   </devices>
Nov 13 10:04:29 user nova-compute[74611]: </domain>
Nov 13 10:04:29 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1214168652',display_name='tempest-ServerActionsTestOtherB-server-1214168652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1214168652',id=21,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDWkg3C+Ons0/sduU7bCkNdUaQmui4Ar0pDJw7KSIbqtW1jWjrtKiyZ8w8dVwpvUbMKS1UF1ykPykLHc0hyTfyxEKKXaxiPgUkE/a0u6OsQxRK/HJgxNowuqXz8Zc+KMg==',key_name='tempest-keypair-1038082490',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:02:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1fb42835d7f49cbaad21eee295c7692',ramdisk_id='',reservation_id='r-yeac67tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-840608963',owner_user_name='tempest-ServerActionsTestOtherB-840608963-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='396adec28c0d44a0aefb1229090f90d5',uuid=635636ea-96a0-4fdb-85a1-ca7a87b762f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converting VIF {"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_vif [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab36b041-07a0-547b-b4c0-73d2ad864388', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fec2d3-193e-4bdb-b252-8409ca6fc6bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40] added
Nov 13 10:04:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ff4d9c6-a2, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ff4d9c6-a2, col_values=(('qos', UUID('c1e485d3-d5ec-4893-a905-501477e481b9')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ff4d9c6-a2, col_values=(('external_ids', {'iface-id': '9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:e2:a3', 'vm-uuid': '635636ea-96a0-4fdb-85a1-ca7a87b762f0'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b234500-c570-45fb-82f7-59a81af7833b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:29 user nova-compute[74611]: INFO os_vif [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2')
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c2b9ac-365f-4833-a54f-6530bf116d4d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yusMKrpF {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yusMKrpF" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42930b1-302f-4267-9ed1-1673cb5717c5]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yusMKrpF'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fd9a79-dd19-4270-8013-e114315c854d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eda1614-27c1-401d-9823-028b46c1edb6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:29 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:29 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:29 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:29 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:29 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:29 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f850ffc4-880e-4573-b32b-33d6fd66384a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40, portal: 172.16.0.220,3260]
Nov 13 10:04:29 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40, portal: 172.16.0.220,3260] successful.
Nov 13 10:04:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bdf2d4-768c-44ba-91e6-87124dc55bfe]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[373e40a8-e227-4ca7-ba4d-19bcc779d2d1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:29 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:29 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:29 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:29 user nova-compute[74611]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:04:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:29 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:29 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:29 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:29 user nova-compute[74611]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:04:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d277f6-877d-4703-8312-4fb85cdc06d3]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:04:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yusMKrpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:04:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:04:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] <== connect_volume: return (2026ms) {'type': 'block', 'scsi_wwn': '23866333036666436', 'path': '/dev/sdf'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:04:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866333036666436', 'path': '/dev/sdf'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:04:30 user nova-compute[74611]: DEBUG nova.objects.instance [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lazy-loading 'flavor' on Instance uuid 7eff589b-8f0f-4e6e-ac04-567da455e579 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:04:30 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:04:30 user nova-compute[74611]:   <source dev="/dev/sdf"/>
Nov 13 10:04:30 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:04:30 user nova-compute[74611]:   <serial>850f4d3b-4cca-4326-8997-caaaaf606a40</serial>
Nov 13 10:04:30 user nova-compute[74611]: </disk>
Nov 13 10:04:30 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:04:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:31 user nova-compute[74611]: DEBUG nova.compute.manager [req-7ffb13cd-0106-4f0a-b971-02395e7a6e22 req-d68fcec1-ce64-476b-bdda-b0c2cd257167 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7ffb13cd-0106-4f0a-b971-02395e7a6e22 req-d68fcec1-ce64-476b-bdda-b0c2cd257167 service nova] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7ffb13cd-0106-4f0a-b971-02395e7a6e22 req-d68fcec1-ce64-476b-bdda-b0c2cd257167 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7ffb13cd-0106-4f0a-b971-02395e7a6e22 req-d68fcec1-ce64-476b-bdda-b0c2cd257167 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:31 user nova-compute[74611]: DEBUG nova.compute.manager [req-7ffb13cd-0106-4f0a-b971-02395e7a6e22 req-d68fcec1-ce64-476b-bdda-b0c2cd257167 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] No waiting events found dispatching network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:31 user nova-compute[74611]: WARNING nova.compute.manager [req-7ffb13cd-0106-4f0a-b971-02395e7a6e22 req-d68fcec1-ce64-476b-bdda-b0c2cd257167 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received unexpected event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d for instance with vm_state resized and task_state resize_reverting.
Nov 13 10:04:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:04:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:04:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] No VIF found with MAC fa:16:3e:8b:04:f1, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:04:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-05ea2872-4639-489f-a1d1-cbde71e52bdb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.247s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:32 user nova-compute[74611]: INFO nova.compute.manager [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Rebuilding instance
Nov 13 10:04:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:04:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-2f45fc2f-9827-4f88-868a-9d1f5fdbeafe req-a2d0deb1-24a5-4b83-a01c-0bd79b4e0a75 service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received event network-vif-unplugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2f45fc2f-9827-4f88-868a-9d1f5fdbeafe req-a2d0deb1-24a5-4b83-a01c-0bd79b4e0a75 service nova] Acquiring lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2f45fc2f-9827-4f88-868a-9d1f5fdbeafe req-a2d0deb1-24a5-4b83-a01c-0bd79b4e0a75 service nova] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2f45fc2f-9827-4f88-868a-9d1f5fdbeafe req-a2d0deb1-24a5-4b83-a01c-0bd79b4e0a75 service nova] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-2f45fc2f-9827-4f88-868a-9d1f5fdbeafe req-a2d0deb1-24a5-4b83-a01c-0bd79b4e0a75 service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] No waiting events found dispatching network-vif-unplugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:32 user nova-compute[74611]: WARNING nova.compute.manager [req-2f45fc2f-9827-4f88-868a-9d1f5fdbeafe req-a2d0deb1-24a5-4b83-a01c-0bd79b4e0a75 service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received unexpected event network-vif-unplugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 for instance with vm_state active and task_state rebuilding.
Nov 13 10:04:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-b6786d8d-797b-4242-a095-eb3a2402e58b req-5d6d913a-a772-48a3-b4c2-7f31deed31e4 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b6786d8d-797b-4242-a095-eb3a2402e58b req-5d6d913a-a772-48a3-b4c2-7f31deed31e4 service nova] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b6786d8d-797b-4242-a095-eb3a2402e58b req-5d6d913a-a772-48a3-b4c2-7f31deed31e4 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b6786d8d-797b-4242-a095-eb3a2402e58b req-5d6d913a-a772-48a3-b4c2-7f31deed31e4 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-b6786d8d-797b-4242-a095-eb3a2402e58b req-5d6d913a-a772-48a3-b4c2-7f31deed31e4 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] No waiting events found dispatching network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:33 user nova-compute[74611]: WARNING nova.compute.manager [req-b6786d8d-797b-4242-a095-eb3a2402e58b req-5d6d913a-a772-48a3-b4c2-7f31deed31e4 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received unexpected event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d for instance with vm_state resized and task_state resize_reverting.
Nov 13 10:04:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:04:33 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Instance running successfully.
Nov 13 10:04:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] finish_revert_migration finished successfully. {{(pid=74611) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 13 10:04:33 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Instance destroyed successfully.
Nov 13 10:04:33 user nova-compute[74611]: INFO nova.compute.manager [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Detaching volume 850f4d3b-4cca-4326-8997-caaaaf606a40
Nov 13 10:04:33 user nova-compute[74611]: INFO nova.compute.manager [None req-52bbf3cb-e62e-43bb-a0ec-de0c06b149d9 tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updating instance to original state: 'active'
Nov 13 10:04:33 user nova-compute[74611]: INFO nova.virt.block_device [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Attempting to driver detach volume 850f4d3b-4cca-4326-8997-caaaaf606a40 from mountpoint /dev/vdb
Nov 13 10:04:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Attempting to detach device vdb from instance 7eff589b-8f0f-4e6e-ac04-567da455e579 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:04:33 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:04:33 user nova-compute[74611]:   <source dev="/dev/sdf"/>
Nov 13 10:04:33 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:04:33 user nova-compute[74611]:   <serial>850f4d3b-4cca-4326-8997-caaaaf606a40</serial>
Nov 13 10:04:33 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:04:33 user nova-compute[74611]: </disk>
Nov 13 10:04:33 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:04:33 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Successfully detached device vdb from instance 7eff589b-8f0f-4e6e-ac04-567da455e579 from the persistent domain config.
Nov 13 10:04:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yusMKrpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:04:33 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9bf659-4486-43b9-a468-f04f32068112]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:04:33 user nova-compute[74611]: No targets found.
Nov 13 10:04:33 user nova-compute[74611]: iSNS:
Nov 13 10:04:33 user nova-compute[74611]: No targets found.
Nov 13 10:04:33 user nova-compute[74611]: STATIC:
Nov 13 10:04:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f
Nov 13 10:04:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d
Nov 13 10:04:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40
Nov 13 10:04:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd
Nov 13 10:04:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:04:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:33 user nova-compute[74611]: FIRMWARE:
Nov 13 10:04:33 user nova-compute[74611]: No targets found.
Nov 13 10:04:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:04:33 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:04:33 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b694f3-c972-47c8-b262-872d533669ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f0de38-d198-4289-af02-c2acad916090]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:33 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:33 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:33 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:33 user nova-compute[74611]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:04:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:33 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:33 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:33 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:33 user nova-compute[74611]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:04:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb646825f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40'): ({'sdf'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Removing single pathed devices sdf {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9391d287-05d4-48f8-ba78-630c6924506f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[29edcb49-f4d2-4e70-94fd-2acfd57559b4]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Flushing IO for device /dev/sdf {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc30e45d-fa64-421c-bf86-247cbde153bb]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad95700e-0e8b-4207-a188-1bd020354caf]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] SCSI volumes sdf have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[02562465-2db9-4246-af69-ffe1150d9c88]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4768995-e269-4057-8827-69724f268299]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40, portal: 172.16.0.220,3260]
Nov 13 10:04:33 user nova-compute[74611]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40, portal: 172.16.0.220,3260] successful.
Nov 13 10:04:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0b0a2b-1109-4ec4-a19a-8b6bb1b5710e]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] <== disconnect_volume: return (360ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Instance destroyed successfully.
Nov 13 10:04:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-645946469',display_name='tempest-ServerActionsTestOtherA-server-1200695120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-645946469',id=30,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMgiZS8iDWJccUoJm8Cr1Cy30m8ExeWrxEP4qRo7zR0nLwbMSKbTx4l1ShW9U7NI1irrxVZ/xJYIVnbYASt5DAgSuA5M9ZDOJFAOj03z1hM3/11AHFBM2VNKmeseRl6Ng==',key_name='tempest-keypair-620803101',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:02:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e6a0b0a078bd44908cd7cd4593914eef',ramdisk_id='',reservation_id='r-0cttspsb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2135577355',owner_user_name='tempest-ServerActionsTestOtherA-2135577355-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:04:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22322be2dd04410b6cd53c31e639b3b',uuid=7eff589b-8f0f-4e6e-ac04-567da455e579,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converting VIF {"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=a102bae6-0d19-44c8-9aed-ea01e72e4d11,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa102bae6-0d') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG os_vif [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=a102bae6-0d19-44c8-9aed-ea01e72e4d11,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa102bae6-0d') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa102bae6-0d, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6f14531-9b51-4106-aebe-507faeee21dd) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:34 user nova-compute[74611]: INFO os_vif [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=a102bae6-0d19-44c8-9aed-ea01e72e4d11,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa102bae6-0d')
Nov 13 10:04:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yusMKrpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:04:34 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 10:04:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf3edd1-32ec-4f88-bdf1-cb27868ffb49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:04:34 user nova-compute[74611]: No targets found.
Nov 13 10:04:34 user nova-compute[74611]: iSNS:
Nov 13 10:04:34 user nova-compute[74611]: No targets found.
Nov 13 10:04:34 user nova-compute[74611]: STATIC:
Nov 13 10:04:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f
Nov 13 10:04:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d
Nov 13 10:04:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd
Nov 13 10:04:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:04:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:34 user nova-compute[74611]: FIRMWARE:
Nov 13 10:04:34 user nova-compute[74611]: No targets found.
Nov 13 10:04:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:04:34 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:04:34 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e846b95a-ca70-4168-83f6-6590e74b7b38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac219c6-caf0-4fc8-80b9-3dc213a1a9ef]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:34 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:34 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:34 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:34 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:34 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:34 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb642953f0>, {}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Disconnecting from: [] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] <== disconnect_volume: return (81ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:04:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:04:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Deleting instance files /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579_del
Nov 13 10:04:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Deletion of /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579_del complete
Nov 13 10:04:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-b2007efc-b44e-4b64-8885-07093a376ab0 req-66e48207-e37d-4335-b230-7d08fee37b7a service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received event network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b2007efc-b44e-4b64-8885-07093a376ab0 req-66e48207-e37d-4335-b230-7d08fee37b7a service nova] Acquiring lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b2007efc-b44e-4b64-8885-07093a376ab0 req-66e48207-e37d-4335-b230-7d08fee37b7a service nova] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b2007efc-b44e-4b64-8885-07093a376ab0 req-66e48207-e37d-4335-b230-7d08fee37b7a service nova] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-b2007efc-b44e-4b64-8885-07093a376ab0 req-66e48207-e37d-4335-b230-7d08fee37b7a service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] No waiting events found dispatching network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:35 user nova-compute[74611]: WARNING nova.compute.manager [req-b2007efc-b44e-4b64-8885-07093a376ab0 req-66e48207-e37d-4335-b230-7d08fee37b7a service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received unexpected event network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 for instance with vm_state active and task_state rebuilding.
Nov 13 10:04:35 user nova-compute[74611]: INFO nova.virt.block_device [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Booting with volume 850f4d3b-4cca-4326-8997-caaaaf606a40 at /dev/vdb
Nov 13 10:04:35 user nova-compute[74611]: DEBUG os_brick.utils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] There are 0 instances to clean {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac12ccb8-498e-48c6-b0c4-b5721aa49bf1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28f213d-8fce-44f4-b969-be008ee36e6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8b0a22-106a-4543-9bef-b4af14e2ab61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b914134c-1f8c-41c7-ba8a-d0f03998da33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:04:35 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:04:35 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3103a6cf-0d26-4b62-904e-97065e0840a1]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG os_brick.utils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:04:35 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Updating existing volume attachment record: de544288-d597-4d64-b659-d9134037c1b8 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:04:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Acquiring lock "9e5b488b-a309-465f-8276-b24cb0d88888" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "9e5b488b-a309-465f-8276-b24cb0d88888" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:38 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:04:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:38 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:04:38 user nova-compute[74611]: INFO nova.compute.claims [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Claim successful on node user
Nov 13 10:04:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.581s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:04:39 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:04:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG nova.policy [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '505ed8495612439cbc5dcf5fd32e0a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b501aee216574b75a8f03ddaeebcf292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:04:39 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Creating image(s)
Nov 13 10:04:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "/opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "/opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.220s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk 1073741824" returned: 0 in 0.062s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Updating instance_info_cache with network_info: [{"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:04:40 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Creating image(s)
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "/opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "/opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "/opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Successfully created port: ad463560-037c-4266-8570-3eb8adbc06a8 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.183s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Cannot resize image /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Ensure instance console log exists: /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk 1073741824" returned: 0 in 0.048s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Cannot resize image /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Ensure instance console log exists: /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Start _get_guest_xml network_info=[{"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'de544288-d597-4d64-b659-d9134037c1b8', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yusMKrpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7eff589b-8f0f-4e6e-ac04-567da455e579', 'attached_at': '', 'detached_at': '', 'volume_id': '850f4d3b-4cca-4326-8997-caaaaf606a40', 'serial': '850f4d3b-4cca-4326-8997-caaaaf606a40'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:04:40 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 10:04:40 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 10:04:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.objects.instance [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7eff589b-8f0f-4e6e-ac04-567da455e579 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Successfully updated port: ad463560-037c-4266-8570-3eb8adbc06a8 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yusMKrpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:04:41 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:04:41 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:04:41 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.compute.manager [req-fd98d55d-c22d-42c4-bae5-0dd9a6f9f883 req-d0799c76-b750-483d-8db0-c64fdee1a06f service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Received event network-changed-ad463560-037c-4266-8570-3eb8adbc06a8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.compute.manager [req-fd98d55d-c22d-42c4-bae5-0dd9a6f9f883 req-d0799c76-b750-483d-8db0-c64fdee1a06f service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Refreshing instance network info cache due to event network-changed-ad463560-037c-4266-8570-3eb8adbc06a8. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fd98d55d-c22d-42c4-bae5-0dd9a6f9f883 req-d0799c76-b750-483d-8db0-c64fdee1a06f service nova] Acquiring lock "refresh_cache-9e5b488b-a309-465f-8276-b24cb0d88888" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fd98d55d-c22d-42c4-bae5-0dd9a6f9f883 req-d0799c76-b750-483d-8db0-c64fdee1a06f service nova] Acquired lock "refresh_cache-9e5b488b-a309-465f-8276-b24cb0d88888" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.network.neutron [req-fd98d55d-c22d-42c4-bae5-0dd9a6f9f883 req-d0799c76-b750-483d-8db0-c64fdee1a06f service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Refreshing network info cache for port ad463560-037c-4266-8570-3eb8adbc06a8 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Acquiring lock "refresh_cache-9e5b488b-a309-465f-8276-b24cb0d88888" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[478b9215-abb1-41b6-ab89-efc886b3573a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:04:41 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f0c6cc-0a7d-4768-8907-a57b8225ffad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40] added
Nov 13 10:04:41 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a1cf71-61fe-4042-bcbe-f4984ccd3ed8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.network.neutron [req-fd98d55d-c22d-42c4-bae5-0dd9a6f9f883 req-d0799c76-b750-483d-8db0-c64fdee1a06f service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5587eb-4516-4de2-b5a9-8cf60b714c20]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yusMKrpF {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yusMKrpF" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9571706-f513-48ec-81c5-f2daedd7ed93]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yusMKrpF'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[176722c5-f092-4b57-a7a9-326256ff743b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf12c4af-aed8-4e70-a109-b6a7831c079c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:41 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:41 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:41 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:41 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:41 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:41 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:41 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:41 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.network.neutron [req-fd98d55d-c22d-42c4-bae5-0dd9a6f9f883 req-d0799c76-b750-483d-8db0-c64fdee1a06f service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fd98d55d-c22d-42c4-bae5-0dd9a6f9f883 req-d0799c76-b750-483d-8db0-c64fdee1a06f service nova] Releasing lock "refresh_cache-9e5b488b-a309-465f-8276-b24cb0d88888" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Acquired lock "refresh_cache-9e5b488b-a309-465f-8276-b24cb0d88888" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[230b02b4-1a1e-4d5a-950f-e31e3bdda633]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40, portal: 172.16.0.220,3260]
Nov 13 10:04:41 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40, portal: 172.16.0.220,3260] successful.
Nov 13 10:04:41 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a9e145-ccd1-45e4-834a-56e5338905ca]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6688493e-e635-4ec8-846a-7831d2af2067]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:41 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:41 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:41 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:41 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:04:41 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:41 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:41 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:41 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:41 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:04:41 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b198162-a2f7-4f00-bd29-8f1388ae836a]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yusMKrpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:04:41 user nova-compute[74611]: DEBUG nova.network.neutron [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Updating instance_info_cache with network_info: [{"id": "ad463560-037c-4266-8570-3eb8adbc06a8", "address": "fa:16:3e:de:7c:24", "network": {"id": "3f2d42fb-380b-41fc-8da0-3f60aa59de75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1201487217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b501aee216574b75a8f03ddaeebcf292", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad463560-03", "ovs_interfaceid": "ad463560-037c-4266-8570-3eb8adbc06a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Releasing lock "refresh_cache-9e5b488b-a309-465f-8276-b24cb0d88888" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Instance network_info: |[{"id": "ad463560-037c-4266-8570-3eb8adbc06a8", "address": "fa:16:3e:de:7c:24", "network": {"id": "3f2d42fb-380b-41fc-8da0-3f60aa59de75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1201487217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b501aee216574b75a8f03ddaeebcf292", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad463560-03", "ovs_interfaceid": "ad463560-037c-4266-8570-3eb8adbc06a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Start _get_guest_xml network_info=[{"id": "ad463560-037c-4266-8570-3eb8adbc06a8", "address": "fa:16:3e:de:7c:24", "network": {"id": "3f2d42fb-380b-41fc-8da0-3f60aa59de75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1201487217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b501aee216574b75a8f03ddaeebcf292", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad463560-03", "ovs_interfaceid": "ad463560-037c-4266-8570-3eb8adbc06a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:04:42 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:04:42 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1150832439',display_name='tempest-DeleteServersTestJSON-server-1150832439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1150832439',id=34,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b501aee216574b75a8f03ddaeebcf292',ramdisk_id='',reservation_id='r-0j4gu0rr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-798365249',owner_user_name='tempest-DeleteServersTestJSON-798365249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:04:39Z,user_data=None,user_id='505ed8495612439cbc5dcf5fd32e0a4d',uuid=9e5b488b-a309-465f-8276-b24cb0d88888,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad463560-037c-4266-8570-3eb8adbc06a8", "address": "fa:16:3e:de:7c:24", "network": {"id": "3f2d42fb-380b-41fc-8da0-3f60aa59de75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1201487217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b501aee216574b75a8f03ddaeebcf292", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad463560-03", "ovs_interfaceid": "ad463560-037c-4266-8570-3eb8adbc06a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Converting VIF {"id": "ad463560-037c-4266-8570-3eb8adbc06a8", "address": "fa:16:3e:de:7c:24", "network": {"id": "3f2d42fb-380b-41fc-8da0-3f60aa59de75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1201487217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b501aee216574b75a8f03ddaeebcf292", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad463560-03", "ovs_interfaceid": "ad463560-037c-4266-8570-3eb8adbc06a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:7c:24,bridge_name='br-int',has_traffic_filtering=True,id=ad463560-037c-4266-8570-3eb8adbc06a8,network=Network(3f2d42fb-380b-41fc-8da0-3f60aa59de75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad463560-03') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.objects.instance [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e5b488b-a309-465f-8276-b24cb0d88888 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:04:42 user nova-compute[74611]:   <uuid>9e5b488b-a309-465f-8276-b24cb0d88888</uuid>
Nov 13 10:04:42 user nova-compute[74611]:   <name>instance-00000022</name>
Nov 13 10:04:42 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:04:42 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:04:42 user nova-compute[74611]:   <metadata>
Nov 13 10:04:42 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:04:42 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:04:42 user nova-compute[74611]:       <nova:name>tempest-DeleteServersTestJSON-server-1150832439</nova:name>
Nov 13 10:04:42 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:04:42</nova:creationTime>
Nov 13 10:04:42 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:04:42 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:04:42 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:04:42 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:04:42 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:04:42 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:04:42 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:04:42 user nova-compute[74611]:       <nova:owner>
Nov 13 10:04:42 user nova-compute[74611]:         <nova:user uuid="505ed8495612439cbc5dcf5fd32e0a4d">tempest-DeleteServersTestJSON-798365249-project-member</nova:user>
Nov 13 10:04:42 user nova-compute[74611]:         <nova:project uuid="b501aee216574b75a8f03ddaeebcf292">tempest-DeleteServersTestJSON-798365249</nova:project>
Nov 13 10:04:42 user nova-compute[74611]:       </nova:owner>
Nov 13 10:04:42 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:04:42 user nova-compute[74611]:       <nova:ports>
Nov 13 10:04:42 user nova-compute[74611]:         <nova:port uuid="ad463560-037c-4266-8570-3eb8adbc06a8">
Nov 13 10:04:42 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 10:04:42 user nova-compute[74611]:         </nova:port>
Nov 13 10:04:42 user nova-compute[74611]:       </nova:ports>
Nov 13 10:04:42 user nova-compute[74611]:     </nova:instance>
Nov 13 10:04:42 user nova-compute[74611]:   </metadata>
Nov 13 10:04:42 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:04:42 user nova-compute[74611]:     <system>
Nov 13 10:04:42 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:04:42 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:04:42 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:04:42 user nova-compute[74611]:       <entry name="serial">9e5b488b-a309-465f-8276-b24cb0d88888</entry>
Nov 13 10:04:42 user nova-compute[74611]:       <entry name="uuid">9e5b488b-a309-465f-8276-b24cb0d88888</entry>
Nov 13 10:04:42 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:04:42 user nova-compute[74611]:     </system>
Nov 13 10:04:42 user nova-compute[74611]:   </sysinfo>
Nov 13 10:04:42 user nova-compute[74611]:   <os>
Nov 13 10:04:42 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:04:42 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:04:42 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:04:42 user nova-compute[74611]:   </os>
Nov 13 10:04:42 user nova-compute[74611]:   <features>
Nov 13 10:04:42 user nova-compute[74611]:     <acpi/>
Nov 13 10:04:42 user nova-compute[74611]:     <apic/>
Nov 13 10:04:42 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:04:42 user nova-compute[74611]:   </features>
Nov 13 10:04:42 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:04:42 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:04:42 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:04:42 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:04:42 user nova-compute[74611]:   </clock>
Nov 13 10:04:42 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:04:42 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:04:42 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:04:42 user nova-compute[74611]:   </cpu>
Nov 13 10:04:42 user nova-compute[74611]:   <devices>
Nov 13 10:04:42 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:04:42 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:04:42 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk"/>
Nov 13 10:04:42 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:04:42 user nova-compute[74611]:     </disk>
Nov 13 10:04:42 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:04:42 user nova-compute[74611]:       <mac address="fa:16:3e:de:7c:24"/>
Nov 13 10:04:42 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:04:42 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:04:42 user nova-compute[74611]:       <target dev="tapad463560-03"/>
Nov 13 10:04:42 user nova-compute[74611]:     </interface>
Nov 13 10:04:42 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:04:42 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/console.log" append="off"/>
Nov 13 10:04:42 user nova-compute[74611]:     </serial>
Nov 13 10:04:42 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:04:42 user nova-compute[74611]:     <video>
Nov 13 10:04:42 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:04:42 user nova-compute[74611]:     </video>
Nov 13 10:04:42 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:04:42 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:04:42 user nova-compute[74611]:     </rng>
Nov 13 10:04:42 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:04:42 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:04:42 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:04:42 user nova-compute[74611]:     </memballoon>
Nov 13 10:04:42 user nova-compute[74611]:   </devices>
Nov 13 10:04:42 user nova-compute[74611]: </domain>
Nov 13 10:04:42 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1150832439',display_name='tempest-DeleteServersTestJSON-server-1150832439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1150832439',id=34,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b501aee216574b75a8f03ddaeebcf292',ramdisk_id='',reservation_id='r-0j4gu0rr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-798365249',owner_user_name='tempest-DeleteServersTestJSON-798365249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:04:39Z,user_data=None,user_id='505ed8495612439cbc5dcf5fd32e0a4d',uuid=9e5b488b-a309-465f-8276-b24cb0d88888,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad463560-037c-4266-8570-3eb8adbc06a8", "address": "fa:16:3e:de:7c:24", "network": {"id": "3f2d42fb-380b-41fc-8da0-3f60aa59de75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1201487217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b501aee216574b75a8f03ddaeebcf292", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad463560-03", "ovs_interfaceid": "ad463560-037c-4266-8570-3eb8adbc06a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Converting VIF {"id": "ad463560-037c-4266-8570-3eb8adbc06a8", "address": "fa:16:3e:de:7c:24", "network": {"id": "3f2d42fb-380b-41fc-8da0-3f60aa59de75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1201487217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b501aee216574b75a8f03ddaeebcf292", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad463560-03", "ovs_interfaceid": "ad463560-037c-4266-8570-3eb8adbc06a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:7c:24,bridge_name='br-int',has_traffic_filtering=True,id=ad463560-037c-4266-8570-3eb8adbc06a8,network=Network(3f2d42fb-380b-41fc-8da0-3f60aa59de75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad463560-03') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG os_vif [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:7c:24,bridge_name='br-int',has_traffic_filtering=True,id=ad463560-037c-4266-8570-3eb8adbc06a8,network=Network(3f2d42fb-380b-41fc-8da0-3f60aa59de75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad463560-03') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e30cf24d-04ee-5854-9046-c3ab34dde681', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad463560-03, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad463560-03, col_values=(('qos', UUID('3e7743b9-c7a4-4bbc-8655-fb2d875deafa')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad463560-03, col_values=(('external_ids', {'iface-id': 'ad463560-037c-4266-8570-3eb8adbc06a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:7c:24', 'vm-uuid': '9e5b488b-a309-465f-8276-b24cb0d88888'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:42 user nova-compute[74611]: INFO os_vif [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:7c:24,bridge_name='br-int',has_traffic_filtering=True,id=ad463560-037c-4266-8570-3eb8adbc06a8,network=Network(3f2d42fb-380b-41fc-8da0-3f60aa59de75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad463560-03')
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] No VIF found with MAC fa:16:3e:de:7c:24, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23866333036666436', 'path': '/dev/sdf'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866333036666436', 'path': '/dev/sdf'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T10:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-645946469',display_name='tempest-ServerActionsTestOtherA-server-1200695120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-645946469',id=30,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMgiZS8iDWJccUoJm8Cr1Cy30m8ExeWrxEP4qRo7zR0nLwbMSKbTx4l1ShW9U7NI1irrxVZ/xJYIVnbYASt5DAgSuA5M9ZDOJFAOj03z1hM3/11AHFBM2VNKmeseRl6Ng==',key_name='tempest-keypair-620803101',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:02:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e6a0b0a078bd44908cd7cd4593914eef',ramdisk_id='',reservation_id='r-0cttspsb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2135577355',owner_user_name='tempest-ServerActionsTestOtherA-2135577355-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:04:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22322be2dd04410b6cd53c31e639b3b',uuid=7eff589b-8f0f-4e6e-ac04-567da455e579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converting VIF {"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=a102bae6-0d19-44c8-9aed-ea01e72e4d11,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa102bae6-0d') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:04:42 user nova-compute[74611]:   <uuid>7eff589b-8f0f-4e6e-ac04-567da455e579</uuid>
Nov 13 10:04:42 user nova-compute[74611]:   <name>instance-0000001e</name>
Nov 13 10:04:42 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:04:42 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:04:42 user nova-compute[74611]:   <metadata>
Nov 13 10:04:42 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:04:42 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:04:42 user nova-compute[74611]:       <nova:name>tempest-ServerActionsTestOtherA-server-1200695120</nova:name>
Nov 13 10:04:42 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:04:40</nova:creationTime>
Nov 13 10:04:42 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:04:42 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:04:42 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:04:42 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:04:42 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:04:42 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:04:42 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:04:42 user nova-compute[74611]:       <nova:owner>
Nov 13 10:04:42 user nova-compute[74611]:         <nova:user uuid="f22322be2dd04410b6cd53c31e639b3b">tempest-ServerActionsTestOtherA-2135577355-project-member</nova:user>
Nov 13 10:04:42 user nova-compute[74611]:         <nova:project uuid="e6a0b0a078bd44908cd7cd4593914eef">tempest-ServerActionsTestOtherA-2135577355</nova:project>
Nov 13 10:04:42 user nova-compute[74611]:       </nova:owner>
Nov 13 10:04:42 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:04:42 user nova-compute[74611]:       <nova:ports>
Nov 13 10:04:42 user nova-compute[74611]:         <nova:port uuid="a102bae6-0d19-44c8-9aed-ea01e72e4d11">
Nov 13 10:04:42 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 10:04:42 user nova-compute[74611]:         </nova:port>
Nov 13 10:04:42 user nova-compute[74611]:       </nova:ports>
Nov 13 10:04:42 user nova-compute[74611]:     </nova:instance>
Nov 13 10:04:42 user nova-compute[74611]:   </metadata>
Nov 13 10:04:42 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:04:42 user nova-compute[74611]:     <system>
Nov 13 10:04:42 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:04:42 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:04:42 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:04:42 user nova-compute[74611]:       <entry name="serial">7eff589b-8f0f-4e6e-ac04-567da455e579</entry>
Nov 13 10:04:42 user nova-compute[74611]:       <entry name="uuid">7eff589b-8f0f-4e6e-ac04-567da455e579</entry>
Nov 13 10:04:42 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:04:42 user nova-compute[74611]:     </system>
Nov 13 10:04:42 user nova-compute[74611]:   </sysinfo>
Nov 13 10:04:42 user nova-compute[74611]:   <os>
Nov 13 10:04:42 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:04:42 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:04:42 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:04:42 user nova-compute[74611]:   </os>
Nov 13 10:04:42 user nova-compute[74611]:   <features>
Nov 13 10:04:42 user nova-compute[74611]:     <acpi/>
Nov 13 10:04:42 user nova-compute[74611]:     <apic/>
Nov 13 10:04:42 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:04:42 user nova-compute[74611]:   </features>
Nov 13 10:04:42 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:04:42 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:04:42 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:04:42 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:04:42 user nova-compute[74611]:   </clock>
Nov 13 10:04:42 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:04:42 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:04:42 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:04:42 user nova-compute[74611]:   </cpu>
Nov 13 10:04:42 user nova-compute[74611]:   <devices>
Nov 13 10:04:42 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:04:42 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:04:42 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk"/>
Nov 13 10:04:42 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:04:42 user nova-compute[74611]:     </disk>
Nov 13 10:04:42 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:04:42 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:04:42 user nova-compute[74611]:       <source dev="/dev/sdf"/>
Nov 13 10:04:42 user nova-compute[74611]:       <target dev="vdb" bus="virtio"/>
Nov 13 10:04:42 user nova-compute[74611]:       <serial>850f4d3b-4cca-4326-8997-caaaaf606a40</serial>
Nov 13 10:04:42 user nova-compute[74611]:     </disk>
Nov 13 10:04:42 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:04:42 user nova-compute[74611]:       <mac address="fa:16:3e:8b:04:f1"/>
Nov 13 10:04:42 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:04:42 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:04:42 user nova-compute[74611]:       <target dev="tapa102bae6-0d"/>
Nov 13 10:04:42 user nova-compute[74611]:     </interface>
Nov 13 10:04:42 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:04:42 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/console.log" append="off"/>
Nov 13 10:04:42 user nova-compute[74611]:     </serial>
Nov 13 10:04:42 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:04:42 user nova-compute[74611]:     <video>
Nov 13 10:04:42 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:04:42 user nova-compute[74611]:     </video>
Nov 13 10:04:42 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:04:42 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:04:42 user nova-compute[74611]:     </rng>
Nov 13 10:04:42 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:04:42 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:04:42 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:04:42 user nova-compute[74611]:     </memballoon>
Nov 13 10:04:42 user nova-compute[74611]:   </devices>
Nov 13 10:04:42 user nova-compute[74611]: </domain>
Nov 13 10:04:42 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T10:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-645946469',display_name='tempest-ServerActionsTestOtherA-server-1200695120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-645946469',id=30,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMgiZS8iDWJccUoJm8Cr1Cy30m8ExeWrxEP4qRo7zR0nLwbMSKbTx4l1ShW9U7NI1irrxVZ/xJYIVnbYASt5DAgSuA5M9ZDOJFAOj03z1hM3/11AHFBM2VNKmeseRl6Ng==',key_name='tempest-keypair-620803101',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:02:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e6a0b0a078bd44908cd7cd4593914eef',ramdisk_id='',reservation_id='r-0cttspsb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2135577355',owner_user_name='tempest-ServerActionsTestOtherA-2135577355-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:04:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22322be2dd04410b6cd53c31e639b3b',uuid=7eff589b-8f0f-4e6e-ac04-567da455e579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converting VIF {"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=a102bae6-0d19-44c8-9aed-ea01e72e4d11,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa102bae6-0d') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG os_vif [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=a102bae6-0d19-44c8-9aed-ea01e72e4d11,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa102bae6-0d') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b1c7aab-39c0-579c-842e-97d8212263d3', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa102bae6-0d, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa102bae6-0d, col_values=(('qos', UUID('27042ac5-f547-4fe9-abd2-fff15697c14f')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa102bae6-0d, col_values=(('external_ids', {'iface-id': 'a102bae6-0d19-44c8-9aed-ea01e72e4d11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:04:f1', 'vm-uuid': '7eff589b-8f0f-4e6e-ac04-567da455e579'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:42 user nova-compute[74611]: INFO os_vif [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=a102bae6-0d19-44c8-9aed-ea01e72e4d11,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa102bae6-0d')
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:04:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] No VIF found with MAC fa:16:3e:8b:04:f1, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:04:43 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG nova.compute.manager [req-42f1ffee-016e-4753-b13c-15b8f5b8bf74 req-ee03a381-4307-4a83-abc0-cad7a4472ef6 service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Received event network-vif-plugged-ad463560-037c-4266-8570-3eb8adbc06a8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-42f1ffee-016e-4753-b13c-15b8f5b8bf74 req-ee03a381-4307-4a83-abc0-cad7a4472ef6 service nova] Acquiring lock "9e5b488b-a309-465f-8276-b24cb0d88888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-42f1ffee-016e-4753-b13c-15b8f5b8bf74 req-ee03a381-4307-4a83-abc0-cad7a4472ef6 service nova] Lock "9e5b488b-a309-465f-8276-b24cb0d88888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-42f1ffee-016e-4753-b13c-15b8f5b8bf74 req-ee03a381-4307-4a83-abc0-cad7a4472ef6 service nova] Lock "9e5b488b-a309-465f-8276-b24cb0d88888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG nova.compute.manager [req-42f1ffee-016e-4753-b13c-15b8f5b8bf74 req-ee03a381-4307-4a83-abc0-cad7a4472ef6 service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] No waiting events found dispatching network-vif-plugged-ad463560-037c-4266-8570-3eb8adbc06a8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:44 user nova-compute[74611]: WARNING nova.compute.manager [req-42f1ffee-016e-4753-b13c-15b8f5b8bf74 req-ee03a381-4307-4a83-abc0-cad7a4472ef6 service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Received unexpected event network-vif-plugged-ad463560-037c-4266-8570-3eb8adbc06a8 for instance with vm_state building and task_state spawning.
Nov 13 10:04:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG nova.compute.manager [req-11b55bac-1fb7-4635-ba89-bbe2f90a1907 req-891ac949-8f59-4cc2-bb15-449ea575861c service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received event network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-11b55bac-1fb7-4635-ba89-bbe2f90a1907 req-891ac949-8f59-4cc2-bb15-449ea575861c service nova] Acquiring lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-11b55bac-1fb7-4635-ba89-bbe2f90a1907 req-891ac949-8f59-4cc2-bb15-449ea575861c service nova] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-11b55bac-1fb7-4635-ba89-bbe2f90a1907 req-891ac949-8f59-4cc2-bb15-449ea575861c service nova] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:44 user nova-compute[74611]: DEBUG nova.compute.manager [req-11b55bac-1fb7-4635-ba89-bbe2f90a1907 req-891ac949-8f59-4cc2-bb15-449ea575861c service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] No waiting events found dispatching network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:44 user nova-compute[74611]: WARNING nova.compute.manager [req-11b55bac-1fb7-4635-ba89-bbe2f90a1907 req-891ac949-8f59-4cc2-bb15-449ea575861c service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received unexpected event network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 for instance with vm_state active and task_state rebuild_spawning.
Nov 13 10:04:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:45 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:04:45 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:04:45 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:04:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:46 user nova-compute[74611]: DEBUG nova.compute.manager [req-6ca34ff4-cdaf-4d02-975c-29154abbf26f req-d4c27701-8b71-4467-b0ad-8fe9d414af82 service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Received event network-vif-plugged-ad463560-037c-4266-8570-3eb8adbc06a8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6ca34ff4-cdaf-4d02-975c-29154abbf26f req-d4c27701-8b71-4467-b0ad-8fe9d414af82 service nova] Acquiring lock "9e5b488b-a309-465f-8276-b24cb0d88888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6ca34ff4-cdaf-4d02-975c-29154abbf26f req-d4c27701-8b71-4467-b0ad-8fe9d414af82 service nova] Lock "9e5b488b-a309-465f-8276-b24cb0d88888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6ca34ff4-cdaf-4d02-975c-29154abbf26f req-d4c27701-8b71-4467-b0ad-8fe9d414af82 service nova] Lock "9e5b488b-a309-465f-8276-b24cb0d88888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:46 user nova-compute[74611]: DEBUG nova.compute.manager [req-6ca34ff4-cdaf-4d02-975c-29154abbf26f req-d4c27701-8b71-4467-b0ad-8fe9d414af82 service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] No waiting events found dispatching network-vif-plugged-ad463560-037c-4266-8570-3eb8adbc06a8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:46 user nova-compute[74611]: WARNING nova.compute.manager [req-6ca34ff4-cdaf-4d02-975c-29154abbf26f req-d4c27701-8b71-4467-b0ad-8fe9d414af82 service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Received unexpected event network-vif-plugged-ad463560-037c-4266-8570-3eb8adbc06a8 for instance with vm_state building and task_state spawning.
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.compute.manager [req-9421a9e2-fed0-4eb3-955d-aa673bd73c28 req-3122b48e-c55b-40e8-af2b-f420063feddd service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received event network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9421a9e2-fed0-4eb3-955d-aa673bd73c28 req-3122b48e-c55b-40e8-af2b-f420063feddd service nova] Acquiring lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9421a9e2-fed0-4eb3-955d-aa673bd73c28 req-3122b48e-c55b-40e8-af2b-f420063feddd service nova] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9421a9e2-fed0-4eb3-955d-aa673bd73c28 req-3122b48e-c55b-40e8-af2b-f420063feddd service nova] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.compute.manager [req-9421a9e2-fed0-4eb3-955d-aa673bd73c28 req-3122b48e-c55b-40e8-af2b-f420063feddd service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] No waiting events found dispatching network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:47 user nova-compute[74611]: WARNING nova.compute.manager [req-9421a9e2-fed0-4eb3-955d-aa673bd73c28 req-3122b48e-c55b-40e8-af2b-f420063feddd service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received unexpected event network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 for instance with vm_state active and task_state rebuild_spawning.
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:04:47 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Instance spawned successfully.
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:04:47 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Instance spawned successfully.
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:04:47 user nova-compute[74611]: INFO nova.compute.manager [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Took 7.82 seconds to spawn the instance on the hypervisor.
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:04:47 user nova-compute[74611]: INFO nova.compute.manager [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Took 8.77 seconds to build instance.
Nov 13 10:04:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG nova.objects.instance [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74611) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b4e34bd7-5025-4333-8d89-2d15857da30f tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "9e5b488b-a309-465f-8276-b24cb0d88888" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.880s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-90872edd-a708-4500-b56e-e001d768ffb6 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.075s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:48 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:04:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:48 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:04:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:04:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:04:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG nova.compute.manager [req-da2930b3-d4da-4fd8-8ecf-ada936a91b9b req-d25f0f29-9298-48a7-b02d-1d1ef8350f74 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Received event network-changed-605834a6-1df6-4bb7-b277-461f53392466 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG nova.compute.manager [req-da2930b3-d4da-4fd8-8ecf-ada936a91b9b req-d25f0f29-9298-48a7-b02d-1d1ef8350f74 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Refreshing instance network info cache due to event network-changed-605834a6-1df6-4bb7-b277-461f53392466. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-da2930b3-d4da-4fd8-8ecf-ada936a91b9b req-d25f0f29-9298-48a7-b02d-1d1ef8350f74 service nova] Acquiring lock "refresh_cache-16e43d20-bcae-4813-9e4b-55099e23d370" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-da2930b3-d4da-4fd8-8ecf-ada936a91b9b req-d25f0f29-9298-48a7-b02d-1d1ef8350f74 service nova] Acquired lock "refresh_cache-16e43d20-bcae-4813-9e4b-55099e23d370" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG nova.network.neutron [req-da2930b3-d4da-4fd8-8ecf-ada936a91b9b req-d25f0f29-9298-48a7-b02d-1d1ef8350f74 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Refreshing network info cache for port 605834a6-1df6-4bb7-b277-461f53392466 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG nova.network.neutron [req-da2930b3-d4da-4fd8-8ecf-ada936a91b9b req-d25f0f29-9298-48a7-b02d-1d1ef8350f74 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Updated VIF entry in instance network info cache for port 605834a6-1df6-4bb7-b277-461f53392466. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG nova.network.neutron [req-da2930b3-d4da-4fd8-8ecf-ada936a91b9b req-d25f0f29-9298-48a7-b02d-1d1ef8350f74 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Updating instance_info_cache with network_info: [{"id": "605834a6-1df6-4bb7-b277-461f53392466", "address": "fa:16:3e:10:8c:53", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605834a6-1d", "ovs_interfaceid": "605834a6-1df6-4bb7-b277-461f53392466", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "16e43d20-bcae-4813-9e4b-55099e23d370" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "16e43d20-bcae-4813-9e4b-55099e23d370" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "16e43d20-bcae-4813-9e4b-55099e23d370-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "16e43d20-bcae-4813-9e4b-55099e23d370-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "16e43d20-bcae-4813-9e4b-55099e23d370-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:51 user nova-compute[74611]: INFO nova.compute.manager [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Terminating instance
Nov 13 10:04:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:04:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-da2930b3-d4da-4fd8-8ecf-ada936a91b9b req-d25f0f29-9298-48a7-b02d-1d1ef8350f74 service nova] Releasing lock "refresh_cache-16e43d20-bcae-4813-9e4b-55099e23d370" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-6f40d919-83ac-4d84-89cc-31f5b1184f2a req-7dc33245-3e88-401d-a511-c00c3dd3fdfa service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Received event network-vif-unplugged-605834a6-1df6-4bb7-b277-461f53392466 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6f40d919-83ac-4d84-89cc-31f5b1184f2a req-7dc33245-3e88-401d-a511-c00c3dd3fdfa service nova] Acquiring lock "16e43d20-bcae-4813-9e4b-55099e23d370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6f40d919-83ac-4d84-89cc-31f5b1184f2a req-7dc33245-3e88-401d-a511-c00c3dd3fdfa service nova] Lock "16e43d20-bcae-4813-9e4b-55099e23d370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6f40d919-83ac-4d84-89cc-31f5b1184f2a req-7dc33245-3e88-401d-a511-c00c3dd3fdfa service nova] Lock "16e43d20-bcae-4813-9e4b-55099e23d370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-6f40d919-83ac-4d84-89cc-31f5b1184f2a req-7dc33245-3e88-401d-a511-c00c3dd3fdfa service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] No waiting events found dispatching network-vif-unplugged-605834a6-1df6-4bb7-b277-461f53392466 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-6f40d919-83ac-4d84-89cc-31f5b1184f2a req-7dc33245-3e88-401d-a511-c00c3dd3fdfa service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Received event network-vif-unplugged-605834a6-1df6-4bb7-b277-461f53392466 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:52 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Instance destroyed successfully.
Nov 13 10:04:52 user nova-compute[74611]: DEBUG nova.objects.instance [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lazy-loading 'resources' on Instance uuid 16e43d20-bcae-4813-9e4b-55099e23d370 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-950576607',display_name='tempest-TestVolumeBootPattern-server-950576607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-950576607',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjRXcM+iAZvLJco7tBubak1kGHq/45jJ2KKO6E3tr61cFQKM/YqE/xURoOe/LdnL01vr4FH+cPhy0FHq1+WQre34a6xvIem5nHqznPEd2v959ht3Wgct9dv/En52XotjA==',key_name='tempest-TestVolumeBootPattern-1763350711',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:03:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-ktdojwi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:03:09Z,user_data=None,user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=16e43d20-bcae-4813-9e4b-55099e23d370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "605834a6-1df6-4bb7-b277-461f53392466", "address": "fa:16:3e:10:8c:53", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605834a6-1d", "ovs_interfaceid": "605834a6-1df6-4bb7-b277-461f53392466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "605834a6-1df6-4bb7-b277-461f53392466", "address": "fa:16:3e:10:8c:53", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605834a6-1d", "ovs_interfaceid": "605834a6-1df6-4bb7-b277-461f53392466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:8c:53,bridge_name='br-int',has_traffic_filtering=True,id=605834a6-1df6-4bb7-b277-461f53392466,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605834a6-1d') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG os_vif [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:8c:53,bridge_name='br-int',has_traffic_filtering=True,id=605834a6-1df6-4bb7-b277-461f53392466,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605834a6-1d') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap605834a6-1d, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86196f13-4f58-4962-80ec-b176a74bc627) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:52 user nova-compute[74611]: INFO os_vif [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:8c:53,bridge_name='br-int',has_traffic_filtering=True,id=605834a6-1df6-4bb7-b277-461f53392466,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605834a6-1d')
Nov 13 10:04:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbIUounm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:04:52 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:04:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c8067e-2cbc-4746-8429-454bfbfa201c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:04:52 user nova-compute[74611]: No targets found.
Nov 13 10:04:52 user nova-compute[74611]: iSNS:
Nov 13 10:04:52 user nova-compute[74611]: No targets found.
Nov 13 10:04:52 user nova-compute[74611]: STATIC:
Nov 13 10:04:52 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f
Nov 13 10:04:52 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:52 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:52 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d
Nov 13 10:04:52 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:52 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:52 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40
Nov 13 10:04:52 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:52 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:52 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd
Nov 13 10:04:52 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:52 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:52 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:04:52 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:04:52 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:04:52 user nova-compute[74611]: FIRMWARE:
Nov 13 10:04:52 user nova-compute[74611]: No targets found.
Nov 13 10:04:52 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:04:52 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:04:52 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f859372-c674-41fe-a428-e17869035ea9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6602de33-3125-4c6f-8d17-52d292f190a5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:52 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:52 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:52 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:52 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:04:52 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:04:52 user nova-compute[74611]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:04:52 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:04:52 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:04:52 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:04:52 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb642957e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd'): ({'sdd'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Removing single pathed devices sdd {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4864732e-f820-4baa-b63c-30e9ee76e545]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8f5ab5-acc6-4965-9b49-5533d349aef5]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flushing IO for device /dev/sdd {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e227162-22fe-4262-9c30-38702672e4fa]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[32539286-a58a-43f9-8878-41a4530a7a05]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] SCSI volumes sdd have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO598514af-34cf93829e5b78d9', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_598514af', '/dev/disk/by-id/scsi-23334636639333832') {{(pid=85776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 10:04:53 user nova-compute[74611]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO598514af-34cf93829e5b78d9
Nov 13 10:04:53 user nova-compute[74611]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_598514af
Nov 13 10:04:53 user nova-compute[74611]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23334636639333832
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c915328-0f0e-4a00-8678-0c2641f1ae13]: (4, None) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea763644-fa05-41a4-ae27-f6e3a2546093]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6d3a4f-03e8-40ef-aac4-5509a54bae8a]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd, portal: 172.16.0.220,3260]
Nov 13 10:04:53 user nova-compute[74611]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd, portal: 172.16.0.220,3260] successful.
Nov 13 10:04:53 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae6811e-b421-4dcc-9711-6552bd03ed99]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== disconnect_volume: return (439ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:04:53 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Deleting instance files /opt/stack/data/nova/instances/16e43d20-bcae-4813-9e4b-55099e23d370_del
Nov 13 10:04:53 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Deletion of /opt/stack/data/nova/instances/16e43d20-bcae-4813-9e4b-55099e23d370_del complete
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:53 user nova-compute[74611]: INFO nova.compute.manager [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Took 1.54 seconds to destroy the instance on the hypervisor.
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-b12219ae-76a4-4030-9d47-6d32fec38a7b req-a63ed82f-02d4-47ac-8aa9-008ad96ab888 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Received event network-vif-deleted-605834a6-1df6-4bb7-b277-461f53392466 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:54 user nova-compute[74611]: INFO nova.compute.manager [req-b12219ae-76a4-4030-9d47-6d32fec38a7b req-a63ed82f-02d4-47ac-8aa9-008ad96ab888 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Neutron deleted interface 605834a6-1df6-4bb7-b277-461f53392466; detaching it from the instance and deleting it from the info cache
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.network.neutron [req-b12219ae-76a4-4030-9d47-6d32fec38a7b req-a63ed82f-02d4-47ac-8aa9-008ad96ab888 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-9ac25426-d8fa-4ec0-908c-1d15dd13cc9b req-ed869cfd-abe3-4ba3-b0ed-4c9eb8a77047 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Received event network-vif-plugged-605834a6-1df6-4bb7-b277-461f53392466 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9ac25426-d8fa-4ec0-908c-1d15dd13cc9b req-ed869cfd-abe3-4ba3-b0ed-4c9eb8a77047 service nova] Acquiring lock "16e43d20-bcae-4813-9e4b-55099e23d370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9ac25426-d8fa-4ec0-908c-1d15dd13cc9b req-ed869cfd-abe3-4ba3-b0ed-4c9eb8a77047 service nova] Lock "16e43d20-bcae-4813-9e4b-55099e23d370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9ac25426-d8fa-4ec0-908c-1d15dd13cc9b req-ed869cfd-abe3-4ba3-b0ed-4c9eb8a77047 service nova] Lock "16e43d20-bcae-4813-9e4b-55099e23d370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-9ac25426-d8fa-4ec0-908c-1d15dd13cc9b req-ed869cfd-abe3-4ba3-b0ed-4c9eb8a77047 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] No waiting events found dispatching network-vif-plugged-605834a6-1df6-4bb7-b277-461f53392466 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:04:54 user nova-compute[74611]: WARNING nova.compute.manager [req-9ac25426-d8fa-4ec0-908c-1d15dd13cc9b req-ed869cfd-abe3-4ba3-b0ed-4c9eb8a77047 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Received unexpected event network-vif-plugged-605834a6-1df6-4bb7-b277-461f53392466 for instance with vm_state active and task_state deleting.
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:54 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:04:54 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=7200MB free_disk=25.161930084228516GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:54 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Took 1.10 seconds to deallocate network for instance.
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-b12219ae-76a4-4030-9d47-6d32fec38a7b req-a63ed82f-02d4-47ac-8aa9-008ad96ab888 service nova] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Detach interface failed, port_id=605834a6-1df6-4bb7-b277-461f53392466, reason: Instance 16e43d20-bcae-4813-9e4b-55099e23d370 could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:54 user nova-compute[74611]: INFO nova.compute.manager [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Unshelving
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 85cb3adb-b2b3-49ec-92ab-c2b7a028241a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance e99e1557-500f-407e-aefc-3b5cde9ceba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4fa9e23b-30f2-41ae-83ed-86145389d474 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 635636ea-96a0-4fdb-85a1-ca7a87b762f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7eff589b-8f0f-4e6e-ac04-567da455e579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 16e43d20-bcae-4813-9e4b-55099e23d370 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance d3c21984-13a9-422c-b9e7-f9ca79b62d81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ad645ec3-086e-4bfe-b10e-b0a2ff32720d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 9e5b488b-a309-465f-8276-b24cb0d88888 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 261e3e34-7a30-42f5-ae31-c3d3a76d0d67 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:54 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing inventories for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 10:04:55 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating ProviderTree inventory for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 10:04:55 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating inventory in ProviderTree for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 10:04:55 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing aggregate associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, aggregates: None {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 10:04:55 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing trait associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 10:04:55 user nova-compute[74611]: INFO nova.compute.manager [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 16e43d20-bcae-4813-9e4b-55099e23d370] Took 0.83 seconds to detach 1 volumes for instance.
Nov 13 10:04:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:55 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:04:55 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:04:55 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:04:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.986s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.578s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:55 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:04:55 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74611) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 10:04:55 user nova-compute[74611]: DEBUG nova.objects.instance [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'pci_requests' on Instance uuid 261e3e34-7a30-42f5-ae31-c3d3a76d0d67 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:55 user nova-compute[74611]: DEBUG nova.objects.instance [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'numa_topology' on Instance uuid 261e3e34-7a30-42f5-ae31-c3d3a76d0d67 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:55 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:04:55 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:04:55 user nova-compute[74611]: INFO nova.compute.claims [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Claim successful on node user
Nov 13 10:04:56 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:04:56 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:04:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.677s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:56 user nova-compute[74611]: INFO nova.network.neutron [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Updating port a2a9d4c3-0ad3-48b0-a588-65a18320392a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 13 10:04:56 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:04:56 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:04:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:56 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Deleted allocations for instance 16e43d20-bcae-4813-9e4b-55099e23d370
Nov 13 10:04:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:04:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquired lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:04:56 user nova-compute[74611]: DEBUG nova.network.neutron [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:04:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-7fe87c0a-995f-494f-8281-2984c9e680a0 req-73bfb0bf-14fc-4520-92b6-edee0c124301 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received event network-changed-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:04:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-7fe87c0a-995f-494f-8281-2984c9e680a0 req-73bfb0bf-14fc-4520-92b6-edee0c124301 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Refreshing instance network info cache due to event network-changed-a2a9d4c3-0ad3-48b0-a588-65a18320392a. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:04:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7fe87c0a-995f-494f-8281-2984c9e680a0 req-73bfb0bf-14fc-4520-92b6-edee0c124301 service nova] Acquiring lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:04:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ec5b0cb2-6be6-4a14-888b-c7ee05aa3f49 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "16e43d20-bcae-4813-9e4b-55099e23d370" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.908s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:57 user nova-compute[74611]: DEBUG nova.network.neutron [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Updating instance_info_cache with network_info: [{"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Releasing lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:04:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:04:57 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Creating image(s)
Nov 13 10:04:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "/opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "/opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "/opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:57 user nova-compute[74611]: DEBUG nova.objects.instance [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'trusted_certs' on Instance uuid 261e3e34-7a30-42f5-ae31-c3d3a76d0d67 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7fe87c0a-995f-494f-8281-2984c9e680a0 req-73bfb0bf-14fc-4520-92b6-edee0c124301 service nova] Acquired lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:04:57 user nova-compute[74611]: DEBUG nova.network.neutron [req-7fe87c0a-995f-494f-8281-2984c9e680a0 req-73bfb0bf-14fc-4520-92b6-edee0c124301 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Refreshing network info cache for port a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:04:57 user nova-compute[74611]: DEBUG nova.objects.base [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Object Instance<261e3e34-7a30-42f5-ae31-c3d3a76d0d67> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:04:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "385d1671726baa076097a97422a6c21c45484b57" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "385d1671726baa076097a97422a6c21c45484b57" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57.part --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:58 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:04:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57.part --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:58 user nova-compute[74611]: DEBUG nova.virt.images [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] 170174c7-22d7-4d47-b4ca-83186bf8fe3c was qcow2, converting to raw {{(pid=74611) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 10:04:58 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 10:04:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57.part /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57.converted {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:58 user nova-compute[74611]: DEBUG nova.network.neutron [req-7fe87c0a-995f-494f-8281-2984c9e680a0 req-73bfb0bf-14fc-4520-92b6-edee0c124301 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Updated VIF entry in instance network info cache for port a2a9d4c3-0ad3-48b0-a588-65a18320392a. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:04:58 user nova-compute[74611]: DEBUG nova.network.neutron [req-7fe87c0a-995f-494f-8281-2984c9e680a0 req-73bfb0bf-14fc-4520-92b6-edee0c124301 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Updating instance_info_cache with network_info: [{"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:04:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7fe87c0a-995f-494f-8281-2984c9e680a0 req-73bfb0bf-14fc-4520-92b6-edee0c124301 service nova] Releasing lock "refresh_cache-261e3e34-7a30-42f5-ae31-c3d3a76d0d67" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:04:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57.part /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57.converted" returned: 0 in 0.335s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57.converted --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "385d1671726baa076097a97422a6c21c45484b57" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.025s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57 --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "385d1671726baa076097a97422a6c21c45484b57" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "385d1671726baa076097a97422a6c21c45484b57" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57 --force-share --output=json" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57,backing_fmt=raw /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57,backing_fmt=raw /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk 1073741824" returned: 0 in 0.046s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "385d1671726baa076097a97422a6c21c45484b57" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57 --force-share --output=json" returned: 0 in 0.166s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG nova.objects.instance [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'migration_context' on Instance uuid 261e3e34-7a30-42f5-ae31-c3d3a76d0d67 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG nova.objects.base [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Object Instance<261e3e34-7a30-42f5-ae31-c3d3a76d0d67> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:04:59 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Rebasing disk image.
Nov 13 10:04:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:04:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 -F raw /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 -F raw /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk" returned: 0 in 3.409s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Ensure instance console log exists: /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Start _get_guest_xml network_info=[{"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5e0324cf8d0767b76c4e89889b18f87c',container_format='bare',created_at=2023-11-13T10:03:02Z,direct_url=<?>,disk_format='qcow2',id=170174c7-22d7-4d47-b4ca-83186bf8fe3c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-524802819-shelved',owner='d5a6f570a7e7404680bd5809be8b0378',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-13T10:03:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:05:03 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:05:03 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5e0324cf8d0767b76c4e89889b18f87c',container_format='bare',created_at=2023-11-13T10:03:02Z,direct_url=<?>,disk_format='qcow2',id=170174c7-22d7-4d47-b4ca-83186bf8fe3c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-524802819-shelved',owner='d5a6f570a7e7404680bd5809be8b0378',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-13T10:03:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.objects.instance [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'vcpu_model' on Instance uuid 261e3e34-7a30-42f5-ae31-c3d3a76d0d67 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.objects.base [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Object Instance<261e3e34-7a30-42f5-ae31-c3d3a76d0d67> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T10:01:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-524802819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-524802819',id=27,image_ref='170174c7-22d7-4d47-b4ca-83186bf8fe3c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-399446396',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d5a6f570a7e7404680bd5809be8b0378',ramdisk_id='',reservation_id='r-fk8bipxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-55203260',owner_user_name='tempest-AttachVolumeShelveTestJSON-55203260-project-member',shelved_at='2023-11-13T10:03:06.049626',shelved_host='user',shelved_image_id='170174c7-22d7-4d47-b4ca-83186bf8fe3c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:04:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008616dff48b4bdeb2ea0f2be72a2934',uuid=261e3e34-7a30-42f5-ae31-c3d3a76d0d67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converting VIF {"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9c:83,bridge_name='br-int',has_traffic_filtering=True,id=a2a9d4c3-0ad3-48b0-a588-65a18320392a,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a9d4c3-0a') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.objects.instance [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'pci_devices' on Instance uuid 261e3e34-7a30-42f5-ae31-c3d3a76d0d67 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.objects.base [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Object Instance<261e3e34-7a30-42f5-ae31-c3d3a76d0d67> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:05:03 user nova-compute[74611]:   <uuid>261e3e34-7a30-42f5-ae31-c3d3a76d0d67</uuid>
Nov 13 10:05:03 user nova-compute[74611]:   <name>instance-0000001b</name>
Nov 13 10:05:03 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:05:03 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:05:03 user nova-compute[74611]:   <metadata>
Nov 13 10:05:03 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:05:03 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:05:03 user nova-compute[74611]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-524802819</nova:name>
Nov 13 10:05:03 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:05:03</nova:creationTime>
Nov 13 10:05:03 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:05:03 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:05:03 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:05:03 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:05:03 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:05:03 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:05:03 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:05:03 user nova-compute[74611]:       <nova:owner>
Nov 13 10:05:03 user nova-compute[74611]:         <nova:user uuid="008616dff48b4bdeb2ea0f2be72a2934">tempest-AttachVolumeShelveTestJSON-55203260-project-member</nova:user>
Nov 13 10:05:03 user nova-compute[74611]:         <nova:project uuid="d5a6f570a7e7404680bd5809be8b0378">tempest-AttachVolumeShelveTestJSON-55203260</nova:project>
Nov 13 10:05:03 user nova-compute[74611]:       </nova:owner>
Nov 13 10:05:03 user nova-compute[74611]:       <nova:root type="image" uuid="170174c7-22d7-4d47-b4ca-83186bf8fe3c"/>
Nov 13 10:05:03 user nova-compute[74611]:       <nova:ports>
Nov 13 10:05:03 user nova-compute[74611]:         <nova:port uuid="a2a9d4c3-0ad3-48b0-a588-65a18320392a">
Nov 13 10:05:03 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 10:05:03 user nova-compute[74611]:         </nova:port>
Nov 13 10:05:03 user nova-compute[74611]:       </nova:ports>
Nov 13 10:05:03 user nova-compute[74611]:     </nova:instance>
Nov 13 10:05:03 user nova-compute[74611]:   </metadata>
Nov 13 10:05:03 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:05:03 user nova-compute[74611]:     <system>
Nov 13 10:05:03 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:05:03 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:05:03 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:05:03 user nova-compute[74611]:       <entry name="serial">261e3e34-7a30-42f5-ae31-c3d3a76d0d67</entry>
Nov 13 10:05:03 user nova-compute[74611]:       <entry name="uuid">261e3e34-7a30-42f5-ae31-c3d3a76d0d67</entry>
Nov 13 10:05:03 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:05:03 user nova-compute[74611]:     </system>
Nov 13 10:05:03 user nova-compute[74611]:   </sysinfo>
Nov 13 10:05:03 user nova-compute[74611]:   <os>
Nov 13 10:05:03 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:05:03 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:05:03 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:05:03 user nova-compute[74611]:   </os>
Nov 13 10:05:03 user nova-compute[74611]:   <features>
Nov 13 10:05:03 user nova-compute[74611]:     <acpi/>
Nov 13 10:05:03 user nova-compute[74611]:     <apic/>
Nov 13 10:05:03 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:05:03 user nova-compute[74611]:   </features>
Nov 13 10:05:03 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:05:03 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:05:03 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:05:03 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:05:03 user nova-compute[74611]:   </clock>
Nov 13 10:05:03 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:05:03 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:05:03 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:05:03 user nova-compute[74611]:   </cpu>
Nov 13 10:05:03 user nova-compute[74611]:   <devices>
Nov 13 10:05:03 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:05:03 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:05:03 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk"/>
Nov 13 10:05:03 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:05:03 user nova-compute[74611]:     </disk>
Nov 13 10:05:03 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:05:03 user nova-compute[74611]:       <mac address="fa:16:3e:c9:9c:83"/>
Nov 13 10:05:03 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:05:03 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:05:03 user nova-compute[74611]:       <target dev="tapa2a9d4c3-0a"/>
Nov 13 10:05:03 user nova-compute[74611]:     </interface>
Nov 13 10:05:03 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:05:03 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/console.log" append="off"/>
Nov 13 10:05:03 user nova-compute[74611]:     </serial>
Nov 13 10:05:03 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:05:03 user nova-compute[74611]:     <video>
Nov 13 10:05:03 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:05:03 user nova-compute[74611]:     </video>
Nov 13 10:05:03 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:05:03 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:05:03 user nova-compute[74611]:     </rng>
Nov 13 10:05:03 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:05:03 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:05:03 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:05:03 user nova-compute[74611]:     </memballoon>
Nov 13 10:05:03 user nova-compute[74611]:   </devices>
Nov 13 10:05:03 user nova-compute[74611]: </domain>
Nov 13 10:05:03 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T10:01:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-524802819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-524802819',id=27,image_ref='170174c7-22d7-4d47-b4ca-83186bf8fe3c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-399446396',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d5a6f570a7e7404680bd5809be8b0378',ramdisk_id='',reservation_id='r-fk8bipxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-55203260',owner_user_name='tempest-AttachVolumeShelveTestJSON-55203260-project-member',shelved_at='2023-11-13T10:03:06.049626',shelved_host='user',shelved_image_id='170174c7-22d7-4d47-b4ca-83186bf8fe3c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:04:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008616dff48b4bdeb2ea0f2be72a2934',uuid=261e3e34-7a30-42f5-ae31-c3d3a76d0d67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converting VIF {"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9c:83,bridge_name='br-int',has_traffic_filtering=True,id=a2a9d4c3-0ad3-48b0-a588-65a18320392a,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a9d4c3-0a') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG os_vif [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9c:83,bridge_name='br-int',has_traffic_filtering=True,id=a2a9d4c3-0ad3-48b0-a588-65a18320392a,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a9d4c3-0a') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a774d56-cbc3-5255-802c-7b936acdf1fe', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2a9d4c3-0a, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2a9d4c3-0a, col_values=(('qos', UUID('7202a361-0b5b-4f56-9cff-31ac7e5e665c')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2a9d4c3-0a, col_values=(('external_ids', {'iface-id': 'a2a9d4c3-0ad3-48b0-a588-65a18320392a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:9c:83', 'vm-uuid': '261e3e34-7a30-42f5-ae31-c3d3a76d0d67'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:03 user nova-compute[74611]: INFO os_vif [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9c:83,bridge_name='br-int',has_traffic_filtering=True,id=a2a9d4c3-0ad3-48b0-a588-65a18320392a,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a9d4c3-0a')
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:05:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] No VIF found with MAC fa:16:3e:c9:9c:83, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:05:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-eca8b5c5-9ee4-487b-b124-5b6e10a3e057 req-03d685ba-319b-4179-92f3-780461c3838f service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received event network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:05:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-eca8b5c5-9ee4-487b-b124-5b6e10a3e057 req-03d685ba-319b-4179-92f3-780461c3838f service nova] Acquiring lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-eca8b5c5-9ee4-487b-b124-5b6e10a3e057 req-03d685ba-319b-4179-92f3-780461c3838f service nova] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-eca8b5c5-9ee4-487b-b124-5b6e10a3e057 req-03d685ba-319b-4179-92f3-780461c3838f service nova] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-eca8b5c5-9ee4-487b-b124-5b6e10a3e057 req-03d685ba-319b-4179-92f3-780461c3838f service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] No waiting events found dispatching network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:05:05 user nova-compute[74611]: WARNING nova.compute.manager [req-eca8b5c5-9ee4-487b-b124-5b6e10a3e057 req-03d685ba-319b-4179-92f3-780461c3838f service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received unexpected event network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 10:05:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-305565cf-a948-41ec-938c-ce6b402ffa11 req-ecf2651c-0afc-44d9-a9c8-8bf30154af14 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received event network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:05:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-305565cf-a948-41ec-938c-ce6b402ffa11 req-ecf2651c-0afc-44d9-a9c8-8bf30154af14 service nova] Acquiring lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-305565cf-a948-41ec-938c-ce6b402ffa11 req-ecf2651c-0afc-44d9-a9c8-8bf30154af14 service nova] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-305565cf-a948-41ec-938c-ce6b402ffa11 req-ecf2651c-0afc-44d9-a9c8-8bf30154af14 service nova] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-305565cf-a948-41ec-938c-ce6b402ffa11 req-ecf2651c-0afc-44d9-a9c8-8bf30154af14 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] No waiting events found dispatching network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:05:07 user nova-compute[74611]: WARNING nova.compute.manager [req-305565cf-a948-41ec-938c-ce6b402ffa11 req-ecf2651c-0afc-44d9-a9c8-8bf30154af14 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received unexpected event network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 10:05:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:05:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:05:07 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Instance spawned successfully.
Nov 13 10:05:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:05:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-567ecfad-ce55-4aee-863d-632cc8978be4 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.709s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "f059d809-84b0-40c4-be84-bc89a9dc182e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:05:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:13 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:05:13 user nova-compute[74611]: INFO nova.compute.claims [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Claim successful on node user
Nov 13 10:05:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:13 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:05:13 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:05:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:05:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:05:13 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:05:13 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:05:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:05:14 user nova-compute[74611]: INFO nova.virt.block_device [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Booting with volume-backed-image b51f50a6-3c60-4450-bd2c-4073087acec9 at /dev/vda
Nov 13 10:05:14 user nova-compute[74611]: DEBUG nova.policy [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6bc911a5649643a6a3606d8b80e20eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e3b3233a5b43d682200d91f29a80b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:05:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:14 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Successfully created port: 0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:05:15 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Successfully updated port: 0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:05:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "refresh_cache-f059d809-84b0-40c4-be84-bc89a9dc182e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:05:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquired lock "refresh_cache-f059d809-84b0-40c4-be84-bc89a9dc182e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:05:15 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:05:15 user nova-compute[74611]: DEBUG nova.compute.manager [req-64c4d611-4af8-4732-85ab-3056f34adaf6 req-04fd79ed-0f96-468c-a6ab-025f556d6f86 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received event network-changed-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:05:15 user nova-compute[74611]: DEBUG nova.compute.manager [req-64c4d611-4af8-4732-85ab-3056f34adaf6 req-04fd79ed-0f96-468c-a6ab-025f556d6f86 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Refreshing instance network info cache due to event network-changed-0a10fea9-0757-4257-b637-952cffdf0114. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:05:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-64c4d611-4af8-4732-85ab-3056f34adaf6 req-04fd79ed-0f96-468c-a6ab-025f556d6f86 service nova] Acquiring lock "refresh_cache-f059d809-84b0-40c4-be84-bc89a9dc182e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:05:15 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:05:15 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Updating instance_info_cache with network_info: [{"id": "0a10fea9-0757-4257-b637-952cffdf0114", "address": "fa:16:3e:21:cf:80", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a10fea9-07", "ovs_interfaceid": "0a10fea9-0757-4257-b637-952cffdf0114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:05:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Releasing lock "refresh_cache-f059d809-84b0-40c4-be84-bc89a9dc182e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:05:15 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Instance network_info: |[{"id": "0a10fea9-0757-4257-b637-952cffdf0114", "address": "fa:16:3e:21:cf:80", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a10fea9-07", "ovs_interfaceid": "0a10fea9-0757-4257-b637-952cffdf0114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:05:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-64c4d611-4af8-4732-85ab-3056f34adaf6 req-04fd79ed-0f96-468c-a6ab-025f556d6f86 service nova] Acquired lock "refresh_cache-f059d809-84b0-40c4-be84-bc89a9dc182e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:05:15 user nova-compute[74611]: DEBUG nova.network.neutron [req-64c4d611-4af8-4732-85ab-3056f34adaf6 req-04fd79ed-0f96-468c-a6ab-025f556d6f86 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Refreshing network info cache for port 0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:05:15 user nova-compute[74611]: DEBUG nova.network.neutron [req-64c4d611-4af8-4732-85ab-3056f34adaf6 req-04fd79ed-0f96-468c-a6ab-025f556d6f86 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Updated VIF entry in instance network info cache for port 0a10fea9-0757-4257-b637-952cffdf0114. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:05:15 user nova-compute[74611]: DEBUG nova.network.neutron [req-64c4d611-4af8-4732-85ab-3056f34adaf6 req-04fd79ed-0f96-468c-a6ab-025f556d6f86 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Updating instance_info_cache with network_info: [{"id": "0a10fea9-0757-4257-b637-952cffdf0114", "address": "fa:16:3e:21:cf:80", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a10fea9-07", "ovs_interfaceid": "0a10fea9-0757-4257-b637-952cffdf0114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:05:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-64c4d611-4af8-4732-85ab-3056f34adaf6 req-04fd79ed-0f96-468c-a6ab-025f556d6f86 service nova] Releasing lock "refresh_cache-f059d809-84b0-40c4-be84-bc89a9dc182e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:05:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG os_brick.utils [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[889fc099-8b20-42ba-8106-aaf2141163eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d4ca35-1369-48a6-8e98-4a2e37d43f2a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d36ac0-eec9-4dda-87c4-32219d7e5e02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0609bbfc-4a0c-4026-9015-3327ec3208d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:05:19 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:05:19 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8b70f2-3d4f-4ecc-b1d0-550b6fc88807]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG os_brick.utils [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:05:19 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Updating existing volume attachment record: 9c778748-beb9-4721-b611-241d025bec4f {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:05:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:05:24 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Creating image(s)
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Ensure instance console log exists: /opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Start _get_guest_xml network_info=[{"id": "0a10fea9-0757-4257-b637-952cffdf0114", "address": "fa:16:3e:21:cf:80", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a10fea9-07", "ovs_interfaceid": "0a10fea9-0757-4257-b637-952cffdf0114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '9c778748-beb9-4721-b611-241d025bec4f', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGfSLFTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f059d809-84b0-40c4-be84-bc89a9dc182e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5f13810-d007-4cd9-ad7f-21f7c3b51dfc', 'serial': 'f5f13810-d007-4cd9-ad7f-21f7c3b51dfc'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:05:24 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:05:24 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGfSLFTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:05:24 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:05:24 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:05:24 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31090ef-0a82-4b67-92c3-2a36286e266f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:05:24 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[951719af-b06d-4013-9bdf-75015cf7d80e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc] added
Nov 13 10:05:24 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71960b5-364d-44b4-a30f-f214f7331456]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[588920d0-0030-4e90-b1b4-7c6413365506]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGfSLFTX {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGfSLFTX" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01421f3-2a08-4601-b1e2-d5501ebade76]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wGfSLFTX'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a95453a-25eb-40b8-b282-b81923843c5a]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea0af7e-7a78-484b-882a-57f7b9f40e36]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:05:24 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:05:24 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:05:24 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:05:24 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:05:24 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:05:24 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:05:24 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:05:24 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae488d59-dd58-46a5-b6d6-b52b1bc87673]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc, portal: 172.16.0.220,3260]
Nov 13 10:05:24 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc, portal: 172.16.0.220,3260] successful.
Nov 13 10:05:24 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e4a207-17c6-4489-b1bd-bc3ac7a2dfd6]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fd9823-bb64-4385-b4d6-3d6a6d1fb196]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:05:24 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:05:24 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:05:24 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:05:24 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:05:24 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:05:24 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:05:24 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:05:24 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:05:24 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:05:24 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bb7575-18c2-418d-9c0d-7be34e096e6c]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:24 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: None {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGfSLFTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23530653865643966', 'path': '/dev/sdd'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530653865643966', 'path': '/dev/sdd'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:05:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1569409365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1569409365',id=35,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83e3b3233a5b43d682200d91f29a80b4',ramdisk_id='',reservation_id='r-nt3djo2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-182847603',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:05:14Z,user_data=None,user_id='6bc911a5649643a6a3606d8b80e20eb0',uuid=f059d809-84b0-40c4-be84-bc89a9dc182e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a10fea9-0757-4257-b637-952cffdf0114", "address": "fa:16:3e:21:cf:80", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a10fea9-07", "ovs_interfaceid": "0a10fea9-0757-4257-b637-952cffdf0114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converting VIF {"id": "0a10fea9-0757-4257-b637-952cffdf0114", "address": "fa:16:3e:21:cf:80", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a10fea9-07", "ovs_interfaceid": "0a10fea9-0757-4257-b637-952cffdf0114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:cf:80,bridge_name='br-int',has_traffic_filtering=True,id=0a10fea9-0757-4257-b637-952cffdf0114,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a10fea9-07') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'pci_devices' on Instance uuid f059d809-84b0-40c4-be84-bc89a9dc182e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:05:25 user nova-compute[74611]:   <uuid>f059d809-84b0-40c4-be84-bc89a9dc182e</uuid>
Nov 13 10:05:25 user nova-compute[74611]:   <name>instance-00000023</name>
Nov 13 10:05:25 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:05:25 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:05:25 user nova-compute[74611]:   <metadata>
Nov 13 10:05:25 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:05:25 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:05:25 user nova-compute[74611]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1569409365</nova:name>
Nov 13 10:05:25 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:05:24</nova:creationTime>
Nov 13 10:05:25 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:05:25 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:05:25 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:05:25 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:05:25 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:05:25 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:05:25 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:05:25 user nova-compute[74611]:       <nova:owner>
Nov 13 10:05:25 user nova-compute[74611]:         <nova:user uuid="6bc911a5649643a6a3606d8b80e20eb0">tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member</nova:user>
Nov 13 10:05:25 user nova-compute[74611]:         <nova:project uuid="83e3b3233a5b43d682200d91f29a80b4">tempest-ServerBootFromVolumeStableRescueTest-182847603</nova:project>
Nov 13 10:05:25 user nova-compute[74611]:       </nova:owner>
Nov 13 10:05:25 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:05:25 user nova-compute[74611]:       <nova:ports>
Nov 13 10:05:25 user nova-compute[74611]:         <nova:port uuid="0a10fea9-0757-4257-b637-952cffdf0114">
Nov 13 10:05:25 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 10:05:25 user nova-compute[74611]:         </nova:port>
Nov 13 10:05:25 user nova-compute[74611]:       </nova:ports>
Nov 13 10:05:25 user nova-compute[74611]:     </nova:instance>
Nov 13 10:05:25 user nova-compute[74611]:   </metadata>
Nov 13 10:05:25 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:05:25 user nova-compute[74611]:     <system>
Nov 13 10:05:25 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:05:25 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:05:25 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:05:25 user nova-compute[74611]:       <entry name="serial">f059d809-84b0-40c4-be84-bc89a9dc182e</entry>
Nov 13 10:05:25 user nova-compute[74611]:       <entry name="uuid">f059d809-84b0-40c4-be84-bc89a9dc182e</entry>
Nov 13 10:05:25 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:05:25 user nova-compute[74611]:     </system>
Nov 13 10:05:25 user nova-compute[74611]:   </sysinfo>
Nov 13 10:05:25 user nova-compute[74611]:   <os>
Nov 13 10:05:25 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:05:25 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:05:25 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:05:25 user nova-compute[74611]:   </os>
Nov 13 10:05:25 user nova-compute[74611]:   <features>
Nov 13 10:05:25 user nova-compute[74611]:     <acpi/>
Nov 13 10:05:25 user nova-compute[74611]:     <apic/>
Nov 13 10:05:25 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:05:25 user nova-compute[74611]:   </features>
Nov 13 10:05:25 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:05:25 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:05:25 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:05:25 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:05:25 user nova-compute[74611]:   </clock>
Nov 13 10:05:25 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:05:25 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:05:25 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:05:25 user nova-compute[74611]:   </cpu>
Nov 13 10:05:25 user nova-compute[74611]:   <devices>
Nov 13 10:05:25 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:05:25 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:05:25 user nova-compute[74611]:       <source dev="/dev/sdd"/>
Nov 13 10:05:25 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:05:25 user nova-compute[74611]:       <serial>f5f13810-d007-4cd9-ad7f-21f7c3b51dfc</serial>
Nov 13 10:05:25 user nova-compute[74611]:     </disk>
Nov 13 10:05:25 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:05:25 user nova-compute[74611]:       <mac address="fa:16:3e:21:cf:80"/>
Nov 13 10:05:25 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:05:25 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:05:25 user nova-compute[74611]:       <target dev="tap0a10fea9-07"/>
Nov 13 10:05:25 user nova-compute[74611]:     </interface>
Nov 13 10:05:25 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:05:25 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/console.log" append="off"/>
Nov 13 10:05:25 user nova-compute[74611]:     </serial>
Nov 13 10:05:25 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:05:25 user nova-compute[74611]:     <video>
Nov 13 10:05:25 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:05:25 user nova-compute[74611]:     </video>
Nov 13 10:05:25 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:05:25 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:05:25 user nova-compute[74611]:     </rng>
Nov 13 10:05:25 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:05:25 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:05:25 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:05:25 user nova-compute[74611]:     </memballoon>
Nov 13 10:05:25 user nova-compute[74611]:   </devices>
Nov 13 10:05:25 user nova-compute[74611]: </domain>
Nov 13 10:05:25 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:05:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1569409365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1569409365',id=35,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83e3b3233a5b43d682200d91f29a80b4',ramdisk_id='',reservation_id='r-nt3djo2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-182847603',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:05:14Z,user_data=None,user_id='6bc911a5649643a6a3606d8b80e20eb0',uuid=f059d809-84b0-40c4-be84-bc89a9dc182e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a10fea9-0757-4257-b637-952cffdf0114", "address": "fa:16:3e:21:cf:80", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a10fea9-07", "ovs_interfaceid": "0a10fea9-0757-4257-b637-952cffdf0114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converting VIF {"id": "0a10fea9-0757-4257-b637-952cffdf0114", "address": "fa:16:3e:21:cf:80", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a10fea9-07", "ovs_interfaceid": "0a10fea9-0757-4257-b637-952cffdf0114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:cf:80,bridge_name='br-int',has_traffic_filtering=True,id=0a10fea9-0757-4257-b637-952cffdf0114,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a10fea9-07') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG os_vif [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:cf:80,bridge_name='br-int',has_traffic_filtering=True,id=0a10fea9-0757-4257-b637-952cffdf0114,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a10fea9-07') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cafeadb-9c09-50d3-9916-57e224cf75c9', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a10fea9-07, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a10fea9-07, col_values=(('qos', UUID('2315d59d-9799-4ddb-8142-499c2bfb1a62')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a10fea9-07, col_values=(('external_ids', {'iface-id': '0a10fea9-0757-4257-b637-952cffdf0114', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:cf:80', 'vm-uuid': 'f059d809-84b0-40c4-be84-bc89a9dc182e'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:25 user nova-compute[74611]: INFO os_vif [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:cf:80,bridge_name='br-int',has_traffic_filtering=True,id=0a10fea9-0757-4257-b637-952cffdf0114,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a10fea9-07')
Nov 13 10:05:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:05:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] No VIF found with MAC fa:16:3e:21:cf:80, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:05:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-94a15bca-a721-4528-b7bf-62670c21238a req-b8424aa3-d517-4c13-8a0b-edeeb8ea5fb9 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:05:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-94a15bca-a721-4528-b7bf-62670c21238a req-b8424aa3-d517-4c13-8a0b-edeeb8ea5fb9 service nova] Acquiring lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-94a15bca-a721-4528-b7bf-62670c21238a req-b8424aa3-d517-4c13-8a0b-edeeb8ea5fb9 service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-94a15bca-a721-4528-b7bf-62670c21238a req-b8424aa3-d517-4c13-8a0b-edeeb8ea5fb9 service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-94a15bca-a721-4528-b7bf-62670c21238a req-b8424aa3-d517-4c13-8a0b-edeeb8ea5fb9 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] No waiting events found dispatching network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:05:27 user nova-compute[74611]: WARNING nova.compute.manager [req-94a15bca-a721-4528-b7bf-62670c21238a req-b8424aa3-d517-4c13-8a0b-edeeb8ea5fb9 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received unexpected event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 for instance with vm_state building and task_state spawning.
Nov 13 10:05:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:29 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:05:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:05:29 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Instance spawned successfully.
Nov 13 10:05:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:05:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:05:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:05:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:05:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:05:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:05:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:05:29 user nova-compute[74611]: INFO nova.compute.manager [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 13 10:05:29 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:05:29 user nova-compute[74611]: INFO nova.compute.manager [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Took 15.92 seconds to build instance.
Nov 13 10:05:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6470aa02-8d7b-491f-bc33-11061fd21742 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.017s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa7347a8-1e7e-43c5-a488-daee6625a015 req-285fdb09-6214-423d-801c-41e1fa1f163b service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:05:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa7347a8-1e7e-43c5-a488-daee6625a015 req-285fdb09-6214-423d-801c-41e1fa1f163b service nova] Acquiring lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa7347a8-1e7e-43c5-a488-daee6625a015 req-285fdb09-6214-423d-801c-41e1fa1f163b service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa7347a8-1e7e-43c5-a488-daee6625a015 req-285fdb09-6214-423d-801c-41e1fa1f163b service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa7347a8-1e7e-43c5-a488-daee6625a015 req-285fdb09-6214-423d-801c-41e1fa1f163b service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] No waiting events found dispatching network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:05:29 user nova-compute[74611]: WARNING nova.compute.manager [req-aa7347a8-1e7e-43c5-a488-daee6625a015 req-285fdb09-6214-423d-801c-41e1fa1f163b service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received unexpected event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 for instance with vm_state active and task_state None.
Nov 13 10:05:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:41 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:05:41 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:05:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:05:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:05:41 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:05:41 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updating instance_info_cache with network_info: [{"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:05:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-635636ea-96a0-4fdb-85a1-ca7a87b762f0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:05:41 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:05:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:43 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:05:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:43 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:05:43 user nova-compute[74611]: INFO nova.compute.claims [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Claim successful on node user
Nov 13 10:05:44 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:05:44 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:05:44 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG nova.policy [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91e7d88000c1476abfb0df6bfca4e0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12e0c04622143f2a0c24258ab90e153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:05:44 user nova-compute[74611]: INFO nova.virt.block_device [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Booting with volume 187e682d-b203-4996-8b12-6a3d1c4447fd at /dev/vda
Nov 13 10:05:44 user nova-compute[74611]: DEBUG os_brick.utils [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fb3881-4e13-4e73-a961-b3a8d962b533]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d173674-df7b-4e57-9ed7-4f9594d762d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dbe706-7b4d-48cb-a74a-75406d6d2328]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97d5a85-3fc8-40e0-93ec-d9a68c0dd233]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:05:44 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:05:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8c30bb-1c09-4bf9-90a1-623e5411923a]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG os_brick.utils [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:05:44 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Updating existing volume attachment record: eaee0c9a-af97-4134-9a2c-7c709c14b211 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:05:45 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:05:45 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Successfully created port: 745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:05:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:05:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:05:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:05:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:05:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:45 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Successfully updated port: 745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:05:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "refresh_cache-0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:05:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquired lock "refresh_cache-0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:05:45 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:05:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-066f6646-0a0e-466e-b4ea-8b8abec68a1d req-3cfcc1f4-e8a2-4193-84f2-12b92b83aaa0 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Received event network-changed-745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:05:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-066f6646-0a0e-466e-b4ea-8b8abec68a1d req-3cfcc1f4-e8a2-4193-84f2-12b92b83aaa0 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Refreshing instance network info cache due to event network-changed-745f6db3-f361-4030-a4cb-03ce5f561662. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:05:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-066f6646-0a0e-466e-b4ea-8b8abec68a1d req-3cfcc1f4-e8a2-4193-84f2-12b92b83aaa0 service nova] Acquiring lock "refresh_cache-0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:05:45 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:05:46 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:05:46 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:05:46 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:05:46 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Updating instance_info_cache with network_info: [{"id": "745f6db3-f361-4030-a4cb-03ce5f561662", "address": "fa:16:3e:8c:c7:a4", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745f6db3-f3", "ovs_interfaceid": "745f6db3-f361-4030-a4cb-03ce5f561662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:05:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Releasing lock "refresh_cache-0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:05:46 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Instance network_info: |[{"id": "745f6db3-f361-4030-a4cb-03ce5f561662", "address": "fa:16:3e:8c:c7:a4", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745f6db3-f3", "ovs_interfaceid": "745f6db3-f361-4030-a4cb-03ce5f561662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:05:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-066f6646-0a0e-466e-b4ea-8b8abec68a1d req-3cfcc1f4-e8a2-4193-84f2-12b92b83aaa0 service nova] Acquired lock "refresh_cache-0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:05:46 user nova-compute[74611]: DEBUG nova.network.neutron [req-066f6646-0a0e-466e-b4ea-8b8abec68a1d req-3cfcc1f4-e8a2-4193-84f2-12b92b83aaa0 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Refreshing network info cache for port 745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:05:46 user nova-compute[74611]: DEBUG nova.network.neutron [req-066f6646-0a0e-466e-b4ea-8b8abec68a1d req-3cfcc1f4-e8a2-4193-84f2-12b92b83aaa0 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Updated VIF entry in instance network info cache for port 745f6db3-f361-4030-a4cb-03ce5f561662. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:05:46 user nova-compute[74611]: DEBUG nova.network.neutron [req-066f6646-0a0e-466e-b4ea-8b8abec68a1d req-3cfcc1f4-e8a2-4193-84f2-12b92b83aaa0 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Updating instance_info_cache with network_info: [{"id": "745f6db3-f361-4030-a4cb-03ce5f561662", "address": "fa:16:3e:8c:c7:a4", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745f6db3-f3", "ovs_interfaceid": "745f6db3-f361-4030-a4cb-03ce5f561662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:05:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-066f6646-0a0e-466e-b4ea-8b8abec68a1d req-3cfcc1f4-e8a2-4193-84f2-12b92b83aaa0 service nova] Releasing lock "refresh_cache-0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:05:47 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:05:47 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:05:47 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'flavor' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquired lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.network.neutron [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'info_cache' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.objects.base [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Object Instance<e99e1557-500f-407e-aefc-3b5cde9ceba0> lazy-loaded attributes: flavor,info_cache {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:05:48 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Creating image(s)
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Ensure instance console log exists: /opt/stack/data/nova/instances/0a689a12-e4c3-4ed3-91e9-1fceb09f0c10/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Start _get_guest_xml network_info=[{"id": "745f6db3-f361-4030-a4cb-03ce5f561662", "address": "fa:16:3e:8c:c7:a4", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745f6db3-f3", "ovs_interfaceid": "745f6db3-f361-4030-a4cb-03ce5f561662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'eaee0c9a-af97-4134-9a2c-7c709c14b211', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbIUounm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a689a12-e4c3-4ed3-91e9-1fceb09f0c10', 'attached_at': '', 'detached_at': '', 'volume_id': '187e682d-b203-4996-8b12-6a3d1c4447fd', 'serial': '187e682d-b203-4996-8b12-6a3d1c4447fd'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:05:48 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:05:48 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbIUounm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:05:48 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:05:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:05:48 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:05:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:05:48 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c4e90a-e857-4c16-b638-3ddda420d8c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:05:48 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[caef67ac-f036-4a30-90ef-c1da9f28ead1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd] added
Nov 13 10:05:48 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ef2575-b4f3-4770-a71d-18d8388d022f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[27252092-52db-46c4-b017-29bdc115eb47]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HbIUounm {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HbIUounm" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfecbeb8-4fac-4957-aaf4-ebbeba8b8761]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HbIUounm'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dba4ac-5b20-4995-bf3c-14f970104930]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cb0fa3-9491-4c5c-ad33-4712bae28d73]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:05:49 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:05:49 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.network.neutron [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Updating instance_info_cache with network_info: [{"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Releasing lock "refresh_cache-e99e1557-500f-407e-aefc-3b5cde9ceba0" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a05767-dccb-4350-acee-8d77ece0b891]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd, portal: 172.16.0.220,3260]
Nov 13 10:05:49 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd, portal: 172.16.0.220,3260] successful.
Nov 13 10:05:49 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:49 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Instance destroyed successfully.
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'resources' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.objects.base [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Object Instance<e99e1557-500f-407e-aefc-3b5cde9ceba0> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1508598088',display_name='tempest-AttachVolumeTestJSON-server-1508598088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1508598088',id=18,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgN2fOxghmivj853mZ2ksKDLn8tdFXuOHZwAmmMU0voEMAFBi/R/0d3RmLKBvhLUKwr6VaNoAX27Qgtk/V6TuVskjG8QOa9sC9yhByta66dRmM6E1ACXtMK3U+5xSdm5g==',key_name='tempest-keypair-977132060',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:57:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ce3f0d3282d547249997fdad18cefc9c',ramdisk_id='',reservation_id='r-tmd58a9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-658018398',owner_user_name='tempest-AttachVolumeTestJSON-658018398-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:03:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0428809075cd41f0a6eb84c21e9abfed',uuid=e99e1557-500f-407e-aefc-3b5cde9ceba0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converting VIF {"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG os_vif [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[340161e2-f14f-4854-a5cf-4a6c2d134832]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16c3fba0-60, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed495599-c2c2-4754-b99e-1e315afa1355) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:49 user nova-compute[74611]: INFO os_vif [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60')
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Start _get_guest_xml network_info=[{"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'numa_topology' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0666b750-dc89-4a0a-a2c9-da5a5cb9a879]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:05:49 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:05:49 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:05:49 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.objects.base [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Object Instance<e99e1557-500f-407e-aefc-3b5cde9ceba0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:49 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:05:49 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'vcpu_model' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62a9036-0404-4c1a-b1f2-f0bef5782519]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbIUounm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.objects.base [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Object Instance<e99e1557-500f-407e-aefc-3b5cde9ceba0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1508598088',display_name='tempest-AttachVolumeTestJSON-server-1508598088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1508598088',id=18,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgN2fOxghmivj853mZ2ksKDLn8tdFXuOHZwAmmMU0voEMAFBi/R/0d3RmLKBvhLUKwr6VaNoAX27Qgtk/V6TuVskjG8QOa9sC9yhByta66dRmM6E1ACXtMK3U+5xSdm5g==',key_name='tempest-keypair-977132060',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:57:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ce3f0d3282d547249997fdad18cefc9c',ramdisk_id='',reservation_id='r-tmd58a9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-658018398',owner_user_name='tempest-AttachVolumeTestJSON-658018398-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:03:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0428809075cd41f0a6eb84c21e9abfed',uuid=e99e1557-500f-407e-aefc-3b5cde9ceba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converting VIF {"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'pci_devices' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.objects.base [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Object Instance<e99e1557-500f-407e-aefc-3b5cde9ceba0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:05:49 user nova-compute[74611]:   <uuid>e99e1557-500f-407e-aefc-3b5cde9ceba0</uuid>
Nov 13 10:05:49 user nova-compute[74611]:   <name>instance-00000012</name>
Nov 13 10:05:49 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:05:49 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:05:49 user nova-compute[74611]:   <metadata>
Nov 13 10:05:49 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:05:49 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:05:49 user nova-compute[74611]:       <nova:name>tempest-AttachVolumeTestJSON-server-1508598088</nova:name>
Nov 13 10:05:49 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:05:49</nova:creationTime>
Nov 13 10:05:49 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:05:49 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:05:49 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:05:49 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:05:49 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:05:49 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:05:49 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:05:49 user nova-compute[74611]:       <nova:owner>
Nov 13 10:05:49 user nova-compute[74611]:         <nova:user uuid="0428809075cd41f0a6eb84c21e9abfed">tempest-AttachVolumeTestJSON-658018398-project-member</nova:user>
Nov 13 10:05:49 user nova-compute[74611]:         <nova:project uuid="ce3f0d3282d547249997fdad18cefc9c">tempest-AttachVolumeTestJSON-658018398</nova:project>
Nov 13 10:05:49 user nova-compute[74611]:       </nova:owner>
Nov 13 10:05:49 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:05:49 user nova-compute[74611]:       <nova:ports>
Nov 13 10:05:49 user nova-compute[74611]:         <nova:port uuid="16c3fba0-6005-4fd4-a1b9-005df1f6771b">
Nov 13 10:05:49 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 10:05:49 user nova-compute[74611]:         </nova:port>
Nov 13 10:05:49 user nova-compute[74611]:       </nova:ports>
Nov 13 10:05:49 user nova-compute[74611]:     </nova:instance>
Nov 13 10:05:49 user nova-compute[74611]:   </metadata>
Nov 13 10:05:49 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:05:49 user nova-compute[74611]:     <system>
Nov 13 10:05:49 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:05:49 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:05:49 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:05:49 user nova-compute[74611]:       <entry name="serial">e99e1557-500f-407e-aefc-3b5cde9ceba0</entry>
Nov 13 10:05:49 user nova-compute[74611]:       <entry name="uuid">e99e1557-500f-407e-aefc-3b5cde9ceba0</entry>
Nov 13 10:05:49 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:05:49 user nova-compute[74611]:     </system>
Nov 13 10:05:49 user nova-compute[74611]:   </sysinfo>
Nov 13 10:05:49 user nova-compute[74611]:   <os>
Nov 13 10:05:49 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:05:49 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:05:49 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:05:49 user nova-compute[74611]:   </os>
Nov 13 10:05:49 user nova-compute[74611]:   <features>
Nov 13 10:05:49 user nova-compute[74611]:     <acpi/>
Nov 13 10:05:49 user nova-compute[74611]:     <apic/>
Nov 13 10:05:49 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:05:49 user nova-compute[74611]:   </features>
Nov 13 10:05:49 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:05:49 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:05:49 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:05:49 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:05:49 user nova-compute[74611]:   </clock>
Nov 13 10:05:49 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:05:49 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:05:49 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:05:49 user nova-compute[74611]:   </cpu>
Nov 13 10:05:49 user nova-compute[74611]:   <devices>
Nov 13 10:05:49 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:05:49 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:05:49 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk"/>
Nov 13 10:05:49 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:05:49 user nova-compute[74611]:     </disk>
Nov 13 10:05:49 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:05:49 user nova-compute[74611]:       <mac address="fa:16:3e:e0:90:1a"/>
Nov 13 10:05:49 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:05:49 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:05:49 user nova-compute[74611]:       <target dev="tap16c3fba0-60"/>
Nov 13 10:05:49 user nova-compute[74611]:     </interface>
Nov 13 10:05:49 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:05:49 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/console.log" append="off"/>
Nov 13 10:05:49 user nova-compute[74611]:     </serial>
Nov 13 10:05:49 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:05:49 user nova-compute[74611]:     <video>
Nov 13 10:05:49 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:05:49 user nova-compute[74611]:     </video>
Nov 13 10:05:49 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:05:49 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:05:49 user nova-compute[74611]:     </rng>
Nov 13 10:05:49 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:05:49 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:05:49 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:05:49 user nova-compute[74611]:     </memballoon>
Nov 13 10:05:49 user nova-compute[74611]:   </devices>
Nov 13 10:05:49 user nova-compute[74611]: </domain>
Nov 13 10:05:49 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'trusted_certs' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.objects.base [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Object Instance<e99e1557-500f-407e-aefc-3b5cde9ceba0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:05:49 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Cannot resize image /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'migration_context' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.objects.base [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Object Instance<e99e1557-500f-407e-aefc-3b5cde9ceba0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1508598088',display_name='tempest-AttachVolumeTestJSON-server-1508598088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1508598088',id=18,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgN2fOxghmivj853mZ2ksKDLn8tdFXuOHZwAmmMU0voEMAFBi/R/0d3RmLKBvhLUKwr6VaNoAX27Qgtk/V6TuVskjG8QOa9sC9yhByta66dRmM6E1ACXtMK3U+5xSdm5g==',key_name='tempest-keypair-977132060',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:57:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ce3f0d3282d547249997fdad18cefc9c',ramdisk_id='',reservation_id='r-tmd58a9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-658018398',owner_user_name='tempest-AttachVolumeTestJSON-658018398-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:03:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0428809075cd41f0a6eb84c21e9abfed',uuid=e99e1557-500f-407e-aefc-3b5cde9ceba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converting VIF {"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG os_vif [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e82700cd-979d-5172-915f-24ee4909c24d', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16c3fba0-60, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16c3fba0-60, col_values=(('qos', UUID('5a34681e-ac13-475e-bf94-ed5b8dbe9fa7')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16c3fba0-60, col_values=(('external_ids', {'iface-id': '16c3fba0-6005-4fd4-a1b9-005df1f6771b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:90:1a', 'vm-uuid': 'e99e1557-500f-407e-aefc-3b5cde9ceba0'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:50 user nova-compute[74611]: INFO os_vif [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60')
Nov 13 10:05:50 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23334636639333832', 'path': '/dev/sdg'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334636639333832', 'path': '/dev/sdg'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1270398425',display_name='tempest-TestVolumeBootPattern-server-1270398425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1270398425',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjRXcM+iAZvLJco7tBubak1kGHq/45jJ2KKO6E3tr61cFQKM/YqE/xURoOe/LdnL01vr4FH+cPhy0FHq1+WQre34a6xvIem5nHqznPEd2v959ht3Wgct9dv/En52XotjA==',key_name='tempest-TestVolumeBootPattern-1763350711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-m1matkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:05:44Z,user_data=None,user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=0a689a12-e4c3-4ed3-91e9-1fceb09f0c10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "745f6db3-f361-4030-a4cb-03ce5f561662", "address": "fa:16:3e:8c:c7:a4", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745f6db3-f3", "ovs_interfaceid": "745f6db3-f361-4030-a4cb-03ce5f561662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "745f6db3-f361-4030-a4cb-03ce5f561662", "address": "fa:16:3e:8c:c7:a4", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745f6db3-f3", "ovs_interfaceid": "745f6db3-f361-4030-a4cb-03ce5f561662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:c7:a4,bridge_name='br-int',has_traffic_filtering=True,id=745f6db3-f361-4030-a4cb-03ce5f561662,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745f6db3-f3') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.objects.instance [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:05:50 user nova-compute[74611]:   <uuid>0a689a12-e4c3-4ed3-91e9-1fceb09f0c10</uuid>
Nov 13 10:05:50 user nova-compute[74611]:   <name>instance-00000024</name>
Nov 13 10:05:50 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:05:50 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:05:50 user nova-compute[74611]:   <metadata>
Nov 13 10:05:50 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:05:50 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:05:50 user nova-compute[74611]:       <nova:name>tempest-TestVolumeBootPattern-server-1270398425</nova:name>
Nov 13 10:05:50 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:05:48</nova:creationTime>
Nov 13 10:05:50 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:05:50 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:05:50 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:05:50 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:05:50 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:05:50 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:05:50 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:05:50 user nova-compute[74611]:       <nova:owner>
Nov 13 10:05:50 user nova-compute[74611]:         <nova:user uuid="91e7d88000c1476abfb0df6bfca4e0fb">tempest-TestVolumeBootPattern-633061604-project-member</nova:user>
Nov 13 10:05:50 user nova-compute[74611]:         <nova:project uuid="f12e0c04622143f2a0c24258ab90e153">tempest-TestVolumeBootPattern-633061604</nova:project>
Nov 13 10:05:50 user nova-compute[74611]:       </nova:owner>
Nov 13 10:05:50 user nova-compute[74611]:       <nova:ports>
Nov 13 10:05:50 user nova-compute[74611]:         <nova:port uuid="745f6db3-f361-4030-a4cb-03ce5f561662">
Nov 13 10:05:50 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 10:05:50 user nova-compute[74611]:         </nova:port>
Nov 13 10:05:50 user nova-compute[74611]:       </nova:ports>
Nov 13 10:05:50 user nova-compute[74611]:     </nova:instance>
Nov 13 10:05:50 user nova-compute[74611]:   </metadata>
Nov 13 10:05:50 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:05:50 user nova-compute[74611]:     <system>
Nov 13 10:05:50 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:05:50 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:05:50 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:05:50 user nova-compute[74611]:       <entry name="serial">0a689a12-e4c3-4ed3-91e9-1fceb09f0c10</entry>
Nov 13 10:05:50 user nova-compute[74611]:       <entry name="uuid">0a689a12-e4c3-4ed3-91e9-1fceb09f0c10</entry>
Nov 13 10:05:50 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:05:50 user nova-compute[74611]:     </system>
Nov 13 10:05:50 user nova-compute[74611]:   </sysinfo>
Nov 13 10:05:50 user nova-compute[74611]:   <os>
Nov 13 10:05:50 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:05:50 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:05:50 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:05:50 user nova-compute[74611]:   </os>
Nov 13 10:05:50 user nova-compute[74611]:   <features>
Nov 13 10:05:50 user nova-compute[74611]:     <acpi/>
Nov 13 10:05:50 user nova-compute[74611]:     <apic/>
Nov 13 10:05:50 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:05:50 user nova-compute[74611]:   </features>
Nov 13 10:05:50 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:05:50 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:05:50 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:05:50 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:05:50 user nova-compute[74611]:   </clock>
Nov 13 10:05:50 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:05:50 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:05:50 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:05:50 user nova-compute[74611]:   </cpu>
Nov 13 10:05:50 user nova-compute[74611]:   <devices>
Nov 13 10:05:50 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:05:50 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:05:50 user nova-compute[74611]:       <source dev="/dev/sdg"/>
Nov 13 10:05:50 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:05:50 user nova-compute[74611]:       <serial>187e682d-b203-4996-8b12-6a3d1c4447fd</serial>
Nov 13 10:05:50 user nova-compute[74611]:     </disk>
Nov 13 10:05:50 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:05:50 user nova-compute[74611]:       <mac address="fa:16:3e:8c:c7:a4"/>
Nov 13 10:05:50 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:05:50 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:05:50 user nova-compute[74611]:       <target dev="tap745f6db3-f3"/>
Nov 13 10:05:50 user nova-compute[74611]:     </interface>
Nov 13 10:05:50 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:05:50 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/0a689a12-e4c3-4ed3-91e9-1fceb09f0c10/console.log" append="off"/>
Nov 13 10:05:50 user nova-compute[74611]:     </serial>
Nov 13 10:05:50 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:05:50 user nova-compute[74611]:     <video>
Nov 13 10:05:50 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:05:50 user nova-compute[74611]:     </video>
Nov 13 10:05:50 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:05:50 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:05:50 user nova-compute[74611]:     </rng>
Nov 13 10:05:50 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:05:50 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:05:50 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:05:50 user nova-compute[74611]:     </memballoon>
Nov 13 10:05:50 user nova-compute[74611]:   </devices>
Nov 13 10:05:50 user nova-compute[74611]: </domain>
Nov 13 10:05:50 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1270398425',display_name='tempest-TestVolumeBootPattern-server-1270398425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1270398425',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjRXcM+iAZvLJco7tBubak1kGHq/45jJ2KKO6E3tr61cFQKM/YqE/xURoOe/LdnL01vr4FH+cPhy0FHq1+WQre34a6xvIem5nHqznPEd2v959ht3Wgct9dv/En52XotjA==',key_name='tempest-TestVolumeBootPattern-1763350711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-m1matkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:05:44Z,user_data=None,user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=0a689a12-e4c3-4ed3-91e9-1fceb09f0c10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "745f6db3-f361-4030-a4cb-03ce5f561662", "address": "fa:16:3e:8c:c7:a4", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745f6db3-f3", "ovs_interfaceid": "745f6db3-f361-4030-a4cb-03ce5f561662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "745f6db3-f361-4030-a4cb-03ce5f561662", "address": "fa:16:3e:8c:c7:a4", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745f6db3-f3", "ovs_interfaceid": "745f6db3-f361-4030-a4cb-03ce5f561662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:c7:a4,bridge_name='br-int',has_traffic_filtering=True,id=745f6db3-f361-4030-a4cb-03ce5f561662,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745f6db3-f3') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG os_vif [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:c7:a4,bridge_name='br-int',has_traffic_filtering=True,id=745f6db3-f361-4030-a4cb-03ce5f561662,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745f6db3-f3') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '625eee51-1f8a-5e3f-8faf-26567c456226', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap745f6db3-f3, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap745f6db3-f3, col_values=(('qos', UUID('7929cad6-d448-480e-8db3-459530f86b60')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap745f6db3-f3, col_values=(('external_ids', {'iface-id': '745f6db3-f361-4030-a4cb-03ce5f561662', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:c7:a4', 'vm-uuid': '0a689a12-e4c3-4ed3-91e9-1fceb09f0c10'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:50 user nova-compute[74611]: INFO os_vif [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:c7:a4,bridge_name='br-int',has_traffic_filtering=True,id=745f6db3-f361-4030-a4cb-03ce5f561662,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745f6db3-f3')
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:05:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] No VIF found with MAC fa:16:3e:8c:c7:a4, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:05:51 user nova-compute[74611]: DEBUG nova.compute.manager [req-ae1b2644-5106-48d8-9e05-c71bb0532947 req-030c447f-c2c4-4057-a5a0-c973d332c308 service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Received event network-changed-69d461bc-84ce-46b4-949d-6d54d9a4454c {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:05:51 user nova-compute[74611]: DEBUG nova.compute.manager [req-ae1b2644-5106-48d8-9e05-c71bb0532947 req-030c447f-c2c4-4057-a5a0-c973d332c308 service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Refreshing instance network info cache due to event network-changed-69d461bc-84ce-46b4-949d-6d54d9a4454c. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:05:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ae1b2644-5106-48d8-9e05-c71bb0532947 req-030c447f-c2c4-4057-a5a0-c973d332c308 service nova] Acquiring lock "refresh_cache-d3c21984-13a9-422c-b9e7-f9ca79b62d81" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:05:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ae1b2644-5106-48d8-9e05-c71bb0532947 req-030c447f-c2c4-4057-a5a0-c973d332c308 service nova] Acquired lock "refresh_cache-d3c21984-13a9-422c-b9e7-f9ca79b62d81" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:05:51 user nova-compute[74611]: DEBUG nova.network.neutron [req-ae1b2644-5106-48d8-9e05-c71bb0532947 req-030c447f-c2c4-4057-a5a0-c973d332c308 service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Refreshing network info cache for port 69d461bc-84ce-46b4-949d-6d54d9a4454c {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:05:51 user nova-compute[74611]: DEBUG nova.network.neutron [req-ae1b2644-5106-48d8-9e05-c71bb0532947 req-030c447f-c2c4-4057-a5a0-c973d332c308 service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Updated VIF entry in instance network info cache for port 69d461bc-84ce-46b4-949d-6d54d9a4454c. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:05:51 user nova-compute[74611]: DEBUG nova.network.neutron [req-ae1b2644-5106-48d8-9e05-c71bb0532947 req-030c447f-c2c4-4057-a5a0-c973d332c308 service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Updating instance_info_cache with network_info: [{"id": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "address": "fa:16:3e:85:87:60", "network": {"id": "329a000f-5d8c-46fe-943f-3e8a7b854140", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392102660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c95f07c1a7a432ba2c8ed8aaa12604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d461bc-84", "ovs_interfaceid": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:05:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ae1b2644-5106-48d8-9e05-c71bb0532947 req-030c447f-c2c4-4057-a5a0-c973d332c308 service nova] Releasing lock "refresh_cache-d3c21984-13a9-422c-b9e7-f9ca79b62d81" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-02351b13-6784-4e34-8d62-ce851e24a72a req-ab094e2a-dbda-423a-8517-af637a9e900a service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Received event network-vif-plugged-745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-02351b13-6784-4e34-8d62-ce851e24a72a req-ab094e2a-dbda-423a-8517-af637a9e900a service nova] Acquiring lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-02351b13-6784-4e34-8d62-ce851e24a72a req-ab094e2a-dbda-423a-8517-af637a9e900a service nova] Lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-02351b13-6784-4e34-8d62-ce851e24a72a req-ab094e2a-dbda-423a-8517-af637a9e900a service nova] Lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-02351b13-6784-4e34-8d62-ce851e24a72a req-ab094e2a-dbda-423a-8517-af637a9e900a service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] No waiting events found dispatching network-vif-plugged-745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:05:52 user nova-compute[74611]: WARNING nova.compute.manager [req-02351b13-6784-4e34-8d62-ce851e24a72a req-ab094e2a-dbda-423a-8517-af637a9e900a service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Received unexpected event network-vif-plugged-745f6db3-f361-4030-a4cb-03ce5f561662 for instance with vm_state building and task_state spawning.
Nov 13 10:05:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG nova.compute.manager [req-9c6e57d1-87c2-4c1d-a769-a0e477992c68 req-5e64082a-954b-4017-a20f-71c645a5c913 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9c6e57d1-87c2-4c1d-a769-a0e477992c68 req-5e64082a-954b-4017-a20f-71c645a5c913 service nova] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9c6e57d1-87c2-4c1d-a769-a0e477992c68 req-5e64082a-954b-4017-a20f-71c645a5c913 service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9c6e57d1-87c2-4c1d-a769-a0e477992c68 req-5e64082a-954b-4017-a20f-71c645a5c913 service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG nova.compute.manager [req-9c6e57d1-87c2-4c1d-a769-a0e477992c68 req-5e64082a-954b-4017-a20f-71c645a5c913 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] No waiting events found dispatching network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:05:53 user nova-compute[74611]: WARNING nova.compute.manager [req-9c6e57d1-87c2-4c1d-a769-a0e477992c68 req-5e64082a-954b-4017-a20f-71c645a5c913 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received unexpected event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b for instance with vm_state stopped and task_state powering-on.
Nov 13 10:05:53 user nova-compute[74611]: DEBUG nova.compute.manager [req-9c6e57d1-87c2-4c1d-a769-a0e477992c68 req-5e64082a-954b-4017-a20f-71c645a5c913 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9c6e57d1-87c2-4c1d-a769-a0e477992c68 req-5e64082a-954b-4017-a20f-71c645a5c913 service nova] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9c6e57d1-87c2-4c1d-a769-a0e477992c68 req-5e64082a-954b-4017-a20f-71c645a5c913 service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9c6e57d1-87c2-4c1d-a769-a0e477992c68 req-5e64082a-954b-4017-a20f-71c645a5c913 service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG nova.compute.manager [req-9c6e57d1-87c2-4c1d-a769-a0e477992c68 req-5e64082a-954b-4017-a20f-71c645a5c913 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] No waiting events found dispatching network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:05:53 user nova-compute[74611]: WARNING nova.compute.manager [req-9c6e57d1-87c2-4c1d-a769-a0e477992c68 req-5e64082a-954b-4017-a20f-71c645a5c913 service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received unexpected event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b for instance with vm_state stopped and task_state powering-on.
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Acquiring lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lazy-loading 'flavor' on Instance uuid d3c21984-13a9-422c-b9e7-f9ca79b62d81 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Acquiring lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:53 user nova-compute[74611]: INFO nova.compute.manager [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Attaching volume 15901d24-a343-44a8-bd9b-46b30d5cdb2c to /dev/vdb
Nov 13 10:05:53 user nova-compute[74611]: DEBUG os_brick.utils [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[79262a87-a97f-4d64-af88-f6a67664b7cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a16bc60-0d1d-4a7e-ad6a-4c6dac0b000e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d18853-32cb-4fc0-bfbd-061eced618b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ce7f73-f17c-4083-b7a5-985318eb3e0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:05:53 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b34790e-c953-4cdc-a54a-7dab7ffa1bb5]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG os_brick.utils [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Updating existing volume attachment record: c8d322f1-16f1-4994-8c95-dcdbe8a1bc7f {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-fe555b36-30a3-42e3-9c42-11b1ed9cbbde req-c6456804-179d-4fa2-8c32-449df9886f4d service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Received event network-vif-plugged-745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fe555b36-30a3-42e3-9c42-11b1ed9cbbde req-c6456804-179d-4fa2-8c32-449df9886f4d service nova] Acquiring lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fe555b36-30a3-42e3-9c42-11b1ed9cbbde req-c6456804-179d-4fa2-8c32-449df9886f4d service nova] Lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fe555b36-30a3-42e3-9c42-11b1ed9cbbde req-c6456804-179d-4fa2-8c32-449df9886f4d service nova] Lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-fe555b36-30a3-42e3-9c42-11b1ed9cbbde req-c6456804-179d-4fa2-8c32-449df9886f4d service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] No waiting events found dispatching network-vif-plugged-745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:05:54 user nova-compute[74611]: WARNING nova.compute.manager [req-fe555b36-30a3-42e3-9c42-11b1ed9cbbde req-c6456804-179d-4fa2-8c32-449df9886f4d service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Received unexpected event network-vif-plugged-745f6db3-f361-4030-a4cb-03ce5f561662 for instance with vm_state building and task_state spawning.
Nov 13 10:05:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:05:55 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Instance spawned successfully.
Nov 13 10:05:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:05:55 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Instance rebooted successfully.
Nov 13 10:05:55 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dd31d13e-d2ed-49cc-954f-08bbf3db54b7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.286s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:55 user nova-compute[74611]: INFO nova.compute.manager [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Took 6.50 seconds to spawn the instance on the hypervisor.
Nov 13 10:05:55 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:55 user nova-compute[74611]: INFO nova.compute.manager [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Took 11.69 seconds to build instance.
Nov 13 10:05:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4719faa6-9e04-4ba8-bbcc-d52664576a5d tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.834s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:05:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:57 user nova-compute[74611]: DEBUG nova.compute.manager [req-5131eece-f3c7-4f6c-858f-d28242df380d req-5246ae18-2b28-4295-8247-2cd95496731a service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Received event network-changed-9bde4c80-c890-47fb-9e43-db74946b103b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:05:57 user nova-compute[74611]: DEBUG nova.compute.manager [req-5131eece-f3c7-4f6c-858f-d28242df380d req-5246ae18-2b28-4295-8247-2cd95496731a service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Refreshing instance network info cache due to event network-changed-9bde4c80-c890-47fb-9e43-db74946b103b. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:05:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5131eece-f3c7-4f6c-858f-d28242df380d req-5246ae18-2b28-4295-8247-2cd95496731a service nova] Acquiring lock "refresh_cache-ad645ec3-086e-4bfe-b10e-b0a2ff32720d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:05:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5131eece-f3c7-4f6c-858f-d28242df380d req-5246ae18-2b28-4295-8247-2cd95496731a service nova] Acquired lock "refresh_cache-ad645ec3-086e-4bfe-b10e-b0a2ff32720d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:05:57 user nova-compute[74611]: DEBUG nova.network.neutron [req-5131eece-f3c7-4f6c-858f-d28242df380d req-5246ae18-2b28-4295-8247-2cd95496731a service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Refreshing network info cache for port 9bde4c80-c890-47fb-9e43-db74946b103b {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:05:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:05:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:05:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG nova.network.neutron [req-5131eece-f3c7-4f6c-858f-d28242df380d req-5246ae18-2b28-4295-8247-2cd95496731a service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Updated VIF entry in instance network info cache for port 9bde4c80-c890-47fb-9e43-db74946b103b. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG nova.network.neutron [req-5131eece-f3c7-4f6c-858f-d28242df380d req-5246ae18-2b28-4295-8247-2cd95496731a service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Updating instance_info_cache with network_info: [{"id": "9bde4c80-c890-47fb-9e43-db74946b103b", "address": "fa:16:3e:86:8d:ba", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bde4c80-c8", "ovs_interfaceid": "9bde4c80-c890-47fb-9e43-db74946b103b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JSbmNZlM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:05:58 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:05:58 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:05:58 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5131eece-f3c7-4f6c-858f-d28242df380d req-5246ae18-2b28-4295-8247-2cd95496731a service nova] Releasing lock "refresh_cache-ad645ec3-086e-4bfe-b10e-b0a2ff32720d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[449b7cfc-22fe-4f47-bc20-3fe97c39f977]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:05:58 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[367d1c70-7381-4cb5-8176-8f88beee09c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c] added
Nov 13 10:05:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f107546-477f-4025-bd60-04659765ae97]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[64271a42-98aa-44b2-8021-ff06f998a772]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JSbmNZlM {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JSbmNZlM" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e780c7b-395e-4225-8d53-56b9cceb39eb]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JSbmNZlM'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[168c3a67-b615-42ac-9a7e-9b7599e6c464]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1b7811-e1a7-4926-b06f-5f3ddaf51379]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:05:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:05:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8271533-b679-4cb1-999e-4d5b408c37f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c, portal: 172.16.0.220,3260]
Nov 13 10:05:58 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c, portal: 172.16.0.220,3260] successful.
Nov 13 10:05:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b6a160-5054-446e-8bc8-57e597c0fcf3]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c5a53f-3a38-4d33-8b72-397bf09b7421]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c (non-flash)
Nov 13 10:05:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:05:58 user nova-compute[74611]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c (non-flash)
Nov 13 10:05:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] HCTL ('39', '-', '-', 0) found on session 35 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2c066c-cf0c-4860-bcc7-67ef18776d07]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Searching for a device in session 35 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JSbmNZlM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:05:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:05:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:05:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:05:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:05:59 user nova-compute[74611]: DEBUG nova.objects.instance [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'flavor' on Instance uuid ad645ec3-086e-4bfe-b10e-b0a2ff32720d {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.771s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] <== connect_volume: return (1773ms) {'type': 'block', 'scsi_wwn': '23938643664323533', 'path': '/dev/sdh'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938643664323533', 'path': '/dev/sdh'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:06:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:06:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=6841MB free_disk=25.069721221923828GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lazy-loading 'flavor' on Instance uuid d3c21984-13a9-422c-b9e7-f9ca79b62d81 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.595s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:06:00 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:06:00 user nova-compute[74611]:   <source dev="/dev/sdh"/>
Nov 13 10:06:00 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:06:00 user nova-compute[74611]:   <serial>15901d24-a343-44a8-bd9b-46b30d5cdb2c</serial>
Nov 13 10:06:00 user nova-compute[74611]: </disk>
Nov 13 10:06:00 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:00 user nova-compute[74611]: INFO nova.compute.manager [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Attaching volume cd806409-d2e0-4a98-aea0-90da583b7150 to /dev/vdb
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 85cb3adb-b2b3-49ec-92ab-c2b7a028241a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance e99e1557-500f-407e-aefc-3b5cde9ceba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4fa9e23b-30f2-41ae-83ed-86145389d474 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 635636ea-96a0-4fdb-85a1-ca7a87b762f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7eff589b-8f0f-4e6e-ac04-567da455e579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance d3c21984-13a9-422c-b9e7-f9ca79b62d81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ad645ec3-086e-4bfe-b10e-b0a2ff32720d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 9e5b488b-a309-465f-8276-b24cb0d88888 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 261e3e34-7a30-42f5-ae31-c3d3a76d0d67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f059d809-84b0-40c4-be84-bc89a9dc182e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG os_brick.utils [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[203c880d-4276-4748-a23e-6ced2ddd88a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c27021-7184-4aec-b3f3-b2452a870916]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26f307a-4c37-4621-ac68-ba39af2fd297]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[40826013-5d25-4f91-9f86-ce68ed4e86d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:06:00 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b5cfa1-5ea7-4b75-a01c-55b08e10abd3]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG os_brick.utils [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Updating existing volume attachment record: 891550ac-5783-44e5-9147-5a7c519c80f1 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:06:00 user nova-compute[74611]: INFO nova.compute.manager [None req-8da42514-ab50-49a9-9efa-34a7d901903b tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Unrescuing
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8da42514-ab50-49a9-9efa-34a7d901903b tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8da42514-ab50-49a9-9efa-34a7d901903b tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquired lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.network.neutron [None req-8da42514-ab50-49a9-9efa-34a7d901903b tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] No VIF found with MAC fa:16:3e:85:87:60, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:06:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6c2dcc93-0851-443b-a3e1-e233a4c16513 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.378s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:01 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:06:01 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:06:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:06:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.030s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:01 user nova-compute[74611]: DEBUG nova.network.neutron [None req-8da42514-ab50-49a9-9efa-34a7d901903b tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Updating instance_info_cache with network_info: [{"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:06:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8da42514-ab50-49a9-9efa-34a7d901903b tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Releasing lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:06:01 user nova-compute[74611]: DEBUG nova.objects.instance [None req-8da42514-ab50-49a9-9efa-34a7d901903b tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'flavor' on Instance uuid 4fa9e23b-30f2-41ae-83ed-86145389d474 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:06:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-0a3a088e-b9fe-4894-8e2d-3b3f72002fd1 req-2eba1f6c-edc8-4df6-8f40-90d4ec629f1b service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-vif-unplugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:06:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0a3a088e-b9fe-4894-8e2d-3b3f72002fd1 req-2eba1f6c-edc8-4df6-8f40-90d4ec629f1b service nova] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0a3a088e-b9fe-4894-8e2d-3b3f72002fd1 req-2eba1f6c-edc8-4df6-8f40-90d4ec629f1b service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0a3a088e-b9fe-4894-8e2d-3b3f72002fd1 req-2eba1f6c-edc8-4df6-8f40-90d4ec629f1b service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-0a3a088e-b9fe-4894-8e2d-3b3f72002fd1 req-2eba1f6c-edc8-4df6-8f40-90d4ec629f1b service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] No waiting events found dispatching network-vif-unplugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:06:01 user nova-compute[74611]: WARNING nova.compute.manager [req-0a3a088e-b9fe-4894-8e2d-3b3f72002fd1 req-2eba1f6c-edc8-4df6-8f40-90d4ec629f1b service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received unexpected event network-vif-unplugged-ffb1eb13-f028-447f-a01d-45bae2d17edd for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:06:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:02 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Instance destroyed successfully.
Nov 13 10:06:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Acquiring lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:02 user nova-compute[74611]: INFO nova.compute.manager [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Detaching volume 15901d24-a343-44a8-bd9b-46b30d5cdb2c
Nov 13 10:06:03 user nova-compute[74611]: INFO nova.virt.block_device [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Attempting to driver detach volume 15901d24-a343-44a8-bd9b-46b30d5cdb2c from mountpoint /dev/vdb
Nov 13 10:06:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Attempting to detach device vdb from instance d3c21984-13a9-422c-b9e7-f9ca79b62d81 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:06:03 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:06:03 user nova-compute[74611]:   <source dev="/dev/sdh"/>
Nov 13 10:06:03 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:06:03 user nova-compute[74611]:   <serial>15901d24-a343-44a8-bd9b-46b30d5cdb2c</serial>
Nov 13 10:06:03 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:06:03 user nova-compute[74611]: </disk>
Nov 13 10:06:03 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:06:03 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Successfully detached device vdb from instance d3c21984-13a9-422c-b9e7-f9ca79b62d81 from the persistent domain config.
Nov 13 10:06:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3c21984-13a9-422c-b9e7-f9ca79b62d81 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:06:03 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:06:03 user nova-compute[74611]:   <source dev="/dev/sdh"/>
Nov 13 10:06:03 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:06:03 user nova-compute[74611]:   <serial>15901d24-a343-44a8-bd9b-46b30d5cdb2c</serial>
Nov 13 10:06:03 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:06:03 user nova-compute[74611]: </disk>
Nov 13 10:06:03 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG nova.compute.manager [req-dc3160d1-4943-466b-8b86-fcaf25dba4da req-e3eb7cc0-17bb-4cf4-a19f-ee2f9c18f6aa service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dc3160d1-4943-466b-8b86-fcaf25dba4da req-e3eb7cc0-17bb-4cf4-a19f-ee2f9c18f6aa service nova] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dc3160d1-4943-466b-8b86-fcaf25dba4da req-e3eb7cc0-17bb-4cf4-a19f-ee2f9c18f6aa service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dc3160d1-4943-466b-8b86-fcaf25dba4da req-e3eb7cc0-17bb-4cf4-a19f-ee2f9c18f6aa service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG nova.compute.manager [req-dc3160d1-4943-466b-8b86-fcaf25dba4da req-e3eb7cc0-17bb-4cf4-a19f-ee2f9c18f6aa service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] No waiting events found dispatching network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:06:03 user nova-compute[74611]: WARNING nova.compute.manager [req-dc3160d1-4943-466b-8b86-fcaf25dba4da req-e3eb7cc0-17bb-4cf4-a19f-ee2f9c18f6aa service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received unexpected event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:06:03 user nova-compute[74611]: DEBUG nova.compute.manager [req-dc3160d1-4943-466b-8b86-fcaf25dba4da req-e3eb7cc0-17bb-4cf4-a19f-ee2f9c18f6aa service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dc3160d1-4943-466b-8b86-fcaf25dba4da req-e3eb7cc0-17bb-4cf4-a19f-ee2f9c18f6aa service nova] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dc3160d1-4943-466b-8b86-fcaf25dba4da req-e3eb7cc0-17bb-4cf4-a19f-ee2f9c18f6aa service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dc3160d1-4943-466b-8b86-fcaf25dba4da req-e3eb7cc0-17bb-4cf4-a19f-ee2f9c18f6aa service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:03 user nova-compute[74611]: DEBUG nova.compute.manager [req-dc3160d1-4943-466b-8b86-fcaf25dba4da req-e3eb7cc0-17bb-4cf4-a19f-ee2f9c18f6aa service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] No waiting events found dispatching network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:06:03 user nova-compute[74611]: WARNING nova.compute.manager [req-dc3160d1-4943-466b-8b86-fcaf25dba4da req-e3eb7cc0-17bb-4cf4-a19f-ee2f9c18f6aa service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received unexpected event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:06:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3c21984-13a9-422c-b9e7-f9ca79b62d81 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:06:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lzAQOaGb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:06:05 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:06:05 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:06:05 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[666e78d7-5877-4f26-bece-77e484f31859]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:06:05 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[71724a37-6f51-44b4-ac5b-62fdf91db6b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150] added
Nov 13 10:06:05 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ace2178-5b74-4474-9803-da4ee7217cd4]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e81bd8d-449d-46e4-ba3b-ebfc13a34cea]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lzAQOaGb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lzAQOaGb" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d21efc8-8050-47d5-a3bc-dfbc3e6bc461]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lzAQOaGb'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6930f685-99db-4696-a4b6-4e51464ad914]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b954f1-bd6a-4565-8951-2759d6a0b24f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c (non-flash)
Nov 13 10:06:05 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c (non-flash)
Nov 13 10:06:05 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd9f0f2-2717-42c6-9a13-1203c2e9c2d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150, portal: 172.16.0.220,3260]
Nov 13 10:06:05 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150, portal: 172.16.0.220,3260] successful.
Nov 13 10:06:05 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0be846-0455-4f17-8399-84f7c6f2d19c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d3697d-52de-42e0-9ccb-9741df703506]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 (non-flash)
Nov 13 10:06:05 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c (non-flash)
Nov 13 10:06:05 user nova-compute[74611]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 (non-flash)
Nov 13 10:06:05 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] HCTL ('40', '-', '-', 0) found on session 36 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9b0055-c663-49ee-b737-50272d1fc387]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Searching for a device in session 36 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lzAQOaGb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-c1cd1207-33d0-42bc-94d5-ed095c3fb8d7 req-9935c7eb-b5e8-42f7-8af3-43e4590b1e7c service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c1cd1207-33d0-42bc-94d5-ed095c3fb8d7 req-9935c7eb-b5e8-42f7-8af3-43e4590b1e7c service nova] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c1cd1207-33d0-42bc-94d5-ed095c3fb8d7 req-9935c7eb-b5e8-42f7-8af3-43e4590b1e7c service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c1cd1207-33d0-42bc-94d5-ed095c3fb8d7 req-9935c7eb-b5e8-42f7-8af3-43e4590b1e7c service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-c1cd1207-33d0-42bc-94d5-ed095c3fb8d7 req-9935c7eb-b5e8-42f7-8af3-43e4590b1e7c service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] No waiting events found dispatching network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:06:05 user nova-compute[74611]: WARNING nova.compute.manager [req-c1cd1207-33d0-42bc-94d5-ed095c3fb8d7 req-9935c7eb-b5e8-42f7-8af3-43e4590b1e7c service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received unexpected event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:06:06 user nova-compute[74611]: DEBUG nova.compute.manager [None req-8da42514-ab50-49a9-9efa-34a7d901903b tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:06:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:06:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23134363131663364', 'path': '/dev/sdi'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:06:06 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134363131663364', 'path': '/dev/sdi'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:06:06 user nova-compute[74611]: DEBUG nova.objects.instance [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'flavor' on Instance uuid ad645ec3-086e-4bfe-b10e-b0a2ff32720d {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:06:06 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:06:06 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:06:06 user nova-compute[74611]:   <source dev="/dev/sdi"/>
Nov 13 10:06:06 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:06:06 user nova-compute[74611]:   <serial>cd806409-d2e0-4a98-aea0-90da583b7150</serial>
Nov 13 10:06:06 user nova-compute[74611]: </disk>
Nov 13 10:06:06 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:06:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:06:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:06:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] No VIF found with MAC fa:16:3e:86:8d:ba, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:06:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a7692eae-09f2-4d89-ac57-d765125ed47a tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.967s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:08 user nova-compute[74611]: INFO nova.compute.manager [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Detaching volume cd806409-d2e0-4a98-aea0-90da583b7150
Nov 13 10:06:08 user nova-compute[74611]: INFO nova.virt.block_device [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Attempting to driver detach volume cd806409-d2e0-4a98-aea0-90da583b7150 from mountpoint /dev/vdb
Nov 13 10:06:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Attempting to detach device vdb from instance ad645ec3-086e-4bfe-b10e-b0a2ff32720d from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:06:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:06:08 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:06:08 user nova-compute[74611]:   <source dev="/dev/sdi"/>
Nov 13 10:06:08 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:06:08 user nova-compute[74611]:   <serial>cd806409-d2e0-4a98-aea0-90da583b7150</serial>
Nov 13 10:06:08 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:06:08 user nova-compute[74611]: </disk>
Nov 13 10:06:08 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:06:08 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Successfully detached device vdb from instance ad645ec3-086e-4bfe-b10e-b0a2ff32720d from the persistent domain config.
Nov 13 10:06:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad645ec3-086e-4bfe-b10e-b0a2ff32720d from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:06:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:06:08 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:06:08 user nova-compute[74611]:   <source dev="/dev/sdi"/>
Nov 13 10:06:08 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:06:08 user nova-compute[74611]:   <serial>cd806409-d2e0-4a98-aea0-90da583b7150</serial>
Nov 13 10:06:08 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:06:08 user nova-compute[74611]: </disk>
Nov 13 10:06:08 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:06:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad645ec3-086e-4bfe-b10e-b0a2ff32720d {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:06:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:23 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d3c21984-13a9-422c-b9e7-f9ca79b62d81 is timed out.
Nov 13 10:06:23 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Successfully detached device vdb from instance d3c21984-13a9-422c-b9e7-f9ca79b62d81 from the live domain config.
Nov 13 10:06:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JSbmNZlM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:06:23 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:06:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7939c7-14de-411d-93b2-27cbbd98eb7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:06:23 user nova-compute[74611]: No targets found.
Nov 13 10:06:23 user nova-compute[74611]: iSNS:
Nov 13 10:06:23 user nova-compute[74611]: No targets found.
Nov 13 10:06:23 user nova-compute[74611]: STATIC:
Nov 13 10:06:23 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc
Nov 13 10:06:23 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:23 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:23 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f
Nov 13 10:06:23 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:23 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:23 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d
Nov 13 10:06:23 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:23 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:23 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40
Nov 13 10:06:23 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:23 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:23 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd
Nov 13 10:06:23 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:23 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:23 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c
Nov 13 10:06:23 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:23 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:23 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:06:23 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:23 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:23 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150
Nov 13 10:06:23 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:23 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:23 user nova-compute[74611]: FIRMWARE:
Nov 13 10:06:23 user nova-compute[74611]: No targets found.
Nov 13 10:06:23 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:06:23 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:06:23 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a28732-1131-4794-bc74-0d6cb1087f6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[063d5bf7-a871-481d-98ce-94fa88af8464]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:06:23 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:06:23 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:06:23 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:06:23 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:06:23 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:06:23 user nova-compute[74611]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c (non-flash)
Nov 13 10:06:23 user nova-compute[74611]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 (non-flash)
Nov 13 10:06:23 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:06:23 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:06:23 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:06:23 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:06:23 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:06:23 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:06:23 user nova-compute[74611]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c (non-flash)
Nov 13 10:06:23 user nova-compute[74611]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 (non-flash)
Nov 13 10:06:23 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8424de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c'): ({'sdh'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Removing single pathed devices sdh {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[06518f72-fd3e-4e60-984c-37a38ddd228f]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c55acb-4be8-436e-bc6d-ffeacf3ac538]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Flushing IO for device /dev/sdh {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d13acb9-376f-46f5-8c56-613d0a38b135]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:06:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f06e7b6-504c-420f-bbdf-27d8443e5405]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] SCSI volumes sdh have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21e16b9-cc62-4cd5-b7cb-a820e933a240]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e5f12d-3c83-45bb-a647-5501d201d8ae]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c, portal: 172.16.0.220,3260]
Nov 13 10:06:24 user nova-compute[74611]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c, portal: 172.16.0.220,3260] successful.
Nov 13 10:06:24 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15901d24-a343-44a8-bd9b-46b30d5cdb2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3187d5f0-d593-4c6b-975a-3ac2be4d35c2]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] <== disconnect_volume: return (336ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG nova.objects.instance [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lazy-loading 'flavor' on Instance uuid d3c21984-13a9-422c-b9e7-f9ca79b62d81 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:06:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cca6abbe-d446-4db4-bce7-f3d1aedc374f tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.975s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:29 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ad645ec3-086e-4bfe-b10e-b0a2ff32720d is timed out.
Nov 13 10:06:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:29 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Successfully detached device vdb from instance ad645ec3-086e-4bfe-b10e-b0a2ff32720d from the live domain config.
Nov 13 10:06:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lzAQOaGb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:06:29 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[786db776-a90f-4e4b-b404-f478eeb85fab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:06:29 user nova-compute[74611]: No targets found.
Nov 13 10:06:29 user nova-compute[74611]: iSNS:
Nov 13 10:06:29 user nova-compute[74611]: No targets found.
Nov 13 10:06:29 user nova-compute[74611]: STATIC:
Nov 13 10:06:29 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc
Nov 13 10:06:29 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:29 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:29 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f
Nov 13 10:06:29 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:29 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:29 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d
Nov 13 10:06:29 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:29 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:29 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40
Nov 13 10:06:29 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:29 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:29 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd
Nov 13 10:06:29 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:29 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:29 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:06:29 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:29 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:29 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150
Nov 13 10:06:29 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:29 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:29 user nova-compute[74611]: FIRMWARE:
Nov 13 10:06:29 user nova-compute[74611]: No targets found.
Nov 13 10:06:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:06:29 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:06:29 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6dd545-1c4e-452b-a020-d464d92c5ef5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e830a01b-8d9b-4ca0-a1dc-b5d758afc8d0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:06:29 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:06:29 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:06:29 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:06:29 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:06:29 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:06:29 user nova-compute[74611]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 (non-flash)
Nov 13 10:06:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:06:29 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:06:29 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:06:29 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:06:29 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:06:29 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:06:29 user nova-compute[74611]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 (non-flash)
Nov 13 10:06:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64629d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150'): ({'sdi'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Removing single pathed devices sdi {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[735294f1-3e60-4334-81f4-eaedfd5be14a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebeaea66-e401-4bc0-b8fa-05de843f2154]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Flushing IO for device /dev/sdi {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6896efb-e05f-45dd-aba1-468e9d90122e]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.049s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff85186-d34b-4feb-81ee-c22a37590f7f]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] SCSI volumes sdi have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb6e507-6847-400a-bbd6-859d3bc9f79e]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c4eb0c-f593-43ad-a827-03984968b050]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150, portal: 172.16.0.220,3260]
Nov 13 10:06:29 user nova-compute[74611]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150, portal: 172.16.0.220,3260] successful.
Nov 13 10:06:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd806409-d2e0-4a98-aea0-90da583b7150 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f47c3c4-9788-4cac-8d32-8b3463454ca9]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] <== disconnect_volume: return (316ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:06:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Acquiring lock "9e5b488b-a309-465f-8276-b24cb0d88888" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "9e5b488b-a309-465f-8276-b24cb0d88888" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG nova.objects.instance [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lazy-loading 'flavor' on Instance uuid 9e5b488b-a309-465f-8276-b24cb0d88888 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG nova.objects.instance [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'flavor' on Instance uuid ad645ec3-086e-4bfe-b10e-b0a2ff32720d {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "9e5b488b-a309-465f-8276-b24cb0d88888" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ad96f695-7ef6-45d7-b808-e49bdc4af12d tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.699s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Acquiring lock "9e5b488b-a309-465f-8276-b24cb0d88888" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "9e5b488b-a309-465f-8276-b24cb0d88888" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:30 user nova-compute[74611]: INFO nova.compute.manager [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Attaching volume c9eae4e2-b861-4d99-941a-0460f356d00d to /dev/vdb
Nov 13 10:06:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG os_brick.utils [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dd34a2-d12d-410c-961a-57fb61e149a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc589ce3-5489-45ef-94ea-be9452817416]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4516ec1-96e8-48c4-bf3a-e9165db65c37]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[930f9a28-7e02-4127-a7bf-b79e62947422]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:06:30 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:06:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc842e01-499b-47a4-98c7-cea27d6d4692]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG os_brick.utils [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:06:30 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Updating existing volume attachment record: 66b945a7-0bd9-4226-b6c6-3a342a2e8855 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puGqZbRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:06:34 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:06:34 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:06:34 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1eb59a-aefb-4bca-8254-209d7710186c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:06:34 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d919d2-f6fe-45f7-bab5-e5b550684c89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d] added
Nov 13 10:06:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5548b946-66e1-473b-8170-48391c451cbf]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cf0da5-540b-46ad-99b0-0c8992a94ea8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v puGqZbRP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v puGqZbRP" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9098f019-20dd-4433-b392-d2d54ddff356]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'puGqZbRP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce56c75c-9ef4-4702-8e25-7cd4c04d4f24]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71f32b7-98bc-4ca2-ada8-687b02fb68ed]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:06:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:06:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f51d9c-d7fb-4cad-b3fd-83f2aaa5b124]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d, portal: 172.16.0.220,3260]
Nov 13 10:06:34 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d, portal: 172.16.0.220,3260] successful.
Nov 13 10:06:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6d9281-7f41-435f-9605-8d7471940a26]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f81778-f857-411d-8981-ed2462cf6239]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d (non-flash)
Nov 13 10:06:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:06:34 user nova-compute[74611]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d (non-flash)
Nov 13 10:06:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] HCTL ('39', '-', '-', 0) found on session 37 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3a0b54-6ee0-493e-a788-7a0f337ec93d]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Searching for a device in session 37 and hctl ['39', '*', '*', 0] yield: None {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:06:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:35 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Searching for a device in session 37 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:06:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puGqZbRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:06:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:06:35 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26637616337333833', 'path': '/dev/sdh'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:06:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637616337333833', 'path': '/dev/sdh'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:06:35 user nova-compute[74611]: DEBUG nova.objects.instance [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lazy-loading 'flavor' on Instance uuid 9e5b488b-a309-465f-8276-b24cb0d88888 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:06:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:06:35 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:06:35 user nova-compute[74611]:   <source dev="/dev/sdh"/>
Nov 13 10:06:35 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:06:35 user nova-compute[74611]:   <serial>c9eae4e2-b861-4d99-941a-0460f356d00d</serial>
Nov 13 10:06:35 user nova-compute[74611]: </disk>
Nov 13 10:06:35 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:06:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:06:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:06:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] No VIF found with MAC fa:16:3e:de:7c:24, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:06:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95ab313a-6508-4f84-8666-faf9d5b55583 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "9e5b488b-a309-465f-8276-b24cb0d88888" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.086s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Acquiring lock "9e5b488b-a309-465f-8276-b24cb0d88888" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "9e5b488b-a309-465f-8276-b24cb0d88888" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Acquiring lock "9e5b488b-a309-465f-8276-b24cb0d88888-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "9e5b488b-a309-465f-8276-b24cb0d88888-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "9e5b488b-a309-465f-8276-b24cb0d88888-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:36 user nova-compute[74611]: INFO nova.compute.manager [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Terminating instance
Nov 13 10:06:36 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:06:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-960087f4-7a5d-4d01-ab25-90a3c0c5e6a9 req-683a7321-fa40-4451-8242-4624be6b11fb service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Received event network-vif-unplugged-ad463560-037c-4266-8570-3eb8adbc06a8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-960087f4-7a5d-4d01-ab25-90a3c0c5e6a9 req-683a7321-fa40-4451-8242-4624be6b11fb service nova] Acquiring lock "9e5b488b-a309-465f-8276-b24cb0d88888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-960087f4-7a5d-4d01-ab25-90a3c0c5e6a9 req-683a7321-fa40-4451-8242-4624be6b11fb service nova] Lock "9e5b488b-a309-465f-8276-b24cb0d88888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-960087f4-7a5d-4d01-ab25-90a3c0c5e6a9 req-683a7321-fa40-4451-8242-4624be6b11fb service nova] Lock "9e5b488b-a309-465f-8276-b24cb0d88888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-960087f4-7a5d-4d01-ab25-90a3c0c5e6a9 req-683a7321-fa40-4451-8242-4624be6b11fb service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] No waiting events found dispatching network-vif-unplugged-ad463560-037c-4266-8570-3eb8adbc06a8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-960087f4-7a5d-4d01-ab25-90a3c0c5e6a9 req-683a7321-fa40-4451-8242-4624be6b11fb service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Received event network-vif-unplugged-ad463560-037c-4266-8570-3eb8adbc06a8 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:06:37 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Instance destroyed successfully.
Nov 13 10:06:37 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lazy-loading 'resources' on Instance uuid 9e5b488b-a309-465f-8276-b24cb0d88888 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1150832439',display_name='tempest-DeleteServersTestJSON-server-1150832439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1150832439',id=34,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:04:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b501aee216574b75a8f03ddaeebcf292',ramdisk_id='',reservation_id='r-0j4gu0rr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-798365249',owner_user_name='tempest-DeleteServersTestJSON-798365249-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:04:47Z,user_data=None,user_id='505ed8495612439cbc5dcf5fd32e0a4d',uuid=9e5b488b-a309-465f-8276-b24cb0d88888,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad463560-037c-4266-8570-3eb8adbc06a8", "address": "fa:16:3e:de:7c:24", "network": {"id": "3f2d42fb-380b-41fc-8da0-3f60aa59de75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1201487217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b501aee216574b75a8f03ddaeebcf292", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad463560-03", "ovs_interfaceid": "ad463560-037c-4266-8570-3eb8adbc06a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Converting VIF {"id": "ad463560-037c-4266-8570-3eb8adbc06a8", "address": "fa:16:3e:de:7c:24", "network": {"id": "3f2d42fb-380b-41fc-8da0-3f60aa59de75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1201487217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b501aee216574b75a8f03ddaeebcf292", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad463560-03", "ovs_interfaceid": "ad463560-037c-4266-8570-3eb8adbc06a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:7c:24,bridge_name='br-int',has_traffic_filtering=True,id=ad463560-037c-4266-8570-3eb8adbc06a8,network=Network(3f2d42fb-380b-41fc-8da0-3f60aa59de75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad463560-03') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_vif [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:7c:24,bridge_name='br-int',has_traffic_filtering=True,id=ad463560-037c-4266-8570-3eb8adbc06a8,network=Network(3f2d42fb-380b-41fc-8da0-3f60aa59de75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad463560-03') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad463560-03, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e7743b9-c7a4-4bbc-8655-fb2d875deafa) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:37 user nova-compute[74611]: INFO os_vif [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:7c:24,bridge_name='br-int',has_traffic_filtering=True,id=ad463560-037c-4266-8570-3eb8adbc06a8,network=Network(3f2d42fb-380b-41fc-8da0-3f60aa59de75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad463560-03')
Nov 13 10:06:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puGqZbRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:06:37 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af3c64e-2fb8-41dc-a6b4-76ebd1b8db5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:06:37 user nova-compute[74611]: No targets found.
Nov 13 10:06:37 user nova-compute[74611]: iSNS:
Nov 13 10:06:37 user nova-compute[74611]: No targets found.
Nov 13 10:06:37 user nova-compute[74611]: STATIC:
Nov 13 10:06:37 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc
Nov 13 10:06:37 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:37 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:37 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f
Nov 13 10:06:37 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:37 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:37 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d
Nov 13 10:06:37 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:37 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:37 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40
Nov 13 10:06:37 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:37 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:37 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d
Nov 13 10:06:37 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:37 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:37 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd
Nov 13 10:06:37 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:37 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:37 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:06:37 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:06:37 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:06:37 user nova-compute[74611]: FIRMWARE:
Nov 13 10:06:37 user nova-compute[74611]: No targets found.
Nov 13 10:06:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:06:37 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:06:37 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccf3157-6835-4363-99c5-dd9d1e97f287]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda723a7-fb7d-4eda-83b6-12d54afb242f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:06:37 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:06:37 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:06:37 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:06:37 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:06:37 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:06:37 user nova-compute[74611]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d (non-flash)
Nov 13 10:06:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:06:37 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:06:37 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:06:37 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:06:37 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:06:37 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:06:37 user nova-compute[74611]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d (non-flash)
Nov 13 10:06:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb645cf5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d'): ({'sdh'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Removing single pathed devices sdh {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1dcb27-bdd5-43fa-8987-1a2476c2fc75]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[226360fa-2e57-43c9-bc82-0c5e943593ad]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Flushing IO for device /dev/sdh {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a17c0c4-a2d3-479a-a8c6-8355ece38d8a]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.051s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11592b9-e04c-43ef-8c00-88153f7d5729]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] SCSI volumes sdh have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e935a36-76a6-47d1-be52-c159a5cbc526]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:38 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c50cf6-6da1-420b-b369-3e7a774dc804]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d, portal: 172.16.0.220,3260]
Nov 13 10:06:38 user nova-compute[74611]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d, portal: 172.16.0.220,3260] successful.
Nov 13 10:06:38 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9eae4e2-b861-4d99-941a-0460f356d00d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:38 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1052e721-e8b0-4679-9477-798a712c4410]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:06:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:06:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:06:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] <== disconnect_volume: return (332ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:06:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:06:38 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Deleting instance files /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888_del
Nov 13 10:06:38 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Deletion of /opt/stack/data/nova/instances/9e5b488b-a309-465f-8276-b24cb0d88888_del complete
Nov 13 10:06:38 user nova-compute[74611]: INFO nova.compute.manager [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 13 10:06:38 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:06:38 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:06:38 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:06:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:38 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:06:38 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Took 0.44 seconds to deallocate network for instance.
Nov 13 10:06:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-7037bb3d-3a9d-46be-882c-366dd39252c4 req-b0b45f46-fde1-4b99-8a58-dd8048d1a9ab service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Received event network-vif-deleted-ad463560-037c-4266-8570-3eb8adbc06a8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:06:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-4a6af268-6fa4-4600-8a9b-00ef42fca1a6 req-c802accd-52fc-4a91-8c03-58758cab1735 service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Received event network-vif-plugged-ad463560-037c-4266-8570-3eb8adbc06a8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:06:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4a6af268-6fa4-4600-8a9b-00ef42fca1a6 req-c802accd-52fc-4a91-8c03-58758cab1735 service nova] Acquiring lock "9e5b488b-a309-465f-8276-b24cb0d88888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4a6af268-6fa4-4600-8a9b-00ef42fca1a6 req-c802accd-52fc-4a91-8c03-58758cab1735 service nova] Lock "9e5b488b-a309-465f-8276-b24cb0d88888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4a6af268-6fa4-4600-8a9b-00ef42fca1a6 req-c802accd-52fc-4a91-8c03-58758cab1735 service nova] Lock "9e5b488b-a309-465f-8276-b24cb0d88888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-4a6af268-6fa4-4600-8a9b-00ef42fca1a6 req-c802accd-52fc-4a91-8c03-58758cab1735 service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] No waiting events found dispatching network-vif-plugged-ad463560-037c-4266-8570-3eb8adbc06a8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:06:39 user nova-compute[74611]: WARNING nova.compute.manager [req-4a6af268-6fa4-4600-8a9b-00ef42fca1a6 req-c802accd-52fc-4a91-8c03-58758cab1735 service nova] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Received unexpected event network-vif-plugged-ad463560-037c-4266-8570-3eb8adbc06a8 for instance with vm_state active and task_state deleting.
Nov 13 10:06:39 user nova-compute[74611]: INFO nova.compute.manager [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] [instance: 9e5b488b-a309-465f-8276-b24cb0d88888] Took 0.69 seconds to detach 1 volumes for instance.
Nov 13 10:06:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:39 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:06:39 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:06:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:39 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Deleted allocations for instance 9e5b488b-a309-465f-8276-b24cb0d88888
Nov 13 10:06:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd54f8dc-fca4-48b7-90f0-ab1ba5f67cc2 tempest-DeleteServersTestJSON-798365249 tempest-DeleteServersTestJSON-798365249-project-member] Lock "9e5b488b-a309-465f-8276-b24cb0d88888" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.915s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:42 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:06:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:06:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:06:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:06:42 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:06:42 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Updating instance_info_cache with network_info: [{"id": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "address": "fa:16:3e:b7:e1:19", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ef27e1-e7", "ovs_interfaceid": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:06:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:06:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:06:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:45 user nova-compute[74611]: INFO nova.compute.manager [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Terminating instance
Nov 13 10:06:45 user nova-compute[74611]: DEBUG nova.compute.manager [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-4f28d959-0cd4-43d3-8cf6-9e5f1420dcd9 req-312a613d-a679-4ae1-980c-aac9ea9cda99 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received event network-vif-unplugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4f28d959-0cd4-43d3-8cf6-9e5f1420dcd9 req-312a613d-a679-4ae1-980c-aac9ea9cda99 service nova] Acquiring lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4f28d959-0cd4-43d3-8cf6-9e5f1420dcd9 req-312a613d-a679-4ae1-980c-aac9ea9cda99 service nova] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4f28d959-0cd4-43d3-8cf6-9e5f1420dcd9 req-312a613d-a679-4ae1-980c-aac9ea9cda99 service nova] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-4f28d959-0cd4-43d3-8cf6-9e5f1420dcd9 req-312a613d-a679-4ae1-980c-aac9ea9cda99 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] No waiting events found dispatching network-vif-unplugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-4f28d959-0cd4-43d3-8cf6-9e5f1420dcd9 req-312a613d-a679-4ae1-980c-aac9ea9cda99 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received event network-vif-unplugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:06:45 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Instance destroyed successfully.
Nov 13 10:06:45 user nova-compute[74611]: DEBUG nova.objects.instance [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lazy-loading 'resources' on Instance uuid 261e3e34-7a30-42f5-ae31-c3d3a76d0d67 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T10:01:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-524802819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-524802819',id=27,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRrlMzFCuFCjqjYKCH+sueVQQbVqfjjNW/9j7fYfIOLB3UnjpV/tuyjC6WhmLe9LgwBS7VJ9bdKHTWsQ3e9xHMYL0Gm98yNrPr+71s8aupumxioGndh4CUCrqKGTpqA2w==',key_name='tempest-keypair-399446396',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:05:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5a6f570a7e7404680bd5809be8b0378',ramdisk_id='',reservation_id='r-fk8bipxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-55203260',owner_user_name='tempest-AttachVolumeShelveTestJSON-55203260-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:05:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008616dff48b4bdeb2ea0f2be72a2934',uuid=261e3e34-7a30-42f5-ae31-c3d3a76d0d67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converting VIF {"id": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "address": "fa:16:3e:c9:9c:83", "network": {"id": "90c12309-debb-4588-9844-28a4f1aba890", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1275760012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5a6f570a7e7404680bd5809be8b0378", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a9d4c3-0a", "ovs_interfaceid": "a2a9d4c3-0ad3-48b0-a588-65a18320392a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9c:83,bridge_name='br-int',has_traffic_filtering=True,id=a2a9d4c3-0ad3-48b0-a588-65a18320392a,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a9d4c3-0a') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG os_vif [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9c:83,bridge_name='br-int',has_traffic_filtering=True,id=a2a9d4c3-0ad3-48b0-a588-65a18320392a,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a9d4c3-0a') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2a9d4c3-0a, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7202a361-0b5b-4f56-9cff-31ac7e5e665c) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:06:45 user nova-compute[74611]: INFO os_vif [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9c:83,bridge_name='br-int',has_traffic_filtering=True,id=a2a9d4c3-0ad3-48b0-a588-65a18320392a,network=Network(90c12309-debb-4588-9844-28a4f1aba890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a9d4c3-0a')
Nov 13 10:06:45 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Deleting instance files /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67_del
Nov 13 10:06:45 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Deletion of /opt/stack/data/nova/instances/261e3e34-7a30-42f5-ae31-c3d3a76d0d67_del complete
Nov 13 10:06:45 user nova-compute[74611]: INFO nova.compute.manager [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 13 10:06:45 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:06:45 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:06:46 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:06:46 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:06:46 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Took 0.69 seconds to deallocate network for instance.
Nov 13 10:06:46 user nova-compute[74611]: DEBUG nova.compute.manager [req-47c5b9cb-cf8e-410f-9bef-147975ef6f57 req-80240dd7-7a03-461b-b685-252541b6c733 service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received event network-vif-deleted-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:06:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:47 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:06:47 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:06:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:47 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Deleted allocations for instance 261e3e34-7a30-42f5-ae31-c3d3a76d0d67
Nov 13 10:06:47 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:06:47 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:06:47 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:06:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:06:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79743aec-6c96-4583-8fc3-8d643f3d5594 tempest-AttachVolumeShelveTestJSON-55203260 tempest-AttachVolumeShelveTestJSON-55203260-project-member] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.953s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:47 user nova-compute[74611]: DEBUG nova.compute.manager [req-3ff2e886-4af2-4293-86ef-101c96801f27 req-b3aaa702-7f45-4314-8bfa-85ebd828eb1b service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received event network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:06:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3ff2e886-4af2-4293-86ef-101c96801f27 req-b3aaa702-7f45-4314-8bfa-85ebd828eb1b service nova] Acquiring lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3ff2e886-4af2-4293-86ef-101c96801f27 req-b3aaa702-7f45-4314-8bfa-85ebd828eb1b service nova] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3ff2e886-4af2-4293-86ef-101c96801f27 req-b3aaa702-7f45-4314-8bfa-85ebd828eb1b service nova] Lock "261e3e34-7a30-42f5-ae31-c3d3a76d0d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:47 user nova-compute[74611]: DEBUG nova.compute.manager [req-3ff2e886-4af2-4293-86ef-101c96801f27 req-b3aaa702-7f45-4314-8bfa-85ebd828eb1b service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] No waiting events found dispatching network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:06:47 user nova-compute[74611]: WARNING nova.compute.manager [req-3ff2e886-4af2-4293-86ef-101c96801f27 req-b3aaa702-7f45-4314-8bfa-85ebd828eb1b service nova] [instance: 261e3e34-7a30-42f5-ae31-c3d3a76d0d67] Received unexpected event network-vif-plugged-a2a9d4c3-0ad3-48b0-a588-65a18320392a for instance with vm_state deleted and task_state None.
Nov 13 10:06:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:49 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:06:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:52 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:06:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:52 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:06:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:06:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:06:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:06:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Acquiring lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Acquiring lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:54 user nova-compute[74611]: INFO nova.compute.manager [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Terminating instance
Nov 13 10:06:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-7aef53c6-e5b3-41c9-9efe-34a4081972dd req-63956c76-2909-4f29-b880-51f945c30bee service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Received event network-vif-unplugged-69d461bc-84ce-46b4-949d-6d54d9a4454c {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7aef53c6-e5b3-41c9-9efe-34a4081972dd req-63956c76-2909-4f29-b880-51f945c30bee service nova] Acquiring lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7aef53c6-e5b3-41c9-9efe-34a4081972dd req-63956c76-2909-4f29-b880-51f945c30bee service nova] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7aef53c6-e5b3-41c9-9efe-34a4081972dd req-63956c76-2909-4f29-b880-51f945c30bee service nova] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-7aef53c6-e5b3-41c9-9efe-34a4081972dd req-63956c76-2909-4f29-b880-51f945c30bee service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] No waiting events found dispatching network-vif-unplugged-69d461bc-84ce-46b4-949d-6d54d9a4454c {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-7aef53c6-e5b3-41c9-9efe-34a4081972dd req-63956c76-2909-4f29-b880-51f945c30bee service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Received event network-vif-unplugged-69d461bc-84ce-46b4-949d-6d54d9a4454c for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:55 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Instance destroyed successfully.
Nov 13 10:06:55 user nova-compute[74611]: DEBUG nova.objects.instance [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lazy-loading 'resources' on Instance uuid d3c21984-13a9-422c-b9e7-f9ca79b62d81 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-288261506',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-288261506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2882615',id=32,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGX90AONFZNWuKQy6iHfVSSck3PWOZgqhIYct3cEpZHZBe0WXxg+jfiwjJuUHrrvB0S+XFoZOl/Lkw/WnS6DAm4bUJUhHgpcDMbvJ0HqpJhZgJrehnGrdcC2GGfHiq983g==',key_name='tempest-keypair-645812607',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:04:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c95f07c1a7a432ba2c8ed8aaa12604f',ramdisk_id='',reservation_id='r-4qxdgqlj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1504114640',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:04:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='690f5c2eb45b4704aa7e1faf9927173a',uuid=d3c21984-13a9-422c-b9e7-f9ca79b62d81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "address": "fa:16:3e:85:87:60", "network": {"id": "329a000f-5d8c-46fe-943f-3e8a7b854140", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392102660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c95f07c1a7a432ba2c8ed8aaa12604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d461bc-84", "ovs_interfaceid": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Converting VIF {"id": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "address": "fa:16:3e:85:87:60", "network": {"id": "329a000f-5d8c-46fe-943f-3e8a7b854140", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392102660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c95f07c1a7a432ba2c8ed8aaa12604f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d461bc-84", "ovs_interfaceid": "69d461bc-84ce-46b4-949d-6d54d9a4454c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:87:60,bridge_name='br-int',has_traffic_filtering=True,id=69d461bc-84ce-46b4-949d-6d54d9a4454c,network=Network(329a000f-5d8c-46fe-943f-3e8a7b854140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69d461bc-84') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG os_vif [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:87:60,bridge_name='br-int',has_traffic_filtering=True,id=69d461bc-84ce-46b4-949d-6d54d9a4454c,network=Network(329a000f-5d8c-46fe-943f-3e8a7b854140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69d461bc-84') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69d461bc-84, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27ae93b6-c056-454e-a2c6-0d952c31cf12) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:55 user nova-compute[74611]: INFO os_vif [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:87:60,bridge_name='br-int',has_traffic_filtering=True,id=69d461bc-84ce-46b4-949d-6d54d9a4454c,network=Network(329a000f-5d8c-46fe-943f-3e8a7b854140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69d461bc-84')
Nov 13 10:06:55 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Deleting instance files /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81_del
Nov 13 10:06:55 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Deletion of /opt/stack/data/nova/instances/d3c21984-13a9-422c-b9e7-f9ca79b62d81_del complete
Nov 13 10:06:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:55 user nova-compute[74611]: INFO nova.compute.manager [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 13 10:06:55 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:06:56 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Took 0.95 seconds to deallocate network for instance.
Nov 13 10:06:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-3547b30b-3dd7-4227-9b56-22efeb6aa811 req-1c59049f-67bd-42ba-97fa-0127bf0bf7f9 service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Received event network-vif-deleted-69d461bc-84ce-46b4-949d-6d54d9a4454c {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:06:56 user nova-compute[74611]: INFO nova.compute.manager [req-3547b30b-3dd7-4227-9b56-22efeb6aa811 req-1c59049f-67bd-42ba-97fa-0127bf0bf7f9 service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Neutron deleted interface 69d461bc-84ce-46b4-949d-6d54d9a4454c; detaching it from the instance and deleting it from the info cache
Nov 13 10:06:56 user nova-compute[74611]: DEBUG nova.network.neutron [req-3547b30b-3dd7-4227-9b56-22efeb6aa811 req-1c59049f-67bd-42ba-97fa-0127bf0bf7f9 service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-3547b30b-3dd7-4227-9b56-22efeb6aa811 req-1c59049f-67bd-42ba-97fa-0127bf0bf7f9 service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Detach interface failed, port_id=69d461bc-84ce-46b4-949d-6d54d9a4454c, reason: Instance d3c21984-13a9-422c-b9e7-f9ca79b62d81 could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-e86aeb9f-8411-4294-94d4-b4a671b3e5ec req-f3845f8b-38f3-4246-9eed-70541be0adbd service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Received event network-vif-plugged-69d461bc-84ce-46b4-949d-6d54d9a4454c {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e86aeb9f-8411-4294-94d4-b4a671b3e5ec req-f3845f8b-38f3-4246-9eed-70541be0adbd service nova] Acquiring lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e86aeb9f-8411-4294-94d4-b4a671b3e5ec req-f3845f8b-38f3-4246-9eed-70541be0adbd service nova] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e86aeb9f-8411-4294-94d4-b4a671b3e5ec req-f3845f8b-38f3-4246-9eed-70541be0adbd service nova] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-e86aeb9f-8411-4294-94d4-b4a671b3e5ec req-f3845f8b-38f3-4246-9eed-70541be0adbd service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] No waiting events found dispatching network-vif-plugged-69d461bc-84ce-46b4-949d-6d54d9a4454c {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:06:56 user nova-compute[74611]: WARNING nova.compute.manager [req-e86aeb9f-8411-4294-94d4-b4a671b3e5ec req-f3845f8b-38f3-4246-9eed-70541be0adbd service nova] [instance: d3c21984-13a9-422c-b9e7-f9ca79b62d81] Received unexpected event network-vif-plugged-69d461bc-84ce-46b4-949d-6d54d9a4454c for instance with vm_state deleted and task_state None.
Nov 13 10:06:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:06:56 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:06:57 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:06:57 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=6996MB free_disk=25.121131896972656GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.858s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.020s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:57 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Deleted allocations for instance d3c21984-13a9-422c-b9e7-f9ca79b62d81
Nov 13 10:06:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-19ce8e9b-d5c3-4184-8b79-c78083a884b1 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640 tempest-TestServerVolumeAttachScenarioOldVersion-1504114640-project-member] Lock "d3c21984-13a9-422c-b9e7-f9ca79b62d81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.939s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 85cb3adb-b2b3-49ec-92ab-c2b7a028241a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance e99e1557-500f-407e-aefc-3b5cde9ceba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4fa9e23b-30f2-41ae-83ed-86145389d474 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 635636ea-96a0-4fdb-85a1-ca7a87b762f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7eff589b-8f0f-4e6e-ac04-567da455e579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ad645ec3-086e-4bfe-b10e-b0a2ff32720d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f059d809-84b0-40c4-be84-bc89a9dc182e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:06:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:58 user nova-compute[74611]: INFO nova.compute.manager [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Terminating instance
Nov 13 10:06:58 user nova-compute[74611]: DEBUG nova.compute.manager [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:06:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-adac76df-b56c-4f49-b196-ec9b91dd4121 req-9b795fbe-e1f5-4694-b6f5-614df2c26471 service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Received event network-vif-unplugged-9bde4c80-c890-47fb-9e43-db74946b103b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-adac76df-b56c-4f49-b196-ec9b91dd4121 req-9b795fbe-e1f5-4694-b6f5-614df2c26471 service nova] Acquiring lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-adac76df-b56c-4f49-b196-ec9b91dd4121 req-9b795fbe-e1f5-4694-b6f5-614df2c26471 service nova] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-adac76df-b56c-4f49-b196-ec9b91dd4121 req-9b795fbe-e1f5-4694-b6f5-614df2c26471 service nova] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-adac76df-b56c-4f49-b196-ec9b91dd4121 req-9b795fbe-e1f5-4694-b6f5-614df2c26471 service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] No waiting events found dispatching network-vif-unplugged-9bde4c80-c890-47fb-9e43-db74946b103b {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-adac76df-b56c-4f49-b196-ec9b91dd4121 req-9b795fbe-e1f5-4694-b6f5-614df2c26471 service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Received event network-vif-unplugged-9bde4c80-c890-47fb-9e43-db74946b103b for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:06:59 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Instance destroyed successfully.
Nov 13 10:06:59 user nova-compute[74611]: DEBUG nova.objects.instance [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lazy-loading 'resources' on Instance uuid ad645ec3-086e-4bfe-b10e-b0a2ff32720d {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1325850666',display_name='tempest-AttachVolumeNegativeTest-server-1325850666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1325850666',id=33,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObCHLVp+hvZZ0HtfbRh0HeUhWR1r3rxiv4ljXlyTD+BNyEu/kdlAqUXL8rWbYVd7Zbrcmhm+wO9106EmE4KnJYDqzmCYLl2a2Da71CK6OSsW/ZDNgoiXi+71JK4Vh4ICw==',key_name='tempest-keypair-1544061739',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1384599c1e484e54ae29b024377dbd04',ramdisk_id='',reservation_id='r-prvwrast',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1307038303',owner_user_name='tempest-AttachVolumeNegativeTest-1307038303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d93cfc3fb54b41ceb9f9657de0059043',uuid=ad645ec3-086e-4bfe-b10e-b0a2ff32720d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bde4c80-c890-47fb-9e43-db74946b103b", "address": "fa:16:3e:86:8d:ba", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bde4c80-c8", "ovs_interfaceid": "9bde4c80-c890-47fb-9e43-db74946b103b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converting VIF {"id": "9bde4c80-c890-47fb-9e43-db74946b103b", "address": "fa:16:3e:86:8d:ba", "network": {"id": "8c8d3421-6dc6-426e-b32e-f2e07e854e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1465843398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1384599c1e484e54ae29b024377dbd04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bde4c80-c8", "ovs_interfaceid": "9bde4c80-c890-47fb-9e43-db74946b103b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:8d:ba,bridge_name='br-int',has_traffic_filtering=True,id=9bde4c80-c890-47fb-9e43-db74946b103b,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bde4c80-c8') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG os_vif [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:8d:ba,bridge_name='br-int',has_traffic_filtering=True,id=9bde4c80-c890-47fb-9e43-db74946b103b,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bde4c80-c8') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bde4c80-c8, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=200c22f9-11f0-40bd-9bc4-861b4755d35d) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:06:59 user nova-compute[74611]: INFO os_vif [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:8d:ba,bridge_name='br-int',has_traffic_filtering=True,id=9bde4c80-c890-47fb-9e43-db74946b103b,network=Network(8c8d3421-6dc6-426e-b32e-f2e07e854e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bde4c80-c8')
Nov 13 10:06:59 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Deleting instance files /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d_del
Nov 13 10:06:59 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Deletion of /opt/stack/data/nova/instances/ad645ec3-086e-4bfe-b10e-b0a2ff32720d_del complete
Nov 13 10:06:59 user nova-compute[74611]: INFO nova.compute.manager [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 13 10:06:59 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:06:59 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:07:00 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:07:00 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Took 0.74 seconds to deallocate network for instance.
Nov 13 10:07:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:00 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:07:00 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:07:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:00 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Deleted allocations for instance ad645ec3-086e-4bfe-b10e-b0a2ff32720d
Nov 13 10:07:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-30fb1608-b049-435c-8564-f69d7ba0f173 tempest-AttachVolumeNegativeTest-1307038303 tempest-AttachVolumeNegativeTest-1307038303-project-member] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.113s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-61cd81cc-41f8-44a2-97ce-f43b14b9333d req-bd09a08e-ea0a-4d5a-b451-7095e9bbaa2d service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Received event network-vif-plugged-9bde4c80-c890-47fb-9e43-db74946b103b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-61cd81cc-41f8-44a2-97ce-f43b14b9333d req-bd09a08e-ea0a-4d5a-b451-7095e9bbaa2d service nova] Acquiring lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-61cd81cc-41f8-44a2-97ce-f43b14b9333d req-bd09a08e-ea0a-4d5a-b451-7095e9bbaa2d service nova] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-61cd81cc-41f8-44a2-97ce-f43b14b9333d req-bd09a08e-ea0a-4d5a-b451-7095e9bbaa2d service nova] Lock "ad645ec3-086e-4bfe-b10e-b0a2ff32720d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-61cd81cc-41f8-44a2-97ce-f43b14b9333d req-bd09a08e-ea0a-4d5a-b451-7095e9bbaa2d service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] No waiting events found dispatching network-vif-plugged-9bde4c80-c890-47fb-9e43-db74946b103b {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:07:01 user nova-compute[74611]: WARNING nova.compute.manager [req-61cd81cc-41f8-44a2-97ce-f43b14b9333d req-bd09a08e-ea0a-4d5a-b451-7095e9bbaa2d service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Received unexpected event network-vif-plugged-9bde4c80-c890-47fb-9e43-db74946b103b for instance with vm_state deleted and task_state None.
Nov 13 10:07:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-61cd81cc-41f8-44a2-97ce-f43b14b9333d req-bd09a08e-ea0a-4d5a-b451-7095e9bbaa2d service nova] [instance: ad645ec3-086e-4bfe-b10e-b0a2ff32720d] Received event network-vif-deleted-9bde4c80-c890-47fb-9e43-db74946b103b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:04 user nova-compute[74611]: INFO nova.compute.manager [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Rescuing
Nov 13 10:07:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "refresh_cache-f059d809-84b0-40c4-be84-bc89a9dc182e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:07:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquired lock "refresh_cache-f059d809-84b0-40c4-be84-bc89a9dc182e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:07:04 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:07:04 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Updating instance_info_cache with network_info: [{"id": "0a10fea9-0757-4257-b637-952cffdf0114", "address": "fa:16:3e:21:cf:80", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a10fea9-07", "ovs_interfaceid": "0a10fea9-0757-4257-b637-952cffdf0114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:07:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Releasing lock "refresh_cache-f059d809-84b0-40c4-be84-bc89a9dc182e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:07:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-119c01ca-25ff-40e7-8553-61f2d918ef68 req-c7c864a0-dc5d-4a2e-9ada-515ddb75b1f7 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received event network-vif-unplugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-119c01ca-25ff-40e7-8553-61f2d918ef68 req-c7c864a0-dc5d-4a2e-9ada-515ddb75b1f7 service nova] Acquiring lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-119c01ca-25ff-40e7-8553-61f2d918ef68 req-c7c864a0-dc5d-4a2e-9ada-515ddb75b1f7 service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-119c01ca-25ff-40e7-8553-61f2d918ef68 req-c7c864a0-dc5d-4a2e-9ada-515ddb75b1f7 service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-119c01ca-25ff-40e7-8553-61f2d918ef68 req-c7c864a0-dc5d-4a2e-9ada-515ddb75b1f7 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] No waiting events found dispatching network-vif-unplugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:07:04 user nova-compute[74611]: WARNING nova.compute.manager [req-119c01ca-25ff-40e7-8553-61f2d918ef68 req-c7c864a0-dc5d-4a2e-9ada-515ddb75b1f7 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received unexpected event network-vif-unplugged-0a10fea9-0757-4257-b637-952cffdf0114 for instance with vm_state active and task_state rescuing.
Nov 13 10:07:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:05 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Instance destroyed successfully.
Nov 13 10:07:05 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Attempting a stable device rescue
Nov 13 10:07:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74611) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 10:07:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Instance directory exists: not creating {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 10:07:05 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Creating image(s)
Nov 13 10:07:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "/opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "/opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "/opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.019s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:05 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'trusted_certs' on Instance uuid f059d809-84b0-40c4-be84-bc89a9dc182e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:07:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "b33a9cc7de8ff36b44342335baccbab6791f21bd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "b33a9cc7de8ff36b44342335baccbab6791f21bd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b33a9cc7de8ff36b44342335baccbab6791f21bd.part --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b33a9cc7de8ff36b44342335baccbab6791f21bd.part --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:06 user nova-compute[74611]: DEBUG nova.virt.images [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] 483ac167-8bd3-4cb4-bfea-02c2bf56efb1 was qcow2, converting to raw {{(pid=74611) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 10:07:06 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 10:07:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b33a9cc7de8ff36b44342335baccbab6791f21bd.part /opt/stack/data/nova/instances/_base/b33a9cc7de8ff36b44342335baccbab6791f21bd.converted {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:06 user nova-compute[74611]: DEBUG nova.compute.manager [req-a1f482f1-441b-4f4b-831b-895a00c1d52b req-980a679a-0181-4862-b25f-deac9f3bf084 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a1f482f1-441b-4f4b-831b-895a00c1d52b req-980a679a-0181-4862-b25f-deac9f3bf084 service nova] Acquiring lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a1f482f1-441b-4f4b-831b-895a00c1d52b req-980a679a-0181-4862-b25f-deac9f3bf084 service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a1f482f1-441b-4f4b-831b-895a00c1d52b req-980a679a-0181-4862-b25f-deac9f3bf084 service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:06 user nova-compute[74611]: DEBUG nova.compute.manager [req-a1f482f1-441b-4f4b-831b-895a00c1d52b req-980a679a-0181-4862-b25f-deac9f3bf084 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] No waiting events found dispatching network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:07:06 user nova-compute[74611]: WARNING nova.compute.manager [req-a1f482f1-441b-4f4b-831b-895a00c1d52b req-980a679a-0181-4862-b25f-deac9f3bf084 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received unexpected event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 for instance with vm_state active and task_state rescuing.
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b33a9cc7de8ff36b44342335baccbab6791f21bd.part /opt/stack/data/nova/instances/_base/b33a9cc7de8ff36b44342335baccbab6791f21bd.converted" returned: 0 in 0.639s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b33a9cc7de8ff36b44342335baccbab6791f21bd.converted --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b33a9cc7de8ff36b44342335baccbab6791f21bd.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "b33a9cc7de8ff36b44342335baccbab6791f21bd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.933s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "b33a9cc7de8ff36b44342335baccbab6791f21bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "b33a9cc7de8ff36b44342335baccbab6791f21bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b33a9cc7de8ff36b44342335baccbab6791f21bd --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b33a9cc7de8ff36b44342335baccbab6791f21bd --force-share --output=json" returned: 0 in 0.169s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b33a9cc7de8ff36b44342335baccbab6791f21bd,backing_fmt=raw /opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/disk.rescue {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b33a9cc7de8ff36b44342335baccbab6791f21bd,backing_fmt=raw /opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/disk.rescue" returned: 0 in 0.054s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "b33a9cc7de8ff36b44342335baccbab6791f21bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'migration_context' on Instance uuid f059d809-84b0-40c4-be84-bc89a9dc182e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.objects.base [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Object Instance<f059d809-84b0-40c4-be84-bc89a9dc182e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Start _get_guest_xml network_info=[{"id": "0a10fea9-0757-4257-b637-952cffdf0114", "address": "fa:16:3e:21:cf:80", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "vif_mac": "fa:16:3e:21:cf:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a10fea9-07", "ovs_interfaceid": "0a10fea9-0757-4257-b637-952cffdf0114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '483ac167-8bd3-4cb4-bfea-02c2bf56efb1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '9c778748-beb9-4721-b611-241d025bec4f', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGfSLFTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'f059d809-84b0-40c4-be84-bc89a9dc182e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5f13810-d007-4cd9-ad7f-21f7c3b51dfc', 'serial': 'f5f13810-d007-4cd9-ad7f-21f7c3b51dfc'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'resources' on Instance uuid f059d809-84b0-40c4-be84-bc89a9dc182e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.objects.base [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Object Instance<f059d809-84b0-40c4-be84-bc89a9dc182e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'numa_topology' on Instance uuid f059d809-84b0-40c4-be84-bc89a9dc182e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.objects.base [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Object Instance<f059d809-84b0-40c4-be84-bc89a9dc182e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:07:07 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:07:07 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'vcpu_model' on Instance uuid f059d809-84b0-40c4-be84-bc89a9dc182e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.objects.base [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Object Instance<f059d809-84b0-40c4-be84-bc89a9dc182e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGfSLFTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:07:07 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:07:07 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:07:07 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1e38ec-18eb-4d22-b6d5-cc7d3dd3771d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = wGfSLFTX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 13 10:07:07 user nova-compute[74611]: node.name = iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc
Nov 13 10:07:07 user nova-compute[74611]: node.tpgt = -1
Nov 13 10:07:07 user nova-compute[74611]: node.startup = automatic
Nov 13 10:07:07 user nova-compute[74611]: node.leading_login = No
Nov 13 10:07:07 user nova-compute[74611]: iface.iscsi_ifacename = default
Nov 13 10:07:07 user nova-compute[74611]: iface.net_ifacename = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.ipaddress = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.prefix_len = 0
Nov 13 10:07:07 user nova-compute[74611]: iface.hwaddress = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.transport_name = tcp
Nov 13 10:07:07 user nova-compute[74611]: iface.initiatorname = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.state = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.vlan_id = 0
Nov 13 10:07:07 user nova-compute[74611]: iface.vlan_priority = 0
Nov 13 10:07:07 user nova-compute[74611]: iface.vlan_state = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.iface_num = 0
Nov 13 10:07:07 user nova-compute[74611]: iface.mtu = 0
Nov 13 10:07:07 user nova-compute[74611]: iface.port = 0
Nov 13 10:07:07 user nova-compute[74611]: iface.bootproto = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.subnet_mask = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.gateway = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.dhcp_alt_client_id_state = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.dhcp_alt_client_id = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.dhcp_dns = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.dhcp_learn_iqn = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.dhcp_req_vendor_id_state = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.dhcp_vendor_id_state = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.dhcp_vendor_id = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.dhcp_slp_da = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.fragmentation = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.gratuitous_arp = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.incoming_forwarding = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.tos_state = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.tos = 0
Nov 13 10:07:07 user nova-compute[74611]: iface.ttl = 0
Nov 13 10:07:07 user nova-compute[74611]: iface.delayed_ack = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.tcp_nagle = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.tcp_wsf_state = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.tcp_wsf = 0
Nov 13 10:07:07 user nova-compute[74611]: iface.tcp_timer_scale = 0
Nov 13 10:07:07 user nova-compute[74611]: iface.tcp_timestamp = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.redirect = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.def_task_mgmt_timeout = 0
Nov 13 10:07:07 user nova-compute[74611]: iface.header_digest = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.data_digest = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.immediate_data = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.initial_r2t = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.data_seq_inorder = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.data_pdu_inorder = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.erl = 0
Nov 13 10:07:07 user nova-compute[74611]: iface.max_receive_data_len = 0
Nov 13 10:07:07 user nova-compute[74611]: iface.first_burst_len = 0
Nov 13 10:07:07 user nova-compute[74611]: iface.max_outstanding_r2t = 0
Nov 13 10:07:07 user nova-compute[74611]: iface.max_burst_len = 0
Nov 13 10:07:07 user nova-compute[74611]: iface.chap_auth = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.bidi_chap = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.strict_login_compliance = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.discovery_auth = <empty>
Nov 13 10:07:07 user nova-compute[74611]: iface.discovery_logout = <empty>
Nov 13 10:07:07 user nova-compute[74611]: node.discovery_address = <empty>
Nov 13 10:07:07 user nova-compute[74611]: node.discovery_port = 0
Nov 13 10:07:07 user nova-compute[74611]: node.discovery_type = static
Nov 13 10:07:07 user nova-compute[74611]: node.session.initial_cmdsn = 0
Nov 13 10:07:07 user nova-compute[74611]: node.session.initial_login_retry_max = 8
Nov 13 10:07:07 user nova-compute[74611]: node.session.xmit_thread_priority = -20
Nov 13 10:07:07 user nova-compute[74611]: node.session.cmds_max = 128
Nov 13 10:07:07 user nova-compute[74611]: node.session.queue_depth = 32
Nov 13 10:07:07 user nova-compute[74611]: node.session.nr_sessions = 1
Nov 13 10:07:07 user nova-compute[74611]: node.session.auth.authmethod = CHAP
Nov 13 10:07:07 user nova-compute[74611]: node.session.auth.username = wGfSLFTX
Nov 13 10:07:07 user nova-compute[74611]: node.session.auth.password = ***
Nov 13 10:07:07 user nova-compute[74611]: node.session.auth.username_in = <empty>
Nov 13 10:07:07 user nova-compute[74611]: node.session.auth.password_in = <empty>
Nov 13 10:07:07 user nova-compute[74611]: node.session.auth.chap_algs = MD5
Nov 13 10:07:07 user nova-compute[74611]: node.session.timeo.replacement_timeout = 120
Nov 13 10:07:07 user nova-compute[74611]: node.session.err_timeo.abort_timeout = 15
Nov 13 10:07:07 user nova-compute[74611]: node.session.err_timeo.lu_reset_timeout = 30
Nov 13 10:07:07 user nova-compute[74611]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 13 10:07:07 user nova-compute[74611]: node.session.err_timeo.host_reset_timeout = 60
Nov 13 10:07:07 user nova-compute[74611]: node.session.iscsi.FastAbort = Yes
Nov 13 10:07:07 user nova-compute[74611]: node.session.iscsi.InitialR2T = No
Nov 13 10:07:07 user nova-compute[74611]: node.session.iscsi.ImmediateData = Yes
Nov 13 10:07:07 user nova-compute[74611]: node.session.iscsi.FirstBurstLength = 262144
Nov 13 10:07:07 user nova-compute[74611]: node.session.iscsi.MaxBurstLength = 16776192
Nov 13 10:07:07 user nova-compute[74611]: node.session.iscsi.DefaultTime2Retain = 0
Nov 13 10:07:07 user nova-compute[74611]: node.session.iscsi.DefaultTime2Wait = 2
Nov 13 10:07:07 user nova-compute[74611]: node.session.iscsi.MaxConnections = 1
Nov 13 10:07:07 user nova-compute[74611]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 13 10:07:07 user nova-compute[74611]: node.session.iscsi.ERL = 0
Nov 13 10:07:07 user nova-compute[74611]: node.session.scan = manual
Nov 13 10:07:07 user nova-compute[74611]: node.session.reopen_max = 0
Nov 13 10:07:07 user nova-compute[74611]: node.conn[0].address = 172.16.0.220
Nov 13 10:07:07 user nova-compute[74611]: node.conn[0].port = 3260
Nov 13 10:07:07 user nova-compute[74611]: node.conn[0].startup = manual
Nov 13 10:07:07 user nova-compute[74611]: node.conn[0].tcp.window_size = 524288
Nov 13 10:07:07 user nova-compute[74611]: node.conn[0].tcp.type_of_service = 0
Nov 13 10:07:07 user nova-compute[74611]: node.conn[0].timeo.logout_timeout = 15
Nov 13 10:07:07 user nova-compute[74611]: node.conn[0].timeo.login_timeout = 15
Nov 13 10:07:07 user nova-compute[74611]: node.conn[0].timeo.auth_timeout = 45
Nov 13 10:07:07 user nova-compute[74611]: node.conn[0].timeo.noop_out_interval = 5
Nov 13 10:07:07 user nova-compute[74611]: node.conn[0].timeo.noop_out_timeout = 5
Nov 13 10:07:07 user nova-compute[74611]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 13 10:07:07 user nova-compute[74611]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 13 10:07:07 user nova-compute[74611]: node.conn[0].iscsi.HeaderDigest = None
Nov 13 10:07:07 user nova-compute[74611]: node.conn[0].iscsi.DataDigest = None
Nov 13 10:07:07 user nova-compute[74611]: node.conn[0].iscsi.IFMarker = No
Nov 13 10:07:07 user nova-compute[74611]: node.conn[0].iscsi.OFMarker = No
Nov 13 10:07:07 user nova-compute[74611]: # END RECORD
Nov 13 10:07:07 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3917bccc-70d6-4aea-b490-996e751a1312]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d8a321-2b1d-46f8-a1a1-5066bdff06a9]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGfSLFTX {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGfSLFTX" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae90e51-a089-491c-97e7-ce717f541b51]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wGfSLFTX'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01deac5-b015-4c8a-abda-1697bd8d22f0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[13458c1f-9147-46e0-b426-e9c5f187cd70]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:07:07 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:07:07 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:07:07 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:07:07 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:07:07 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:07:07 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:07:07 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:07:07 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:07:07 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:07:07 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:07:07 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:07:07 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.140s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] HCTL ('35', '0', '0', 0) found on session 33 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5d60d8-283f-443e-881b-4b2a6189659d]: (4, ('0 0 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Searching for a device in session 33 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGfSLFTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.163s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] <== connect_volume: return (164ms) {'type': 'block', 'scsi_wwn': '23530653865643966', 'path': '/dev/sdd'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530653865643966', 'path': '/dev/sdd'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:05:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1569409365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1569409365',id=35,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:05:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83e3b3233a5b43d682200d91f29a80b4',ramdisk_id='',reservation_id='r-nt3djo2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-182847603',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:05:29Z,user_data=None,user_id='6bc911a5649643a6a3606d8b80e20eb0',uuid=f059d809-84b0-40c4-be84-bc89a9dc182e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a10fea9-0757-4257-b637-952cffdf0114", "address": "fa:16:3e:21:cf:80", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "vif_mac": "fa:16:3e:21:cf:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a10fea9-07", "ovs_interfaceid": "0a10fea9-0757-4257-b637-952cffdf0114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converting VIF {"id": "0a10fea9-0757-4257-b637-952cffdf0114", "address": "fa:16:3e:21:cf:80", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "vif_mac": "fa:16:3e:21:cf:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a10fea9-07", "ovs_interfaceid": "0a10fea9-0757-4257-b637-952cffdf0114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:cf:80,bridge_name='br-int',has_traffic_filtering=True,id=0a10fea9-0757-4257-b637-952cffdf0114,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a10fea9-07') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'pci_devices' on Instance uuid f059d809-84b0-40c4-be84-bc89a9dc182e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.objects.base [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Object Instance<f059d809-84b0-40c4-be84-bc89a9dc182e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:07:07 user nova-compute[74611]:   <uuid>f059d809-84b0-40c4-be84-bc89a9dc182e</uuid>
Nov 13 10:07:07 user nova-compute[74611]:   <name>instance-00000023</name>
Nov 13 10:07:07 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:07:07 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:07:07 user nova-compute[74611]:   <metadata>
Nov 13 10:07:07 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:07:07 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:07:07 user nova-compute[74611]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1569409365</nova:name>
Nov 13 10:07:07 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:07:07</nova:creationTime>
Nov 13 10:07:07 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:07:07 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:07:07 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:07:07 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:07:07 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:07:07 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:07:07 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:07:07 user nova-compute[74611]:       <nova:owner>
Nov 13 10:07:07 user nova-compute[74611]:         <nova:user uuid="6bc911a5649643a6a3606d8b80e20eb0">tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member</nova:user>
Nov 13 10:07:07 user nova-compute[74611]:         <nova:project uuid="83e3b3233a5b43d682200d91f29a80b4">tempest-ServerBootFromVolumeStableRescueTest-182847603</nova:project>
Nov 13 10:07:07 user nova-compute[74611]:       </nova:owner>
Nov 13 10:07:07 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:07:07 user nova-compute[74611]:       <nova:ports>
Nov 13 10:07:07 user nova-compute[74611]:         <nova:port uuid="0a10fea9-0757-4257-b637-952cffdf0114">
Nov 13 10:07:07 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 10:07:07 user nova-compute[74611]:         </nova:port>
Nov 13 10:07:07 user nova-compute[74611]:       </nova:ports>
Nov 13 10:07:07 user nova-compute[74611]:     </nova:instance>
Nov 13 10:07:07 user nova-compute[74611]:   </metadata>
Nov 13 10:07:07 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:07:07 user nova-compute[74611]:     <system>
Nov 13 10:07:07 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:07:07 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:07:07 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:07:07 user nova-compute[74611]:       <entry name="serial">f059d809-84b0-40c4-be84-bc89a9dc182e</entry>
Nov 13 10:07:07 user nova-compute[74611]:       <entry name="uuid">f059d809-84b0-40c4-be84-bc89a9dc182e</entry>
Nov 13 10:07:07 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:07:07 user nova-compute[74611]:     </system>
Nov 13 10:07:07 user nova-compute[74611]:   </sysinfo>
Nov 13 10:07:07 user nova-compute[74611]:   <os>
Nov 13 10:07:07 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:07:07 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:07:07 user nova-compute[74611]:   </os>
Nov 13 10:07:07 user nova-compute[74611]:   <features>
Nov 13 10:07:07 user nova-compute[74611]:     <acpi/>
Nov 13 10:07:07 user nova-compute[74611]:     <apic/>
Nov 13 10:07:07 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:07:07 user nova-compute[74611]:   </features>
Nov 13 10:07:07 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:07:07 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:07:07 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:07:07 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:07:07 user nova-compute[74611]:   </clock>
Nov 13 10:07:07 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:07:07 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:07:07 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:07:07 user nova-compute[74611]:   </cpu>
Nov 13 10:07:07 user nova-compute[74611]:   <devices>
Nov 13 10:07:07 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:07:07 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:07:07 user nova-compute[74611]:       <source dev="/dev/sdd"/>
Nov 13 10:07:07 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:07:07 user nova-compute[74611]:       <serial>f5f13810-d007-4cd9-ad7f-21f7c3b51dfc</serial>
Nov 13 10:07:07 user nova-compute[74611]:     </disk>
Nov 13 10:07:07 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:07:07 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:07:07 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/disk.rescue"/>
Nov 13 10:07:07 user nova-compute[74611]:       <target dev="vdb" bus="virtio"/>
Nov 13 10:07:07 user nova-compute[74611]:       <boot order="1"/>
Nov 13 10:07:07 user nova-compute[74611]:     </disk>
Nov 13 10:07:07 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:07:07 user nova-compute[74611]:       <mac address="fa:16:3e:21:cf:80"/>
Nov 13 10:07:07 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:07:07 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:07:07 user nova-compute[74611]:       <target dev="tap0a10fea9-07"/>
Nov 13 10:07:07 user nova-compute[74611]:     </interface>
Nov 13 10:07:07 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:07:07 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/console.log" append="off"/>
Nov 13 10:07:07 user nova-compute[74611]:     </serial>
Nov 13 10:07:07 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:07:07 user nova-compute[74611]:     <video>
Nov 13 10:07:07 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:07:07 user nova-compute[74611]:     </video>
Nov 13 10:07:07 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:07:07 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:07:07 user nova-compute[74611]:     </rng>
Nov 13 10:07:07 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:07:07 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:07:07 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:07:07 user nova-compute[74611]:     </memballoon>
Nov 13 10:07:07 user nova-compute[74611]:   </devices>
Nov 13 10:07:07 user nova-compute[74611]: </domain>
Nov 13 10:07:07 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:07:07 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Instance destroyed successfully.
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:07:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] No VIF found with MAC fa:16:3e:21:cf:80, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:07:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:09 user nova-compute[74611]: DEBUG nova.compute.manager [req-40990230-6395-4846-a1bf-e3312648bcf2 req-e0f0c288-057e-4084-9160-08bf5740bff2 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-40990230-6395-4846-a1bf-e3312648bcf2 req-e0f0c288-057e-4084-9160-08bf5740bff2 service nova] Acquiring lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-40990230-6395-4846-a1bf-e3312648bcf2 req-e0f0c288-057e-4084-9160-08bf5740bff2 service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-40990230-6395-4846-a1bf-e3312648bcf2 req-e0f0c288-057e-4084-9160-08bf5740bff2 service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:09 user nova-compute[74611]: DEBUG nova.compute.manager [req-40990230-6395-4846-a1bf-e3312648bcf2 req-e0f0c288-057e-4084-9160-08bf5740bff2 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] No waiting events found dispatching network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:07:09 user nova-compute[74611]: WARNING nova.compute.manager [req-40990230-6395-4846-a1bf-e3312648bcf2 req-e0f0c288-057e-4084-9160-08bf5740bff2 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received unexpected event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 for instance with vm_state active and task_state rescuing.
Nov 13 10:07:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:09 user nova-compute[74611]: INFO nova.compute.manager [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Terminating instance
Nov 13 10:07:09 user nova-compute[74611]: DEBUG nova.compute.manager [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:10 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Instance destroyed successfully.
Nov 13 10:07:10 user nova-compute[74611]: DEBUG nova.objects.instance [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lazy-loading 'resources' on Instance uuid 635636ea-96a0-4fdb-85a1-ca7a87b762f0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1214168652',display_name='tempest-ServerActionsTestOtherB-server-1214168652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1214168652',id=21,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDWkg3C+Ons0/sduU7bCkNdUaQmui4Ar0pDJw7KSIbqtW1jWjrtKiyZ8w8dVwpvUbMKS1UF1ykPykLHc0hyTfyxEKKXaxiPgUkE/a0u6OsQxRK/HJgxNowuqXz8Zc+KMg==',key_name='tempest-keypair-1038082490',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:04:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1fb42835d7f49cbaad21eee295c7692',ramdisk_id='',reservation_id='r-yeac67tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-840608963',owner_user_name='tempest-ServerActionsTestOtherB-840608963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:04:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='396adec28c0d44a0aefb1229090f90d5',uuid=635636ea-96a0-4fdb-85a1-ca7a87b762f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converting VIF {"id": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "address": "fa:16:3e:f5:e2:a3", "network": {"id": "b6ff1116-1baa-4aa7-96cb-a09aeace3945", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1498625862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1fb42835d7f49cbaad21eee295c7692", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff4d9c6-a2", "ovs_interfaceid": "9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG os_vif [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ff4d9c6-a2, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1e485d3-d5ec-4893-a905-501477e481b9) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:10 user nova-compute[74611]: INFO os_vif [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:e2:a3,bridge_name='br-int',has_traffic_filtering=True,id=9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d,network=Network(b6ff1116-1baa-4aa7-96cb-a09aeace3945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff4d9c6-a2')
Nov 13 10:07:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQfyJOvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:07:10 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:07:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf32a3a1-482a-48cf-9119-25cb2dd25d44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:07:10 user nova-compute[74611]: No targets found.
Nov 13 10:07:10 user nova-compute[74611]: iSNS:
Nov 13 10:07:10 user nova-compute[74611]: No targets found.
Nov 13 10:07:10 user nova-compute[74611]: STATIC:
Nov 13 10:07:10 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc
Nov 13 10:07:10 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:07:10 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:07:10 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f
Nov 13 10:07:10 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:07:10 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:07:10 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d
Nov 13 10:07:10 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:07:10 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:07:10 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40
Nov 13 10:07:10 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:07:10 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:07:10 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd
Nov 13 10:07:10 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:07:10 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:07:10 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:07:10 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:07:10 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:07:10 user nova-compute[74611]: FIRMWARE:
Nov 13 10:07:10 user nova-compute[74611]: No targets found.
Nov 13 10:07:10 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:07:10 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:07:10 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[db746a4c-aca2-4b65-822d-618e01ed7e4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1382627f-77d1-4d13-bd88-03a181d74e68]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:07:10 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:07:10 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:07:10 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:07:10 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:07:10 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:07:10 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:07:10 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:07:10 user nova-compute[74611]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f (non-flash)
Nov 13 10:07:10 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:07:10 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:07:10 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:07:10 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb84376320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f'): ({'sde'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Removing single pathed devices sde {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df3e91e-0fe7-429f-8b5b-4cc1e05ad515]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4504ce32-ddc4-41b2-a3dc-31832702d9c0]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Flushing IO for device /dev/sde {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b6e4e3-cb90-46a8-b8c5-424e41fb6cc0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a34e7c-4d3a-49fa-822c-2a5274017582]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] SCSI volumes sde have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca910e8-c189-4d73-bfda-31df6df0e3cf]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c743e658-5dad-4cab-8f92-952e7d6dd1fa]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260]
Nov 13 10:07:11 user nova-compute[74611]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f, portal: 172.16.0.220,3260] successful.
Nov 13 10:07:11 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fb42e8-06d6-42aa-a06c-142251173f9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c15dad-1524-49a8-8ba4-d636404b9a20]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] <== disconnect_volume: return (304ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:07:11 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Deleting instance files /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0_del
Nov 13 10:07:11 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Deletion of /opt/stack/data/nova/instances/635636ea-96a0-4fdb-85a1-ca7a87b762f0_del complete
Nov 13 10:07:11 user nova-compute[74611]: INFO nova.compute.manager [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2f1bc7d7-3da4-4e47-ac15-70112585deb5 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] Acquiring lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] No waiting events found dispatching network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:07:11 user nova-compute[74611]: WARNING nova.compute.manager [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received unexpected event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 for instance with vm_state active and task_state rescuing.
Nov 13 10:07:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received event network-vif-unplugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] No waiting events found dispatching network-vif-unplugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received event network-vif-unplugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] Acquiring lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] No waiting events found dispatching network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:07:11 user nova-compute[74611]: WARNING nova.compute.manager [req-6373e51e-5d7b-4977-ba22-b1ac689cb8d5 req-ce748efc-ad9b-4fe9-926a-e83cced1be22 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received unexpected event network-vif-plugged-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d for instance with vm_state active and task_state deleting.
Nov 13 10:07:11 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:07:11 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Took 0.66 seconds to deallocate network for instance.
Nov 13 10:07:12 user nova-compute[74611]: INFO nova.compute.manager [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Took 0.74 seconds to detach 1 volumes for instance.
Nov 13 10:07:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:13 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:07:13 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:07:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:13 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Deleted allocations for instance 635636ea-96a0-4fdb-85a1-ca7a87b762f0
Nov 13 10:07:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3cc9c9eb-94ce-4a9c-bc08-de22823b33be tempest-ServerActionsTestOtherB-840608963 tempest-ServerActionsTestOtherB-840608963-project-member] Lock "635636ea-96a0-4fdb-85a1-ca7a87b762f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.235s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:13 user nova-compute[74611]: DEBUG nova.compute.manager [req-b7623af7-726e-4dbb-bd8f-ddb6f3edb50e req-c8ac3796-a804-4e66-a386-51e9ffd10a17 service nova] [instance: 635636ea-96a0-4fdb-85a1-ca7a87b762f0] Received event network-vif-deleted-9ff4d9c6-a2b3-40ec-aabd-4cd6366b2b7d {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "7eff589b-8f0f-4e6e-ac04-567da455e579" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:23 user nova-compute[74611]: INFO nova.compute.manager [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Detaching volume 850f4d3b-4cca-4326-8997-caaaaf606a40
Nov 13 10:07:23 user nova-compute[74611]: INFO nova.virt.block_device [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Attempting to driver detach volume 850f4d3b-4cca-4326-8997-caaaaf606a40 from mountpoint /dev/vdb
Nov 13 10:07:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Attempting to detach device vdb from instance 7eff589b-8f0f-4e6e-ac04-567da455e579 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:07:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:07:23 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:07:23 user nova-compute[74611]:   <source dev="/dev/sdf"/>
Nov 13 10:07:23 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:07:23 user nova-compute[74611]:   <serial>850f4d3b-4cca-4326-8997-caaaaf606a40</serial>
Nov 13 10:07:23 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 10:07:23 user nova-compute[74611]: </disk>
Nov 13 10:07:23 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:07:23 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Successfully detached device vdb from instance 7eff589b-8f0f-4e6e-ac04-567da455e579 from the persistent domain config.
Nov 13 10:07:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7eff589b-8f0f-4e6e-ac04-567da455e579 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:07:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:07:23 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:07:23 user nova-compute[74611]:   <source dev="/dev/sdf"/>
Nov 13 10:07:23 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:07:23 user nova-compute[74611]:   <serial>850f4d3b-4cca-4326-8997-caaaaf606a40</serial>
Nov 13 10:07:23 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 10:07:23 user nova-compute[74611]: </disk>
Nov 13 10:07:23 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:07:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7eff589b-8f0f-4e6e-ac04-567da455e579 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:07:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:07:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-936690d5-f4eb-495b-af89-aaa6d0040005 req-7afc21dc-fad7-4220-9ecc-38359c5cd4a1 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Received event network-changed-745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-936690d5-f4eb-495b-af89-aaa6d0040005 req-7afc21dc-fad7-4220-9ecc-38359c5cd4a1 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Refreshing instance network info cache due to event network-changed-745f6db3-f361-4030-a4cb-03ce5f561662. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:07:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-936690d5-f4eb-495b-af89-aaa6d0040005 req-7afc21dc-fad7-4220-9ecc-38359c5cd4a1 service nova] Acquiring lock "refresh_cache-0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:07:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-936690d5-f4eb-495b-af89-aaa6d0040005 req-7afc21dc-fad7-4220-9ecc-38359c5cd4a1 service nova] Acquired lock "refresh_cache-0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:07:35 user nova-compute[74611]: DEBUG nova.network.neutron [req-936690d5-f4eb-495b-af89-aaa6d0040005 req-7afc21dc-fad7-4220-9ecc-38359c5cd4a1 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Refreshing network info cache for port 745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:07:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:36 user nova-compute[74611]: DEBUG nova.network.neutron [req-936690d5-f4eb-495b-af89-aaa6d0040005 req-7afc21dc-fad7-4220-9ecc-38359c5cd4a1 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Updated VIF entry in instance network info cache for port 745f6db3-f361-4030-a4cb-03ce5f561662. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:07:36 user nova-compute[74611]: DEBUG nova.network.neutron [req-936690d5-f4eb-495b-af89-aaa6d0040005 req-7afc21dc-fad7-4220-9ecc-38359c5cd4a1 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Updating instance_info_cache with network_info: [{"id": "745f6db3-f361-4030-a4cb-03ce5f561662", "address": "fa:16:3e:8c:c7:a4", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745f6db3-f3", "ovs_interfaceid": "745f6db3-f361-4030-a4cb-03ce5f561662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:07:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-936690d5-f4eb-495b-af89-aaa6d0040005 req-7afc21dc-fad7-4220-9ecc-38359c5cd4a1 service nova] Releasing lock "refresh_cache-0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:07:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:39 user nova-compute[74611]: INFO nova.compute.manager [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Terminating instance
Nov 13 10:07:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:07:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "e9ed65b3-b8fc-4320-9625-e5028b6e340d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "e9ed65b3-b8fc-4320-9625-e5028b6e340d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:07:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:39 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:07:39 user nova-compute[74611]: INFO nova.compute.claims [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Claim successful on node user
Nov 13 10:07:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-c18a485c-f0b9-4fe3-abda-25ebb9387603 req-aaaa07e1-6c24-46dc-8b95-bca14ee22b9e service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received event network-vif-unplugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c18a485c-f0b9-4fe3-abda-25ebb9387603 req-aaaa07e1-6c24-46dc-8b95-bca14ee22b9e service nova] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c18a485c-f0b9-4fe3-abda-25ebb9387603 req-aaaa07e1-6c24-46dc-8b95-bca14ee22b9e service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c18a485c-f0b9-4fe3-abda-25ebb9387603 req-aaaa07e1-6c24-46dc-8b95-bca14ee22b9e service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-c18a485c-f0b9-4fe3-abda-25ebb9387603 req-aaaa07e1-6c24-46dc-8b95-bca14ee22b9e service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] No waiting events found dispatching network-vif-unplugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-c18a485c-f0b9-4fe3-abda-25ebb9387603 req-aaaa07e1-6c24-46dc-8b95-bca14ee22b9e service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received event network-vif-unplugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:07:40 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Instance destroyed successfully.
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.objects.instance [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'resources' on Instance uuid e99e1557-500f-407e-aefc-3b5cde9ceba0 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1508598088',display_name='tempest-AttachVolumeTestJSON-server-1508598088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1508598088',id=18,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgN2fOxghmivj853mZ2ksKDLn8tdFXuOHZwAmmMU0voEMAFBi/R/0d3RmLKBvhLUKwr6VaNoAX27Qgtk/V6TuVskjG8QOa9sC9yhByta66dRmM6E1ACXtMK3U+5xSdm5g==',key_name='tempest-keypair-977132060',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:57:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce3f0d3282d547249997fdad18cefc9c',ramdisk_id='',reservation_id='r-tmd58a9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-658018398',owner_user_name='tempest-AttachVolumeTestJSON-658018398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:05:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0428809075cd41f0a6eb84c21e9abfed',uuid=e99e1557-500f-407e-aefc-3b5cde9ceba0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converting VIF {"id": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "address": "fa:16:3e:e0:90:1a", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c3fba0-60", "ovs_interfaceid": "16c3fba0-6005-4fd4-a1b9-005df1f6771b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG os_vif [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16c3fba0-60, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a34681e-ac13-475e-bf94-ed5b8dbe9fa7) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:40 user nova-compute[74611]: INFO os_vif [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:90:1a,bridge_name='br-int',has_traffic_filtering=True,id=16c3fba0-6005-4fd4-a1b9-005df1f6771b,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c3fba0-60')
Nov 13 10:07:40 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Deleting instance files /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0_del
Nov 13 10:07:40 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Deletion of /opt/stack/data/nova/instances/e99e1557-500f-407e-aefc-3b5cde9ceba0_del complete
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:07:40 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:07:40 user nova-compute[74611]: INFO nova.compute.manager [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:07:40 user nova-compute[74611]: INFO nova.virt.block_device [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Booting with volume aedff532-9929-4ffa-8aac-ef4ad576a740 at /dev/vda
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.policy [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91e7d88000c1476abfb0df6bfca4e0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12e0c04622143f2a0c24258ab90e153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG os_brick.utils [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a129b91-a849-430f-afb0-898332e7d32d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e4c2e2-5e67-47a6-b22b-797cfcf242cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[91498115-741c-4cc6-b0ad-575110e99c1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6785de-d40b-48eb-aa90-ae2d719fb1cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:07:40 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:07:40 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ab904a-7d52-4a2e-b625-ab18baccab15]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG os_brick.utils [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:07:40 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Updating existing volume attachment record: 0b067c20-e6c0-45c8-b322-704e8145b85e {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:07:41 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Successfully created port: 71ffa4ff-d077-44f9-b3d1-3c2a921d6334 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Successfully updated port: 71ffa4ff-d077-44f9-b3d1-3c2a921d6334 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "refresh_cache-e9ed65b3-b8fc-4320-9625-e5028b6e340d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquired lock "refresh_cache-e9ed65b3-b8fc-4320-9625-e5028b6e340d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.compute.manager [req-285446fc-1f6b-45e7-bd55-c691d4505436 req-971bbb51-4035-49d1-8c79-4dea8c0f44b6 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Received event network-changed-71ffa4ff-d077-44f9-b3d1-3c2a921d6334 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.compute.manager [req-285446fc-1f6b-45e7-bd55-c691d4505436 req-971bbb51-4035-49d1-8c79-4dea8c0f44b6 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Refreshing instance network info cache due to event network-changed-71ffa4ff-d077-44f9-b3d1-3c2a921d6334. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-285446fc-1f6b-45e7-bd55-c691d4505436 req-971bbb51-4035-49d1-8c79-4dea8c0f44b6 service nova] Acquiring lock "refresh_cache-e9ed65b3-b8fc-4320-9625-e5028b6e340d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:07:42 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Took 1.58 seconds to deallocate network for instance.
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa08c28c-938d-4ccb-b2df-01d06b278fc3 req-a56db226-207d-4dce-9b42-ef6f5506585f service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received event network-vif-deleted-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:42 user nova-compute[74611]: INFO nova.compute.manager [req-aa08c28c-938d-4ccb-b2df-01d06b278fc3 req-a56db226-207d-4dce-9b42-ef6f5506585f service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Neutron deleted interface 16c3fba0-6005-4fd4-a1b9-005df1f6771b; detaching it from the instance and deleting it from the info cache
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.network.neutron [req-aa08c28c-938d-4ccb-b2df-01d06b278fc3 req-a56db226-207d-4dce-9b42-ef6f5506585f service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Didn't find any instances for network info cache update. {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa08c28c-938d-4ccb-b2df-01d06b278fc3 req-a56db226-207d-4dce-9b42-ef6f5506585f service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Detach interface failed, port_id=16c3fba0-6005-4fd4-a1b9-005df1f6771b, reason: Instance e99e1557-500f-407e-aefc-3b5cde9ceba0 could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.compute.manager [req-6ba65596-4242-4779-b869-c7bb71e75d58 req-3bb81ce3-5f67-4637-8df7-0943f4fb200f service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6ba65596-4242-4779-b869-c7bb71e75d58 req-3bb81ce3-5f67-4637-8df7-0943f4fb200f service nova] Acquiring lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6ba65596-4242-4779-b869-c7bb71e75d58 req-3bb81ce3-5f67-4637-8df7-0943f4fb200f service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6ba65596-4242-4779-b869-c7bb71e75d58 req-3bb81ce3-5f67-4637-8df7-0943f4fb200f service nova] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.compute.manager [req-6ba65596-4242-4779-b869-c7bb71e75d58 req-3bb81ce3-5f67-4637-8df7-0943f4fb200f service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] No waiting events found dispatching network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:07:42 user nova-compute[74611]: WARNING nova.compute.manager [req-6ba65596-4242-4779-b869-c7bb71e75d58 req-3bb81ce3-5f67-4637-8df7-0943f4fb200f service nova] [instance: e99e1557-500f-407e-aefc-3b5cde9ceba0] Received unexpected event network-vif-plugged-16c3fba0-6005-4fd4-a1b9-005df1f6771b for instance with vm_state active and task_state deleting.
Nov 13 10:07:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Updating instance_info_cache with network_info: [{"id": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "address": "fa:16:3e:9c:24:82", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ffa4ff-d0", "ovs_interfaceid": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Releasing lock "refresh_cache-e9ed65b3-b8fc-4320-9625-e5028b6e340d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Instance network_info: |[{"id": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "address": "fa:16:3e:9c:24:82", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ffa4ff-d0", "ovs_interfaceid": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-285446fc-1f6b-45e7-bd55-c691d4505436 req-971bbb51-4035-49d1-8c79-4dea8c0f44b6 service nova] Acquired lock "refresh_cache-e9ed65b3-b8fc-4320-9625-e5028b6e340d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.network.neutron [req-285446fc-1f6b-45e7-bd55-c691d4505436 req-971bbb51-4035-49d1-8c79-4dea8c0f44b6 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Refreshing network info cache for port 71ffa4ff-d077-44f9-b3d1-3c2a921d6334 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:07:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:42 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Deleted allocations for instance e99e1557-500f-407e-aefc-3b5cde9ceba0
Nov 13 10:07:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e304a5d3-24d6-4026-a17c-6f68d27a1ce2 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "e99e1557-500f-407e-aefc-3b5cde9ceba0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.095s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:43 user nova-compute[74611]: DEBUG nova.network.neutron [req-285446fc-1f6b-45e7-bd55-c691d4505436 req-971bbb51-4035-49d1-8c79-4dea8c0f44b6 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Updated VIF entry in instance network info cache for port 71ffa4ff-d077-44f9-b3d1-3c2a921d6334. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:07:43 user nova-compute[74611]: DEBUG nova.network.neutron [req-285446fc-1f6b-45e7-bd55-c691d4505436 req-971bbb51-4035-49d1-8c79-4dea8c0f44b6 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Updating instance_info_cache with network_info: [{"id": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "address": "fa:16:3e:9c:24:82", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ffa4ff-d0", "ovs_interfaceid": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:07:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-285446fc-1f6b-45e7-bd55-c691d4505436 req-971bbb51-4035-49d1-8c79-4dea8c0f44b6 service nova] Releasing lock "refresh_cache-e9ed65b3-b8fc-4320-9625-e5028b6e340d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:07:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:44 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7eff589b-8f0f-4e6e-ac04-567da455e579 is timed out.
Nov 13 10:07:44 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Successfully detached device vdb from instance 7eff589b-8f0f-4e6e-ac04-567da455e579 from the live domain config.
Nov 13 10:07:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yusMKrpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:07:44 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa58ccb9-8a4b-4d83-9a13-8d97ed7f2186]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:07:44 user nova-compute[74611]: No targets found.
Nov 13 10:07:44 user nova-compute[74611]: iSNS:
Nov 13 10:07:44 user nova-compute[74611]: No targets found.
Nov 13 10:07:44 user nova-compute[74611]: STATIC:
Nov 13 10:07:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc
Nov 13 10:07:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:07:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:07:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d
Nov 13 10:07:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:07:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:07:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40
Nov 13 10:07:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:07:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:07:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd
Nov 13 10:07:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:07:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:07:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:07:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:07:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:07:44 user nova-compute[74611]: FIRMWARE:
Nov 13 10:07:44 user nova-compute[74611]: No targets found.
Nov 13 10:07:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:07:44 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:07:44 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dcb522-d57d-466f-8429-d0e62046cd44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dfb74d-d813-4e78-b8f5-d62065915e72]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:07:44 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:07:44 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:07:44 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:07:44 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:07:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:07:44 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:07:44 user nova-compute[74611]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 (non-flash)
Nov 13 10:07:44 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:07:44 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:07:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64628940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40'): ({'sdf'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Removing single pathed devices sdf {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[720227af-ef0e-4974-8d5f-90214990bd5a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ece4f41-cdd9-41a1-81b9-1c3712143fb8]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Flushing IO for device /dev/sdf {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[52624d24-6b35-420a-a16c-d5f255840612]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3901f9ea-0966-40f9-a7e7-6a7881c47b7d]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] SCSI volumes sdf have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d43534-504e-4413-a98d-5d986b770495]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de4293b-1f8b-4682-9f38-a51e0fddc372]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40, portal: 172.16.0.220,3260]
Nov 13 10:07:44 user nova-compute[74611]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40, portal: 172.16.0.220,3260] successful.
Nov 13 10:07:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850f4d3b-4cca-4326-8997-caaaaf606a40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57e34a5-be4e-41b0-a8c7-45c3b6047491]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] <== disconnect_volume: return (354ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:07:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:07:45 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Creating image(s)
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Ensure instance console log exists: /opt/stack/data/nova/instances/e9ed65b3-b8fc-4320-9625-e5028b6e340d/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Start _get_guest_xml network_info=[{"id": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "address": "fa:16:3e:9c:24:82", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ffa4ff-d0", "ovs_interfaceid": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '0b067c20-e6c0-45c8-b322-704e8145b85e', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZTPNuGJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e9ed65b3-b8fc-4320-9625-e5028b6e340d', 'attached_at': '', 'detached_at': '', 'volume_id': 'aedff532-9929-4ffa-8aac-ef4ad576a740', 'serial': 'aedff532-9929-4ffa-8aac-ef4ad576a740'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:07:45 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:07:45 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZTPNuGJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:07:45 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:07:45 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:07:45 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b683a5c1-001a-486a-8940-e7ab1bfb0f8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:07:45 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8480898a-3c24-41bf-b9b4-f0b001461c12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740] added
Nov 13 10:07:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee509594-e155-4c75-bfdf-76aa2e5f7018]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG nova.objects.instance [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lazy-loading 'flavor' on Instance uuid 7eff589b-8f0f-4e6e-ac04-567da455e579 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2d40d8-801c-4ab4-9504-283e04f76865]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SZTPNuGJ {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SZTPNuGJ" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[224218fa-6301-4712-80f2-fc512a3af987]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SZTPNuGJ'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7025aed6-44c3-42d2-b076-926f9306720c tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.745s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3d08de-32b1-4c69-95cc-07d32a9ee5a8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d9ccd8-fd29-4a00-bae3-0252497bdfd7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:07:45 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:07:45 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:07:45 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:07:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:07:45 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:07:45 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:07:45 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:07:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2267e1c2-22df-4794-b4a6-bd07bc54562e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740, portal: 172.16.0.220,3260]
Nov 13 10:07:45 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740, portal: 172.16.0.220,3260] successful.
Nov 13 10:07:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7145a987-7c2a-4dc9-b494-161c3f660ac6]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d83e0e-6b1a-4741-abd3-8b9783bf68b1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:07:45 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:07:45 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:07:45 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:07:45 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:07:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:07:45 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:07:45 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:07:45 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:07:45 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:07:45 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1771006f-dd96-44db-a571-b714328ba1d9]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:07:45 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZTPNuGJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23835336232393135', 'path': '/dev/sde'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835336232393135', 'path': '/dev/sde'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-8480901',display_name='tempest-TestVolumeBootPattern-server-8480901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-8480901',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjRXcM+iAZvLJco7tBubak1kGHq/45jJ2KKO6E3tr61cFQKM/YqE/xURoOe/LdnL01vr4FH+cPhy0FHq1+WQre34a6xvIem5nHqznPEd2v959ht3Wgct9dv/En52XotjA==',key_name='tempest-TestVolumeBootPattern-1763350711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-e0xb40sn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:07:41Z,user_data=None,user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=e9ed65b3-b8fc-4320-9625-e5028b6e340d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "address": "fa:16:3e:9c:24:82", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ffa4ff-d0", "ovs_interfaceid": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "address": "fa:16:3e:9c:24:82", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ffa4ff-d0", "ovs_interfaceid": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:24:82,bridge_name='br-int',has_traffic_filtering=True,id=71ffa4ff-d077-44f9-b3d1-3c2a921d6334,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ffa4ff-d0') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG nova.objects.instance [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lazy-loading 'pci_devices' on Instance uuid e9ed65b3-b8fc-4320-9625-e5028b6e340d {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:07:46 user nova-compute[74611]:   <uuid>e9ed65b3-b8fc-4320-9625-e5028b6e340d</uuid>
Nov 13 10:07:46 user nova-compute[74611]:   <name>instance-00000025</name>
Nov 13 10:07:46 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:07:46 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:07:46 user nova-compute[74611]:   <metadata>
Nov 13 10:07:46 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:07:46 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:07:46 user nova-compute[74611]:       <nova:name>tempest-TestVolumeBootPattern-server-8480901</nova:name>
Nov 13 10:07:46 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:07:45</nova:creationTime>
Nov 13 10:07:46 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:07:46 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:07:46 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:07:46 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:07:46 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:07:46 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:07:46 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:07:46 user nova-compute[74611]:       <nova:owner>
Nov 13 10:07:46 user nova-compute[74611]:         <nova:user uuid="91e7d88000c1476abfb0df6bfca4e0fb">tempest-TestVolumeBootPattern-633061604-project-member</nova:user>
Nov 13 10:07:46 user nova-compute[74611]:         <nova:project uuid="f12e0c04622143f2a0c24258ab90e153">tempest-TestVolumeBootPattern-633061604</nova:project>
Nov 13 10:07:46 user nova-compute[74611]:       </nova:owner>
Nov 13 10:07:46 user nova-compute[74611]:       <nova:ports>
Nov 13 10:07:46 user nova-compute[74611]:         <nova:port uuid="71ffa4ff-d077-44f9-b3d1-3c2a921d6334">
Nov 13 10:07:46 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 10:07:46 user nova-compute[74611]:         </nova:port>
Nov 13 10:07:46 user nova-compute[74611]:       </nova:ports>
Nov 13 10:07:46 user nova-compute[74611]:     </nova:instance>
Nov 13 10:07:46 user nova-compute[74611]:   </metadata>
Nov 13 10:07:46 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:07:46 user nova-compute[74611]:     <system>
Nov 13 10:07:46 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:07:46 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:07:46 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:07:46 user nova-compute[74611]:       <entry name="serial">e9ed65b3-b8fc-4320-9625-e5028b6e340d</entry>
Nov 13 10:07:46 user nova-compute[74611]:       <entry name="uuid">e9ed65b3-b8fc-4320-9625-e5028b6e340d</entry>
Nov 13 10:07:46 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:07:46 user nova-compute[74611]:     </system>
Nov 13 10:07:46 user nova-compute[74611]:   </sysinfo>
Nov 13 10:07:46 user nova-compute[74611]:   <os>
Nov 13 10:07:46 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:07:46 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:07:46 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:07:46 user nova-compute[74611]:   </os>
Nov 13 10:07:46 user nova-compute[74611]:   <features>
Nov 13 10:07:46 user nova-compute[74611]:     <acpi/>
Nov 13 10:07:46 user nova-compute[74611]:     <apic/>
Nov 13 10:07:46 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:07:46 user nova-compute[74611]:   </features>
Nov 13 10:07:46 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:07:46 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:07:46 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:07:46 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:07:46 user nova-compute[74611]:   </clock>
Nov 13 10:07:46 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:07:46 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:07:46 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:07:46 user nova-compute[74611]:   </cpu>
Nov 13 10:07:46 user nova-compute[74611]:   <devices>
Nov 13 10:07:46 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:07:46 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:07:46 user nova-compute[74611]:       <source dev="/dev/sde"/>
Nov 13 10:07:46 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:07:46 user nova-compute[74611]:       <serial>aedff532-9929-4ffa-8aac-ef4ad576a740</serial>
Nov 13 10:07:46 user nova-compute[74611]:     </disk>
Nov 13 10:07:46 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:07:46 user nova-compute[74611]:       <mac address="fa:16:3e:9c:24:82"/>
Nov 13 10:07:46 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:07:46 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:07:46 user nova-compute[74611]:       <target dev="tap71ffa4ff-d0"/>
Nov 13 10:07:46 user nova-compute[74611]:     </interface>
Nov 13 10:07:46 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:07:46 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/e9ed65b3-b8fc-4320-9625-e5028b6e340d/console.log" append="off"/>
Nov 13 10:07:46 user nova-compute[74611]:     </serial>
Nov 13 10:07:46 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:07:46 user nova-compute[74611]:     <video>
Nov 13 10:07:46 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:07:46 user nova-compute[74611]:     </video>
Nov 13 10:07:46 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:07:46 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:07:46 user nova-compute[74611]:     </rng>
Nov 13 10:07:46 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:07:46 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:07:46 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:07:46 user nova-compute[74611]:     </memballoon>
Nov 13 10:07:46 user nova-compute[74611]:   </devices>
Nov 13 10:07:46 user nova-compute[74611]: </domain>
Nov 13 10:07:46 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-8480901',display_name='tempest-TestVolumeBootPattern-server-8480901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-8480901',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjRXcM+iAZvLJco7tBubak1kGHq/45jJ2KKO6E3tr61cFQKM/YqE/xURoOe/LdnL01vr4FH+cPhy0FHq1+WQre34a6xvIem5nHqznPEd2v959ht3Wgct9dv/En52XotjA==',key_name='tempest-TestVolumeBootPattern-1763350711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-e0xb40sn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:07:41Z,user_data=None,user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=e9ed65b3-b8fc-4320-9625-e5028b6e340d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "address": "fa:16:3e:9c:24:82", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ffa4ff-d0", "ovs_interfaceid": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "address": "fa:16:3e:9c:24:82", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ffa4ff-d0", "ovs_interfaceid": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:24:82,bridge_name='br-int',has_traffic_filtering=True,id=71ffa4ff-d077-44f9-b3d1-3c2a921d6334,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ffa4ff-d0') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG os_vif [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:24:82,bridge_name='br-int',has_traffic_filtering=True,id=71ffa4ff-d077-44f9-b3d1-3c2a921d6334,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ffa4ff-d0') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41cf4889-d39c-5f4b-a1e2-22d1005f05ee', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71ffa4ff-d0, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71ffa4ff-d0, col_values=(('qos', UUID('e9abfb63-76bb-47c4-8f6c-47d569fd2fad')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71ffa4ff-d0, col_values=(('external_ids', {'iface-id': '71ffa4ff-d077-44f9-b3d1-3c2a921d6334', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:24:82', 'vm-uuid': 'e9ed65b3-b8fc-4320-9625-e5028b6e340d'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:07:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:46 user nova-compute[74611]: INFO os_vif [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:24:82,bridge_name='br-int',has_traffic_filtering=True,id=71ffa4ff-d077-44f9-b3d1-3c2a921d6334,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ffa4ff-d0')
Nov 13 10:07:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:07:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] No VIF found with MAC fa:16:3e:9c:24:82, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:07:47 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:07:47 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:07:48 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:07:48 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:07:48 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:07:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:07:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:50 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:07:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-107b0d84-ad38-41de-9037-46d64b411358 req-73f8b840-348d-41ed-9c5a-6176f9c2c665 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Received event network-vif-plugged-71ffa4ff-d077-44f9-b3d1-3c2a921d6334 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-107b0d84-ad38-41de-9037-46d64b411358 req-73f8b840-348d-41ed-9c5a-6176f9c2c665 service nova] Acquiring lock "e9ed65b3-b8fc-4320-9625-e5028b6e340d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-107b0d84-ad38-41de-9037-46d64b411358 req-73f8b840-348d-41ed-9c5a-6176f9c2c665 service nova] Lock "e9ed65b3-b8fc-4320-9625-e5028b6e340d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-107b0d84-ad38-41de-9037-46d64b411358 req-73f8b840-348d-41ed-9c5a-6176f9c2c665 service nova] Lock "e9ed65b3-b8fc-4320-9625-e5028b6e340d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-107b0d84-ad38-41de-9037-46d64b411358 req-73f8b840-348d-41ed-9c5a-6176f9c2c665 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] No waiting events found dispatching network-vif-plugged-71ffa4ff-d077-44f9-b3d1-3c2a921d6334 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:07:50 user nova-compute[74611]: WARNING nova.compute.manager [req-107b0d84-ad38-41de-9037-46d64b411358 req-73f8b840-348d-41ed-9c5a-6176f9c2c665 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Received unexpected event network-vif-plugged-71ffa4ff-d077-44f9-b3d1-3c2a921d6334 for instance with vm_state building and task_state spawning.
Nov 13 10:07:50 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:07:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:07:50 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Instance spawned successfully.
Nov 13 10:07:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:07:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:07:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:07:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:07:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:07:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:07:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:07:50 user nova-compute[74611]: INFO nova.compute.manager [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 13 10:07:50 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:07:50 user nova-compute[74611]: INFO nova.compute.manager [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Took 10.94 seconds to build instance.
Nov 13 10:07:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c2cc3964-406e-4cb5-bb92-b5502bfd9ff8 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "e9ed65b3-b8fc-4320-9625-e5028b6e340d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.112s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-fd3a8a0a-d9bd-4966-8af5-d550c213451f req-4b1589a8-82c8-4663-86cc-3dc7e5ccd865 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Received event network-vif-plugged-71ffa4ff-d077-44f9-b3d1-3c2a921d6334 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fd3a8a0a-d9bd-4966-8af5-d550c213451f req-4b1589a8-82c8-4663-86cc-3dc7e5ccd865 service nova] Acquiring lock "e9ed65b3-b8fc-4320-9625-e5028b6e340d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fd3a8a0a-d9bd-4966-8af5-d550c213451f req-4b1589a8-82c8-4663-86cc-3dc7e5ccd865 service nova] Lock "e9ed65b3-b8fc-4320-9625-e5028b6e340d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fd3a8a0a-d9bd-4966-8af5-d550c213451f req-4b1589a8-82c8-4663-86cc-3dc7e5ccd865 service nova] Lock "e9ed65b3-b8fc-4320-9625-e5028b6e340d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-fd3a8a0a-d9bd-4966-8af5-d550c213451f req-4b1589a8-82c8-4663-86cc-3dc7e5ccd865 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] No waiting events found dispatching network-vif-plugged-71ffa4ff-d077-44f9-b3d1-3c2a921d6334 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:07:52 user nova-compute[74611]: WARNING nova.compute.manager [req-fd3a8a0a-d9bd-4966-8af5-d550c213451f req-4b1589a8-82c8-4663-86cc-3dc7e5ccd865 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Received unexpected event network-vif-plugged-71ffa4ff-d077-44f9-b3d1-3c2a921d6334 for instance with vm_state active and task_state None.
Nov 13 10:07:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:53 user nova-compute[74611]: INFO nova.compute.manager [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Detaching volume 6e42a395-a96a-419b-8acf-a49518f1ed1d
Nov 13 10:07:53 user nova-compute[74611]: INFO nova.virt.block_device [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Attempting to driver detach volume 6e42a395-a96a-419b-8acf-a49518f1ed1d from mountpoint /dev/vdb
Nov 13 10:07:53 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:07:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Attempting to detach device vdb from instance 4fa9e23b-30f2-41ae-83ed-86145389d474 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:07:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:07:53 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:07:53 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:07:53 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:07:53 user nova-compute[74611]:   <serial>6e42a395-a96a-419b-8acf-a49518f1ed1d</serial>
Nov 13 10:07:53 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:07:53 user nova-compute[74611]: </disk>
Nov 13 10:07:53 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:07:53 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Successfully detached device vdb from instance 4fa9e23b-30f2-41ae-83ed-86145389d474 from the persistent domain config.
Nov 13 10:07:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4fa9e23b-30f2-41ae-83ed-86145389d474 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:07:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:07:53 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:07:53 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:07:53 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:07:53 user nova-compute[74611]:   <serial>6e42a395-a96a-419b-8acf-a49518f1ed1d</serial>
Nov 13 10:07:53 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:07:53 user nova-compute[74611]: </disk>
Nov 13 10:07:53 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:07:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:53 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:07:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4fa9e23b-30f2-41ae-83ed-86145389d474 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:07:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:07:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:07:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-8aec036c-eda9-4e43-ae03-c5609412cde6 req-683d3742-2722-49d4-9e0c-f9cb156b3a4c service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-changed-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-8aec036c-eda9-4e43-ae03-c5609412cde6 req-683d3742-2722-49d4-9e0c-f9cb156b3a4c service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Refreshing instance network info cache due to event network-changed-ffb1eb13-f028-447f-a01d-45bae2d17edd. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:07:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8aec036c-eda9-4e43-ae03-c5609412cde6 req-683d3742-2722-49d4-9e0c-f9cb156b3a4c service nova] Acquiring lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:07:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8aec036c-eda9-4e43-ae03-c5609412cde6 req-683d3742-2722-49d4-9e0c-f9cb156b3a4c service nova] Acquired lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:07:54 user nova-compute[74611]: DEBUG nova.network.neutron [req-8aec036c-eda9-4e43-ae03-c5609412cde6 req-683d3742-2722-49d4-9e0c-f9cb156b3a4c service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Refreshing network info cache for port ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:07:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG nova.network.neutron [req-8aec036c-eda9-4e43-ae03-c5609412cde6 req-683d3742-2722-49d4-9e0c-f9cb156b3a4c service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Updated VIF entry in instance network info cache for port ffb1eb13-f028-447f-a01d-45bae2d17edd. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG nova.network.neutron [req-8aec036c-eda9-4e43-ae03-c5609412cde6 req-683d3742-2722-49d4-9e0c-f9cb156b3a4c service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Updating instance_info_cache with network_info: [{"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8aec036c-eda9-4e43-ae03-c5609412cde6 req-683d3742-2722-49d4-9e0c-f9cb156b3a4c service nova] Releasing lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG nova.compute.manager [req-8aec036c-eda9-4e43-ae03-c5609412cde6 req-683d3742-2722-49d4-9e0c-f9cb156b3a4c service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-changed-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG nova.compute.manager [req-8aec036c-eda9-4e43-ae03-c5609412cde6 req-683d3742-2722-49d4-9e0c-f9cb156b3a4c service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Refreshing instance network info cache due to event network-changed-ffb1eb13-f028-447f-a01d-45bae2d17edd. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8aec036c-eda9-4e43-ae03-c5609412cde6 req-683d3742-2722-49d4-9e0c-f9cb156b3a4c service nova] Acquiring lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8aec036c-eda9-4e43-ae03-c5609412cde6 req-683d3742-2722-49d4-9e0c-f9cb156b3a4c service nova] Acquired lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG nova.network.neutron [req-8aec036c-eda9-4e43-ae03-c5609412cde6 req-683d3742-2722-49d4-9e0c-f9cb156b3a4c service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Refreshing network info cache for port ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG nova.network.neutron [req-8aec036c-eda9-4e43-ae03-c5609412cde6 req-683d3742-2722-49d4-9e0c-f9cb156b3a4c service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Updated VIF entry in instance network info cache for port ffb1eb13-f028-447f-a01d-45bae2d17edd. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG nova.network.neutron [req-8aec036c-eda9-4e43-ae03-c5609412cde6 req-683d3742-2722-49d4-9e0c-f9cb156b3a4c service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Updating instance_info_cache with network_info: [{"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8aec036c-eda9-4e43-ae03-c5609412cde6 req-683d3742-2722-49d4-9e0c-f9cb156b3a4c service nova] Releasing lock "refresh_cache-4fa9e23b-30f2-41ae-83ed-86145389d474" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:07:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:07:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:07:58 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:07:58 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=7673MB free_disk=25.12346649169922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 85cb3adb-b2b3-49ec-92ab-c2b7a028241a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4fa9e23b-30f2-41ae-83ed-86145389d474 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7eff589b-8f0f-4e6e-ac04-567da455e579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f059d809-84b0-40c4-be84-bc89a9dc182e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance e9ed65b3-b8fc-4320-9625-e5028b6e340d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:07:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.553s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:07:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:01 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:08:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "d0853d6e-1178-4a53-a532-b45656d9e416" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:02 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:08:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:02 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:08:02 user nova-compute[74611]: INFO nova.compute.claims [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Claim successful on node user
Nov 13 10:08:02 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:08:02 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:08:03 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:08:03 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:08:03 user nova-compute[74611]: INFO nova.virt.block_device [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Booting with volume 74ba88b6-8564-42d7-b805-f1d7c463dadd at /dev/vda
Nov 13 10:08:03 user nova-compute[74611]: DEBUG nova.policy [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fa51d40058b4882ac12075776b36ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b003c1f30e448a9725379dc78c779d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG os_brick.utils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92ebcf2-29ab-4649-99a1-dbf6e377b44e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[641a9c29-56fd-4a9f-87a2-86b53a08cae2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db3bd8a-560d-4350-9541-1c47400df0d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f801cc-f370-4a68-b25f-cb29e0f46092]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:08:03 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:08:03 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f4201a-79d0-4722-8180-37936f090c7f]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG os_brick.utils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:08:03 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Updating existing volume attachment record: 6273f5ba-369e-4280-9814-8fcf48f23545 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:08:04 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Successfully created port: 68041c9c-ff1f-4f90-b36c-2d68ecc786ce {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:08:04 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Successfully created port: f385fbf1-2c52-42d5-addd-f950be2dac74 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:08:05 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Successfully created port: 3d1655af-51db-4dc6-8250-9e5d2aee112a {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:08:05 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Successfully created port: a79c7eee-edeb-42c7-813e-d8888ffdf514 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:08:06 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Successfully created port: 6c6fc688-5b31-41ae-b902-b1271c264078 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:08:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:07 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Successfully updated port: 68041c9c-ff1f-4f90-b36c-2d68ecc786ce {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:08:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-5b21cf46-3b05-4c56-8903-2f5aca8e523d req-7d9e8db3-8668-4832-889c-8efda5b26afb service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-changed-68041c9c-ff1f-4f90-b36c-2d68ecc786ce {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-5b21cf46-3b05-4c56-8903-2f5aca8e523d req-7d9e8db3-8668-4832-889c-8efda5b26afb service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Refreshing instance network info cache due to event network-changed-68041c9c-ff1f-4f90-b36c-2d68ecc786ce. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:08:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5b21cf46-3b05-4c56-8903-2f5aca8e523d req-7d9e8db3-8668-4832-889c-8efda5b26afb service nova] Acquiring lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:08:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5b21cf46-3b05-4c56-8903-2f5aca8e523d req-7d9e8db3-8668-4832-889c-8efda5b26afb service nova] Acquired lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:08:07 user nova-compute[74611]: DEBUG nova.network.neutron [req-5b21cf46-3b05-4c56-8903-2f5aca8e523d req-7d9e8db3-8668-4832-889c-8efda5b26afb service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Refreshing network info cache for port 68041c9c-ff1f-4f90-b36c-2d68ecc786ce {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:08:07 user nova-compute[74611]: DEBUG nova.network.neutron [req-5b21cf46-3b05-4c56-8903-2f5aca8e523d req-7d9e8db3-8668-4832-889c-8efda5b26afb service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:08:07 user nova-compute[74611]: DEBUG nova.network.neutron [req-5b21cf46-3b05-4c56-8903-2f5aca8e523d req-7d9e8db3-8668-4832-889c-8efda5b26afb service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:08:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5b21cf46-3b05-4c56-8903-2f5aca8e523d req-7d9e8db3-8668-4832-889c-8efda5b26afb service nova] Releasing lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:08:07 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Successfully updated port: 5a95e799-9076-4024-809f-7de7acb57e68 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:08:08 user nova-compute[74611]: INFO nova.virt.block_device [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Booting with volume 97ca530c-111f-427f-93e0-67eb70f4f0bc at /dev/vdb
Nov 13 10:08:08 user nova-compute[74611]: DEBUG os_brick.utils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b8a422-b982-4ea5-9e6f-8c059115699e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39d5bdd-c474-44ed-a696-892e80d67dd3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[688af990-ba6d-4448-ae8e-7305e0247dfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[43406f44-ffb4-4ebb-bf4d-170509f91c7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:08:08 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:08:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[66939922-bec7-4c80-82ae-6d7915c62d0a]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG os_brick.utils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Updating existing volume attachment record: 6eeaf160-4265-41b3-afb8-dc928cf500f2 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:08:08 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Successfully updated port: 74d60359-c0d5-442d-8b95-d97a937d5b98 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG nova.compute.manager [req-884040fb-7c86-400c-9323-b5f8b8c41b0d req-ca9ff66c-ed2a-4d1e-a1d8-94914ba8549b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-changed-5a95e799-9076-4024-809f-7de7acb57e68 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG nova.compute.manager [req-884040fb-7c86-400c-9323-b5f8b8c41b0d req-ca9ff66c-ed2a-4d1e-a1d8-94914ba8549b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Refreshing instance network info cache due to event network-changed-5a95e799-9076-4024-809f-7de7acb57e68. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-884040fb-7c86-400c-9323-b5f8b8c41b0d req-ca9ff66c-ed2a-4d1e-a1d8-94914ba8549b service nova] Acquiring lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-884040fb-7c86-400c-9323-b5f8b8c41b0d req-ca9ff66c-ed2a-4d1e-a1d8-94914ba8549b service nova] Acquired lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG nova.network.neutron [req-884040fb-7c86-400c-9323-b5f8b8c41b0d req-ca9ff66c-ed2a-4d1e-a1d8-94914ba8549b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Refreshing network info cache for port 5a95e799-9076-4024-809f-7de7acb57e68 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG nova.network.neutron [req-884040fb-7c86-400c-9323-b5f8b8c41b0d req-ca9ff66c-ed2a-4d1e-a1d8-94914ba8549b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG nova.network.neutron [req-884040fb-7c86-400c-9323-b5f8b8c41b0d req-ca9ff66c-ed2a-4d1e-a1d8-94914ba8549b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-884040fb-7c86-400c-9323-b5f8b8c41b0d req-ca9ff66c-ed2a-4d1e-a1d8-94914ba8549b service nova] Releasing lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG nova.compute.manager [req-884040fb-7c86-400c-9323-b5f8b8c41b0d req-ca9ff66c-ed2a-4d1e-a1d8-94914ba8549b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-changed-74d60359-c0d5-442d-8b95-d97a937d5b98 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG nova.compute.manager [req-884040fb-7c86-400c-9323-b5f8b8c41b0d req-ca9ff66c-ed2a-4d1e-a1d8-94914ba8549b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Refreshing instance network info cache due to event network-changed-74d60359-c0d5-442d-8b95-d97a937d5b98. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-884040fb-7c86-400c-9323-b5f8b8c41b0d req-ca9ff66c-ed2a-4d1e-a1d8-94914ba8549b service nova] Acquiring lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-884040fb-7c86-400c-9323-b5f8b8c41b0d req-ca9ff66c-ed2a-4d1e-a1d8-94914ba8549b service nova] Acquired lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG nova.network.neutron [req-884040fb-7c86-400c-9323-b5f8b8c41b0d req-ca9ff66c-ed2a-4d1e-a1d8-94914ba8549b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Refreshing network info cache for port 74d60359-c0d5-442d-8b95-d97a937d5b98 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Successfully updated port: f385fbf1-2c52-42d5-addd-f950be2dac74 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG nova.network.neutron [req-884040fb-7c86-400c-9323-b5f8b8c41b0d req-ca9ff66c-ed2a-4d1e-a1d8-94914ba8549b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG nova.network.neutron [req-884040fb-7c86-400c-9323-b5f8b8c41b0d req-ca9ff66c-ed2a-4d1e-a1d8-94914ba8549b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:08:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-884040fb-7c86-400c-9323-b5f8b8c41b0d req-ca9ff66c-ed2a-4d1e-a1d8-94914ba8549b service nova] Releasing lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:08:10 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Successfully updated port: 3d1655af-51db-4dc6-8250-9e5d2aee112a {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:08:10 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Successfully updated port: a79c7eee-edeb-42c7-813e-d8888ffdf514 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-changed-f385fbf1-2c52-42d5-addd-f950be2dac74 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Refreshing instance network info cache due to event network-changed-f385fbf1-2c52-42d5-addd-f950be2dac74. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] Acquiring lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] Acquired lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG nova.network.neutron [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Refreshing network info cache for port f385fbf1-2c52-42d5-addd-f950be2dac74 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG nova.network.neutron [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG nova.network.neutron [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] Releasing lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-changed-3d1655af-51db-4dc6-8250-9e5d2aee112a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Refreshing instance network info cache due to event network-changed-3d1655af-51db-4dc6-8250-9e5d2aee112a. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] Acquiring lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] Acquired lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG nova.network.neutron [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Refreshing network info cache for port 3d1655af-51db-4dc6-8250-9e5d2aee112a {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Successfully updated port: 6c6fc688-5b31-41ae-b902-b1271c264078 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquiring lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG nova.network.neutron [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG nova.network.neutron [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] Releasing lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-changed-a79c7eee-edeb-42c7-813e-d8888ffdf514 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Refreshing instance network info cache due to event network-changed-a79c7eee-edeb-42c7-813e-d8888ffdf514. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] Acquiring lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] Acquired lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG nova.network.neutron [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Refreshing network info cache for port a79c7eee-edeb-42c7-813e-d8888ffdf514 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:08:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:12 user nova-compute[74611]: DEBUG nova.network.neutron [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:08:12 user nova-compute[74611]: DEBUG nova.network.neutron [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:08:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-034c9ea4-2a66-4994-8ec2-748a3861e592 req-fc9ee14d-9fe5-412a-8715-022575948ad9 service nova] Releasing lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:08:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquired lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:08:12 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:08:12 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG nova.compute.manager [req-476c3a33-9b6b-4cb9-a683-4c400101aef8 req-cb4b471c-7a8f-47c2-b9a8-486cbf8b7b97 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-changed-6c6fc688-5b31-41ae-b902-b1271c264078 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG nova.compute.manager [req-476c3a33-9b6b-4cb9-a683-4c400101aef8 req-cb4b471c-7a8f-47c2-b9a8-486cbf8b7b97 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Refreshing instance network info cache due to event network-changed-6c6fc688-5b31-41ae-b902-b1271c264078. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-476c3a33-9b6b-4cb9-a683-4c400101aef8 req-cb4b471c-7a8f-47c2-b9a8-486cbf8b7b97 service nova] Acquiring lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:08:13 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4fa9e23b-30f2-41ae-83ed-86145389d474 is timed out.
Nov 13 10:08:13 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Successfully detached device vdb from instance 4fa9e23b-30f2-41ae-83ed-86145389d474 from the live domain config.
Nov 13 10:08:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgNWIkqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:08:13 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:08:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1271c944-965b-4e9e-9090-d59d02d6002e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:08:13 user nova-compute[74611]: No targets found.
Nov 13 10:08:13 user nova-compute[74611]: iSNS:
Nov 13 10:08:13 user nova-compute[74611]: No targets found.
Nov 13 10:08:13 user nova-compute[74611]: STATIC:
Nov 13 10:08:13 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc
Nov 13 10:08:13 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:08:13 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:08:13 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d
Nov 13 10:08:13 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:08:13 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:08:13 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740
Nov 13 10:08:13 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:08:13 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:08:13 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd
Nov 13 10:08:13 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:08:13 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:08:13 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:08:13 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:08:13 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:08:13 user nova-compute[74611]: FIRMWARE:
Nov 13 10:08:13 user nova-compute[74611]: No targets found.
Nov 13 10:08:13 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:08:13 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:08:13 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc0de95-2d24-490a-9733-947a43c576f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd359be7-fb7e-463f-bb23-8968a3941d86]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:08:13 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:08:13 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:08:13 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:08:13 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:08:13 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:08:13 user nova-compute[74611]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d (non-flash)
Nov 13 10:08:13 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:08:13 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:08:13 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:08:13 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb643679a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b89476-cd49-402c-835b-bfb34d2e81b8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0b9c42-635b-4826-adde-34ee71784613]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[432a8a9a-93e5-42bf-8919-aed1ad7717d6]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[be69df01-f01c-438e-be45-1ab995353ed5]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f88d2e-f865-4dcb-9566-350a40ec1c68]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ead33c-adaa-424a-8211-2de073d8d4fa]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d, portal: 172.16.0.220,3260]
Nov 13 10:08:14 user nova-compute[74611]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d, portal: 172.16.0.220,3260] successful.
Nov 13 10:08:14 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e42a395-a96a-419b-8acf-a49518f1ed1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8f7dc9-0971-4815-b5a8-c07af1dbb785]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] <== disconnect_volume: return (366ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "7eff589b-8f0f-4e6e-ac04-567da455e579" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:14 user nova-compute[74611]: INFO nova.compute.manager [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Terminating instance
Nov 13 10:08:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-488b5856-2a30-467c-a7ba-399df3081730 req-e51fc7eb-aeb2-4828-b948-b4e078dbcabc service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received event network-vif-unplugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-488b5856-2a30-467c-a7ba-399df3081730 req-e51fc7eb-aeb2-4828-b948-b4e078dbcabc service nova] Acquiring lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-488b5856-2a30-467c-a7ba-399df3081730 req-e51fc7eb-aeb2-4828-b948-b4e078dbcabc service nova] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-488b5856-2a30-467c-a7ba-399df3081730 req-e51fc7eb-aeb2-4828-b948-b4e078dbcabc service nova] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-488b5856-2a30-467c-a7ba-399df3081730 req-e51fc7eb-aeb2-4828-b948-b4e078dbcabc service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] No waiting events found dispatching network-vif-unplugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-488b5856-2a30-467c-a7ba-399df3081730 req-e51fc7eb-aeb2-4828-b948-b4e078dbcabc service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received event network-vif-unplugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG nova.network.neutron [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Updating instance_info_cache with network_info: [{"id": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "address": "fa:16:3e:e3:d6:0e", "network": {"id": "1465dfcb-80a9-4c13-8ad2-d49990f27559", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-614630284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68041c9c-ff", "ovs_interfaceid": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a95e799-9076-4024-809f-7de7acb57e68", "address": "fa:16:3e:91:fd:2b", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a95e799-90", "ovs_interfaceid": "5a95e799-9076-4024-809f-7de7acb57e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74d60359-c0d5-442d-8b95-d97a937d5b98", "address": "fa:16:3e:35:d1:d0", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d60359-c0", "ovs_interfaceid": "74d60359-c0d5-442d-8b95-d97a937d5b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f385fbf1-2c52-42d5-addd-f950be2dac74", "address": "fa:16:3e:92:70:35", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf385fbf1-2c", "ovs_interfaceid": "f385fbf1-2c52-42d5-addd-f950be2dac74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "address": "fa:16:3e:b6:48:d4", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1655af-51", "ovs_interfaceid": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "address": "fa:16:3e:e1:e9:f1", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79c7eee-ed", "ovs_interfaceid": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c6fc688-5b31-41ae-b902-b1271c264078", "address": "fa:16:3e:47:f7:66", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c6fc688-5b", "ovs_interfaceid": "6c6fc688-5b31-41ae-b902-b1271c264078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Releasing lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Instance network_info: |[{"id": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "address": "fa:16:3e:e3:d6:0e", "network": {"id": "1465dfcb-80a9-4c13-8ad2-d49990f27559", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-614630284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68041c9c-ff", "ovs_interfaceid": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a95e799-9076-4024-809f-7de7acb57e68", "address": "fa:16:3e:91:fd:2b", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a95e799-90", "ovs_interfaceid": "5a95e799-9076-4024-809f-7de7acb57e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74d60359-c0d5-442d-8b95-d97a937d5b98", "address": "fa:16:3e:35:d1:d0", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d60359-c0", "ovs_interfaceid": "74d60359-c0d5-442d-8b95-d97a937d5b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f385fbf1-2c52-42d5-addd-f950be2dac74", "address": "fa:16:3e:92:70:35", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf385fbf1-2c", "ovs_interfaceid": "f385fbf1-2c52-42d5-addd-f950be2dac74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "address": "fa:16:3e:b6:48:d4", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1655af-51", "ovs_interfaceid": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "address": "fa:16:3e:e1:e9:f1", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79c7eee-ed", "ovs_interfaceid": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c6fc688-5b31-41ae-b902-b1271c264078", "address": "fa:16:3e:47:f7:66", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c6fc688-5b", "ovs_interfaceid": "6c6fc688-5b31-41ae-b902-b1271c264078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-476c3a33-9b6b-4cb9-a683-4c400101aef8 req-cb4b471c-7a8f-47c2-b9a8-486cbf8b7b97 service nova] Acquired lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:08:14 user nova-compute[74611]: DEBUG nova.network.neutron [req-476c3a33-9b6b-4cb9-a683-4c400101aef8 req-cb4b471c-7a8f-47c2-b9a8-486cbf8b7b97 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Refreshing network info cache for port 6c6fc688-5b31-41ae-b902-b1271c264078 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG nova.objects.instance [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'flavor' on Instance uuid 4fa9e23b-30f2-41ae-83ed-86145389d474 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f010d79a-9d24-46f1-ac73-dbd200b3b4ae tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.966s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:15 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Instance destroyed successfully.
Nov 13 10:08:15 user nova-compute[74611]: DEBUG nova.objects.instance [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lazy-loading 'resources' on Instance uuid 7eff589b-8f0f-4e6e-ac04-567da455e579 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T10:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-645946469',display_name='tempest-ServerActionsTestOtherA-server-1200695120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-645946469',id=30,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMgiZS8iDWJccUoJm8Cr1Cy30m8ExeWrxEP4qRo7zR0nLwbMSKbTx4l1ShW9U7NI1irrxVZ/xJYIVnbYASt5DAgSuA5M9ZDOJFAOj03z1hM3/11AHFBM2VNKmeseRl6Ng==',key_name='tempest-keypair-620803101',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:04:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6a0b0a078bd44908cd7cd4593914eef',ramdisk_id='',reservation_id='r-0cttspsb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2135577355',owner_user_name='tempest-ServerActionsTestOtherA-2135577355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:04:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22322be2dd04410b6cd53c31e639b3b',uuid=7eff589b-8f0f-4e6e-ac04-567da455e579,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converting VIF {"id": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "address": "fa:16:3e:8b:04:f1", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa102bae6-0d", "ovs_interfaceid": "a102bae6-0d19-44c8-9aed-ea01e72e4d11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=a102bae6-0d19-44c8-9aed-ea01e72e4d11,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa102bae6-0d') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG os_vif [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=a102bae6-0d19-44c8-9aed-ea01e72e4d11,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa102bae6-0d') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa102bae6-0d, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27042ac5-f547-4fe9-abd2-fff15697c14f) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:15 user nova-compute[74611]: INFO os_vif [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=a102bae6-0d19-44c8-9aed-ea01e72e4d11,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa102bae6-0d')
Nov 13 10:08:15 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Deleting instance files /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579_del
Nov 13 10:08:15 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Deletion of /opt/stack/data/nova/instances/7eff589b-8f0f-4e6e-ac04-567da455e579_del complete
Nov 13 10:08:15 user nova-compute[74611]: INFO nova.compute.manager [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 13 10:08:15 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG nova.network.neutron [req-476c3a33-9b6b-4cb9-a683-4c400101aef8 req-cb4b471c-7a8f-47c2-b9a8-486cbf8b7b97 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Updated VIF entry in instance network info cache for port 6c6fc688-5b31-41ae-b902-b1271c264078. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG nova.network.neutron [req-476c3a33-9b6b-4cb9-a683-4c400101aef8 req-cb4b471c-7a8f-47c2-b9a8-486cbf8b7b97 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Updating instance_info_cache with network_info: [{"id": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "address": "fa:16:3e:e3:d6:0e", "network": {"id": "1465dfcb-80a9-4c13-8ad2-d49990f27559", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-614630284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68041c9c-ff", "ovs_interfaceid": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a95e799-9076-4024-809f-7de7acb57e68", "address": "fa:16:3e:91:fd:2b", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a95e799-90", "ovs_interfaceid": "5a95e799-9076-4024-809f-7de7acb57e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74d60359-c0d5-442d-8b95-d97a937d5b98", "address": "fa:16:3e:35:d1:d0", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d60359-c0", "ovs_interfaceid": "74d60359-c0d5-442d-8b95-d97a937d5b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f385fbf1-2c52-42d5-addd-f950be2dac74", "address": "fa:16:3e:92:70:35", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf385fbf1-2c", "ovs_interfaceid": "f385fbf1-2c52-42d5-addd-f950be2dac74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "address": "fa:16:3e:b6:48:d4", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1655af-51", "ovs_interfaceid": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "address": "fa:16:3e:e1:e9:f1", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79c7eee-ed", "ovs_interfaceid": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c6fc688-5b31-41ae-b902-b1271c264078", "address": "fa:16:3e:47:f7:66", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c6fc688-5b", "ovs_interfaceid": "6c6fc688-5b31-41ae-b902-b1271c264078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:08:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-476c3a33-9b6b-4cb9-a683-4c400101aef8 req-cb4b471c-7a8f-47c2-b9a8-486cbf8b7b97 service nova] Releasing lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:08:16 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Took 0.85 seconds to deallocate network for instance.
Nov 13 10:08:16 user nova-compute[74611]: DEBUG nova.compute.manager [req-318b0b18-c4a5-4f82-87de-7b8eefaae343 req-750efba1-d467-4e45-91bc-193c17c7c11a service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received event network-vif-deleted-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:16 user nova-compute[74611]: INFO nova.compute.manager [req-318b0b18-c4a5-4f82-87de-7b8eefaae343 req-750efba1-d467-4e45-91bc-193c17c7c11a service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Neutron deleted interface a102bae6-0d19-44c8-9aed-ea01e72e4d11; detaching it from the instance and deleting it from the info cache
Nov 13 10:08:16 user nova-compute[74611]: DEBUG nova.network.neutron [req-318b0b18-c4a5-4f82-87de-7b8eefaae343 req-750efba1-d467-4e45-91bc-193c17c7c11a service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG nova.compute.manager [req-318b0b18-c4a5-4f82-87de-7b8eefaae343 req-750efba1-d467-4e45-91bc-193c17c7c11a service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Detach interface failed, port_id=a102bae6-0d19-44c8-9aed-ea01e72e4d11, reason: Instance 7eff589b-8f0f-4e6e-ac04-567da455e579 could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 10:08:16 user nova-compute[74611]: INFO nova.virt.block_device [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Booting with volume 2e1128fa-47f2-4d59-9284-47faba1f03c6 at /dev/vdc
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG os_brick.utils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb45bf3-cf19-4fca-8edb-4bc815849d51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8646ac-d4db-4634-b3b3-cc3b8115fa88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cf42ab-c329-4ad2-8e84-b6c9805e7b24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32186c5-0ad8-4bf1-9d75-0cd6a11fe319]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:08:16 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a12053-2827-4a3a-85ab-6c951ebe6c72]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG os_brick.utils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Updating existing volume attachment record: e088adcf-c444-4405-8881-df82a3c4c029 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:16 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Deleted allocations for instance 7eff589b-8f0f-4e6e-ac04-567da455e579
Nov 13 10:08:16 user nova-compute[74611]: DEBUG nova.compute.manager [req-64516fa4-c49e-40fe-8a8a-e9b1dc510056 req-e6c4ee6d-9e9a-4bd3-b038-7460a2f78c1b service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received event network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-64516fa4-c49e-40fe-8a8a-e9b1dc510056 req-e6c4ee6d-9e9a-4bd3-b038-7460a2f78c1b service nova] Acquiring lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-64516fa4-c49e-40fe-8a8a-e9b1dc510056 req-e6c4ee6d-9e9a-4bd3-b038-7460a2f78c1b service nova] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-64516fa4-c49e-40fe-8a8a-e9b1dc510056 req-e6c4ee6d-9e9a-4bd3-b038-7460a2f78c1b service nova] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:16 user nova-compute[74611]: DEBUG nova.compute.manager [req-64516fa4-c49e-40fe-8a8a-e9b1dc510056 req-e6c4ee6d-9e9a-4bd3-b038-7460a2f78c1b service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] No waiting events found dispatching network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:16 user nova-compute[74611]: WARNING nova.compute.manager [req-64516fa4-c49e-40fe-8a8a-e9b1dc510056 req-e6c4ee6d-9e9a-4bd3-b038-7460a2f78c1b service nova] [instance: 7eff589b-8f0f-4e6e-ac04-567da455e579] Received unexpected event network-vif-plugged-a102bae6-0d19-44c8-9aed-ea01e72e4d11 for instance with vm_state deleted and task_state None.
Nov 13 10:08:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-79f90529-d821-419b-a024-1f73139a7434 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "7eff589b-8f0f-4e6e-ac04-567da455e579" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.504s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:08:28 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Creating image(s)
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Ensure instance console log exists: /opt/stack/data/nova/instances/d0853d6e-1178-4a53-a532-b45656d9e416/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Start _get_guest_xml network_info=[{"id": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "address": "fa:16:3e:e3:d6:0e", "network": {"id": "1465dfcb-80a9-4c13-8ad2-d49990f27559", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-614630284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68041c9c-ff", "ovs_interfaceid": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a95e799-9076-4024-809f-7de7acb57e68", "address": "fa:16:3e:91:fd:2b", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a95e799-90", "ovs_interfaceid": "5a95e799-9076-4024-809f-7de7acb57e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74d60359-c0d5-442d-8b95-d97a937d5b98", "address": "fa:16:3e:35:d1:d0", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d60359-c0", "ovs_interfaceid": "74d60359-c0d5-442d-8b95-d97a937d5b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f385fbf1-2c52-42d5-addd-f950be2dac74", "address": "fa:16:3e:92:70:35", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf385fbf1-2c", "ovs_interfaceid": "f385fbf1-2c52-42d5-addd-f950be2dac74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "address": "fa:16:3e:b6:48:d4", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1655af-51", "ovs_interfaceid": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "address": "fa:16:3e:e1:e9:f1", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79c7eee-ed", "ovs_interfaceid": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c6fc688-5b31-41ae-b902-b1271c264078", "address": "fa:16:3e:47:f7:66", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c6fc688-5b", "ovs_interfaceid": "6c6fc688-5b31-41ae-b902-b1271c264078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '6273f5ba-369e-4280-9814-8fcf48f23545', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlJLhjPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd0853d6e-1178-4a53-a532-b45656d9e416', 'attached_at': '', 'detached_at': '', 'volume_id': '74ba88b6-8564-42d7-b805-f1d7c463dadd', 'serial': '74ba88b6-8564-42d7-b805-f1d7c463dadd'}, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'attachment_id': '6eeaf160-4265-41b3-afb8-dc928cf500f2', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLOrMcEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd0853d6e-1178-4a53-a532-b45656d9e416', 'attached_at': '', 'detached_at': '', 'volume_id': '97ca530c-111f-427f-93e0-67eb70f4f0bc', 'serial': '97ca530c-111f-427f-93e0-67eb70f4f0bc'}, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'attachment_id': 'e088adcf-c444-4405-8881-df82a3c4c029', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mhcbrUDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd0853d6e-1178-4a53-a532-b45656d9e416', 'attached_at': '', 'detached_at': '', 'volume_id': '2e1128fa-47f2-4d59-9284-47faba1f03c6', 'serial': '2e1128fa-47f2-4d59-9284-47faba1f03c6'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:08:28 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:08:28 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlJLhjPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:08:28 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:08:28 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:08:28 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[656c2f9e-1776-4763-bbb8-74d0ce97b18d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:08:28 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88df238-91ad-489e-8a46-4814efe68f28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd] added
Nov 13 10:08:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad11886-83ac-4289-ad1f-2d50150697e5]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb7b782-dc0e-47e0-bd8a-c966feda3288]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QlJLhjPn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QlJLhjPn" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf78568-7153-4b59-a1b8-5eb071d1869c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QlJLhjPn'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd63d843-754b-4d3f-ad95-dd0aab2a1c7f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb5b10a-613d-4f2d-ac78-990cf94811bf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:08:28 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:08:28 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:08:28 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:08:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:08:28 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:08:28 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:08:28 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:08:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c23652a-73d8-49ff-8836-a563888c98c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd, portal: 172.16.0.220,3260]
Nov 13 10:08:28 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd, portal: 172.16.0.220,3260] successful.
Nov 13 10:08:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[805966a8-5009-4f8f-a8c6-9f2d7eb70239]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[413a8038-2d3a-464b-a689-c46b080a6500]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:08:28 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:08:28 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:08:28 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:08:28 user nova-compute[74611]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)
Nov 13 10:08:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:08:28 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:08:28 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:08:28 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:08:28 user nova-compute[74611]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)
Nov 13 10:08:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[05891b64-7785-4c1a-9941-0fd79718feb8]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:28 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlJLhjPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26265313139396338', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265313139396338', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLOrMcEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:08:29 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:08:29 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:08:29 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4573773b-a5cd-4816-a424-d1ed079a328b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:08:29 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7068fc-5e5b-4336-9b41-f977325c13fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc] added
Nov 13 10:08:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe97262-d5c2-406f-81fd-13fe4d824a6b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac66472-10f0-48d7-9e71-4cd40e00356d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gLOrMcEi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gLOrMcEi" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b8d644-f63c-4c4d-85dd-33347b5acd9c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gLOrMcEi'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffc8a09-71a8-417f-bb79-21c579d50f7f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed64302-83ec-455b-82a1-92efc5c05b77]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69b34eb-cfea-440f-928b-16be8e1cd613 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69b34eb-cfea-440f-928b-16be8e1cd613 (non-flash)
Nov 13 10:08:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69b34eb-cfea-440f-928b-16be8e1cd613 (non-flash)
Nov 13 10:08:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f637876-ed69-464e-8a7c-eb3c8be15873]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc, portal: 172.16.0.220,3260]
Nov 13 10:08:29 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc, portal: 172.16.0.220,3260] successful.
Nov 13 10:08:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebb6ce8-e357-4fa6-8511-c8483c9ce6a9]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[14767162-053a-49ef-a084-d7499ac03bd7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69b34eb-cfea-440f-928b-16be8e1cd613 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69b34eb-cfea-440f-928b-16be8e1cd613 (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)
Nov 13 10:08:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69b34eb-cfea-440f-928b-16be8e1cd613 (non-flash)
Nov 13 10:08:29 user nova-compute[74611]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)
Nov 13 10:08:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] HCTL ('39', '-', '-', 0) found on session 41 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e919bf1-e698-45bc-a4b0-1b77497837e9]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:29 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Searching for a device in session 41 and hctl ['39', '*', '*', 0] yield: None {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Searching for a device in session 41 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLOrMcEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23837343031323766', 'path': '/dev/sdh'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837343031323766', 'path': '/dev/sdh'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mhcbrUDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:08:30 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:08:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:08:30 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:08:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:08:30 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:08:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be036b1-a9c8-40c0-8e75-ccff0edbbef1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:08:30 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5630bc-d964-45bf-9819-1dd74782e98b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6] added
Nov 13 10:08:30 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6447b840-f949-42cf-9f57-f184d01ab5f1]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f18ee30-ece4-4ade-b199-5beadce73bf7]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mhcbrUDp {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mhcbrUDp" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[183fd671-905f-4697-ba9f-2fd14b67f323]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mhcbrUDp'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e8471d-372b-40f0-aee8-3f4357f1d00c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ec227a-15ae-4c06-9348-28ff7ab07cd0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69b34eb-cfea-440f-928b-16be8e1cd613 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69b34eb-cfea-440f-928b-16be8e1cd613 (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)
Nov 13 10:08:31 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69b34eb-cfea-440f-928b-16be8e1cd613 (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)
Nov 13 10:08:31 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cf7228-d05a-42f0-b884-67ee9cc9d6bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6, portal: 172.16.0.220,3260]
Nov 13 10:08:31 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6, portal: 172.16.0.220,3260] successful.
Nov 13 10:08:31 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbe5d5c-0e4a-4679-ad48-cc7c8d960f3b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b79986-6088-4aa4-b465-f2dfc0ebf8f7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69b34eb-cfea-440f-928b-16be8e1cd613 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69b34eb-cfea-440f-928b-16be8e1cd613 (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 (non-flash)
Nov 13 10:08:31 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69b34eb-cfea-440f-928b-16be8e1cd613 (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)
Nov 13 10:08:31 user nova-compute[74611]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 (non-flash)
Nov 13 10:08:31 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] HCTL ('40', '-', '-', 0) found on session 42 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a021b26d-a322-439b-b98f-d9b985f421ba]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Searching for a device in session 42 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:08:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mhcbrUDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26363376233653533', 'path': '/dev/sdi'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363376233653533', 'path': '/dev/sdi'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "address": "fa:16:3e:e3:d6:0e", "network": {"id": "1465dfcb-80a9-4c13-8ad2-d49990f27559", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-614630284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68041c9c-ff", "ovs_interfaceid": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "address": "fa:16:3e:e3:d6:0e", "network": {"id": "1465dfcb-80a9-4c13-8ad2-d49990f27559", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-614630284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68041c9c-ff", "ovs_interfaceid": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:d6:0e,bridge_name='br-int',has_traffic_filtering=True,id=68041c9c-ff1f-4f90-b36c-2d68ecc786ce,network=Network(1465dfcb-80a9-4c13-8ad2-d49990f27559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68041c9c-ff') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a95e799-9076-4024-809f-7de7acb57e68", "address": "fa:16:3e:91:fd:2b", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a95e799-90", "ovs_interfaceid": "5a95e799-9076-4024-809f-7de7acb57e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "5a95e799-9076-4024-809f-7de7acb57e68", "address": "fa:16:3e:91:fd:2b", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a95e799-90", "ovs_interfaceid": "5a95e799-9076-4024-809f-7de7acb57e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:fd:2b,bridge_name='br-int',has_traffic_filtering=True,id=5a95e799-9076-4024-809f-7de7acb57e68,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5a95e799-90') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74d60359-c0d5-442d-8b95-d97a937d5b98", "address": "fa:16:3e:35:d1:d0", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d60359-c0", "ovs_interfaceid": "74d60359-c0d5-442d-8b95-d97a937d5b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "74d60359-c0d5-442d-8b95-d97a937d5b98", "address": "fa:16:3e:35:d1:d0", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d60359-c0", "ovs_interfaceid": "74d60359-c0d5-442d-8b95-d97a937d5b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:d1:d0,bridge_name='br-int',has_traffic_filtering=True,id=74d60359-c0d5-442d-8b95-d97a937d5b98,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74d60359-c0') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f385fbf1-2c52-42d5-addd-f950be2dac74", "address": "fa:16:3e:92:70:35", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf385fbf1-2c", "ovs_interfaceid": "f385fbf1-2c52-42d5-addd-f950be2dac74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "f385fbf1-2c52-42d5-addd-f950be2dac74", "address": "fa:16:3e:92:70:35", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf385fbf1-2c", "ovs_interfaceid": "f385fbf1-2c52-42d5-addd-f950be2dac74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:35,bridge_name='br-int',has_traffic_filtering=True,id=f385fbf1-2c52-42d5-addd-f950be2dac74,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf385fbf1-2c') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "address": "fa:16:3e:b6:48:d4", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1655af-51", "ovs_interfaceid": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "address": "fa:16:3e:b6:48:d4", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1655af-51", "ovs_interfaceid": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:48:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d1655af-51db-4dc6-8250-9e5d2aee112a,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1655af-51') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "address": "fa:16:3e:e1:e9:f1", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79c7eee-ed", "ovs_interfaceid": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "address": "fa:16:3e:e1:e9:f1", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79c7eee-ed", "ovs_interfaceid": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e9:f1,bridge_name='br-int',has_traffic_filtering=True,id=a79c7eee-edeb-42c7-813e-d8888ffdf514,network=Network(4f8bd835-da02-4926-9114-ffd0f16fea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa79c7eee-ed') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c6fc688-5b31-41ae-b902-b1271c264078", "address": "fa:16:3e:47:f7:66", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c6fc688-5b", "ovs_interfaceid": "6c6fc688-5b31-41ae-b902-b1271c264078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "6c6fc688-5b31-41ae-b902-b1271c264078", "address": "fa:16:3e:47:f7:66", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c6fc688-5b", "ovs_interfaceid": "6c6fc688-5b31-41ae-b902-b1271c264078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:f7:66,bridge_name='br-int',has_traffic_filtering=True,id=6c6fc688-5b31-41ae-b902-b1271c264078,network=Network(4f8bd835-da02-4926-9114-ffd0f16fea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c6fc688-5b') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.objects.instance [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lazy-loading 'pci_devices' on Instance uuid d0853d6e-1178-4a53-a532-b45656d9e416 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:08:32 user nova-compute[74611]:   <uuid>d0853d6e-1178-4a53-a532-b45656d9e416</uuid>
Nov 13 10:08:32 user nova-compute[74611]:   <name>instance-00000026</name>
Nov 13 10:08:32 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:08:32 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:08:32 user nova-compute[74611]:   <metadata>
Nov 13 10:08:32 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:08:32 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:08:32 user nova-compute[74611]:       <nova:name>tempest-device-tagging-server-373293110</nova:name>
Nov 13 10:08:32 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:08:28</nova:creationTime>
Nov 13 10:08:32 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:08:32 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:08:32 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:08:32 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:08:32 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:08:32 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:08:32 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:08:32 user nova-compute[74611]:       <nova:owner>
Nov 13 10:08:32 user nova-compute[74611]:         <nova:user uuid="3fa51d40058b4882ac12075776b36ea4">tempest-TaggedBootDevicesTest_v242-992195744-project-member</nova:user>
Nov 13 10:08:32 user nova-compute[74611]:         <nova:project uuid="73b003c1f30e448a9725379dc78c779d">tempest-TaggedBootDevicesTest_v242-992195744</nova:project>
Nov 13 10:08:32 user nova-compute[74611]:       </nova:owner>
Nov 13 10:08:32 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:08:32 user nova-compute[74611]:       <nova:ports>
Nov 13 10:08:32 user nova-compute[74611]:         <nova:port uuid="68041c9c-ff1f-4f90-b36c-2d68ecc786ce">
Nov 13 10:08:32 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 10:08:32 user nova-compute[74611]:         </nova:port>
Nov 13 10:08:32 user nova-compute[74611]:         <nova:port uuid="5a95e799-9076-4024-809f-7de7acb57e68">
Nov 13 10:08:32 user nova-compute[74611]:           <nova:ip type="fixed" address="10.1.1.85" ipVersion="4"/>
Nov 13 10:08:32 user nova-compute[74611]:         </nova:port>
Nov 13 10:08:32 user nova-compute[74611]:         <nova:port uuid="74d60359-c0d5-442d-8b95-d97a937d5b98">
Nov 13 10:08:32 user nova-compute[74611]:           <nova:ip type="fixed" address="10.1.1.62" ipVersion="4"/>
Nov 13 10:08:32 user nova-compute[74611]:         </nova:port>
Nov 13 10:08:32 user nova-compute[74611]:         <nova:port uuid="f385fbf1-2c52-42d5-addd-f950be2dac74">
Nov 13 10:08:32 user nova-compute[74611]:           <nova:ip type="fixed" address="10.1.1.199" ipVersion="4"/>
Nov 13 10:08:32 user nova-compute[74611]:         </nova:port>
Nov 13 10:08:32 user nova-compute[74611]:         <nova:port uuid="3d1655af-51db-4dc6-8250-9e5d2aee112a">
Nov 13 10:08:32 user nova-compute[74611]:           <nova:ip type="fixed" address="10.1.1.22" ipVersion="4"/>
Nov 13 10:08:32 user nova-compute[74611]:         </nova:port>
Nov 13 10:08:32 user nova-compute[74611]:         <nova:port uuid="a79c7eee-edeb-42c7-813e-d8888ffdf514">
Nov 13 10:08:32 user nova-compute[74611]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 13 10:08:32 user nova-compute[74611]:         </nova:port>
Nov 13 10:08:32 user nova-compute[74611]:         <nova:port uuid="6c6fc688-5b31-41ae-b902-b1271c264078">
Nov 13 10:08:32 user nova-compute[74611]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 13 10:08:32 user nova-compute[74611]:         </nova:port>
Nov 13 10:08:32 user nova-compute[74611]:       </nova:ports>
Nov 13 10:08:32 user nova-compute[74611]:     </nova:instance>
Nov 13 10:08:32 user nova-compute[74611]:   </metadata>
Nov 13 10:08:32 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:08:32 user nova-compute[74611]:     <system>
Nov 13 10:08:32 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:08:32 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:08:32 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:08:32 user nova-compute[74611]:       <entry name="serial">d0853d6e-1178-4a53-a532-b45656d9e416</entry>
Nov 13 10:08:32 user nova-compute[74611]:       <entry name="uuid">d0853d6e-1178-4a53-a532-b45656d9e416</entry>
Nov 13 10:08:32 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:08:32 user nova-compute[74611]:     </system>
Nov 13 10:08:32 user nova-compute[74611]:   </sysinfo>
Nov 13 10:08:32 user nova-compute[74611]:   <os>
Nov 13 10:08:32 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:08:32 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:08:32 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:08:32 user nova-compute[74611]:   </os>
Nov 13 10:08:32 user nova-compute[74611]:   <features>
Nov 13 10:08:32 user nova-compute[74611]:     <acpi/>
Nov 13 10:08:32 user nova-compute[74611]:     <apic/>
Nov 13 10:08:32 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:08:32 user nova-compute[74611]:   </features>
Nov 13 10:08:32 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:08:32 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:08:32 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:08:32 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:08:32 user nova-compute[74611]:   </clock>
Nov 13 10:08:32 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:08:32 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:08:32 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:08:32 user nova-compute[74611]:   </cpu>
Nov 13 10:08:32 user nova-compute[74611]:   <devices>
Nov 13 10:08:32 user nova-compute[74611]:     <disk type="file" device="cdrom">
Nov 13 10:08:32 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 10:08:32 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/d0853d6e-1178-4a53-a532-b45656d9e416/disk.config"/>
Nov 13 10:08:32 user nova-compute[74611]:       <target dev="hda" bus="ide"/>
Nov 13 10:08:32 user nova-compute[74611]:     </disk>
Nov 13 10:08:32 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:08:32 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:08:32 user nova-compute[74611]:       <source dev="/dev/sdb"/>
Nov 13 10:08:32 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:08:32 user nova-compute[74611]:       <serial>74ba88b6-8564-42d7-b805-f1d7c463dadd</serial>
Nov 13 10:08:32 user nova-compute[74611]:     </disk>
Nov 13 10:08:32 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:08:32 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:08:32 user nova-compute[74611]:       <source dev="/dev/sdh"/>
Nov 13 10:08:32 user nova-compute[74611]:       <target dev="vdb" bus="virtio"/>
Nov 13 10:08:32 user nova-compute[74611]:       <serial>97ca530c-111f-427f-93e0-67eb70f4f0bc</serial>
Nov 13 10:08:32 user nova-compute[74611]:     </disk>
Nov 13 10:08:32 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:08:32 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:08:32 user nova-compute[74611]:       <source dev="/dev/sdi"/>
Nov 13 10:08:32 user nova-compute[74611]:       <target dev="vdc" bus="virtio"/>
Nov 13 10:08:32 user nova-compute[74611]:       <serial>2e1128fa-47f2-4d59-9284-47faba1f03c6</serial>
Nov 13 10:08:32 user nova-compute[74611]:     </disk>
Nov 13 10:08:32 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:08:32 user nova-compute[74611]:       <mac address="fa:16:3e:e3:d6:0e"/>
Nov 13 10:08:32 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:08:32 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:08:32 user nova-compute[74611]:       <target dev="tap68041c9c-ff"/>
Nov 13 10:08:32 user nova-compute[74611]:     </interface>
Nov 13 10:08:32 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:08:32 user nova-compute[74611]:       <mac address="fa:16:3e:91:fd:2b"/>
Nov 13 10:08:32 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:08:32 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:08:32 user nova-compute[74611]:       <target dev="tap5a95e799-90"/>
Nov 13 10:08:32 user nova-compute[74611]:     </interface>
Nov 13 10:08:32 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:08:32 user nova-compute[74611]:       <mac address="fa:16:3e:35:d1:d0"/>
Nov 13 10:08:32 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:08:32 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:08:32 user nova-compute[74611]:       <target dev="tap74d60359-c0"/>
Nov 13 10:08:32 user nova-compute[74611]:     </interface>
Nov 13 10:08:32 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:08:32 user nova-compute[74611]:       <mac address="fa:16:3e:92:70:35"/>
Nov 13 10:08:32 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:08:32 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:08:32 user nova-compute[74611]:       <target dev="tapf385fbf1-2c"/>
Nov 13 10:08:32 user nova-compute[74611]:     </interface>
Nov 13 10:08:32 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:08:32 user nova-compute[74611]:       <mac address="fa:16:3e:b6:48:d4"/>
Nov 13 10:08:32 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:08:32 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:08:32 user nova-compute[74611]:       <target dev="tap3d1655af-51"/>
Nov 13 10:08:32 user nova-compute[74611]:     </interface>
Nov 13 10:08:32 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:08:32 user nova-compute[74611]:       <mac address="fa:16:3e:e1:e9:f1"/>
Nov 13 10:08:32 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:08:32 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:08:32 user nova-compute[74611]:       <target dev="tapa79c7eee-ed"/>
Nov 13 10:08:32 user nova-compute[74611]:     </interface>
Nov 13 10:08:32 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:08:32 user nova-compute[74611]:       <mac address="fa:16:3e:47:f7:66"/>
Nov 13 10:08:32 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:08:32 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:08:32 user nova-compute[74611]:       <target dev="tap6c6fc688-5b"/>
Nov 13 10:08:32 user nova-compute[74611]:     </interface>
Nov 13 10:08:32 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:08:32 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/d0853d6e-1178-4a53-a532-b45656d9e416/console.log" append="off"/>
Nov 13 10:08:32 user nova-compute[74611]:     </serial>
Nov 13 10:08:32 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:08:32 user nova-compute[74611]:     <video>
Nov 13 10:08:32 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:08:32 user nova-compute[74611]:     </video>
Nov 13 10:08:32 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:08:32 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:08:32 user nova-compute[74611]:     </rng>
Nov 13 10:08:32 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:08:32 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:08:32 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:08:32 user nova-compute[74611]:     </memballoon>
Nov 13 10:08:32 user nova-compute[74611]:   </devices>
Nov 13 10:08:32 user nova-compute[74611]: </domain>
Nov 13 10:08:32 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "address": "fa:16:3e:e3:d6:0e", "network": {"id": "1465dfcb-80a9-4c13-8ad2-d49990f27559", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-614630284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68041c9c-ff", "ovs_interfaceid": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "address": "fa:16:3e:e3:d6:0e", "network": {"id": "1465dfcb-80a9-4c13-8ad2-d49990f27559", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-614630284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68041c9c-ff", "ovs_interfaceid": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:d6:0e,bridge_name='br-int',has_traffic_filtering=True,id=68041c9c-ff1f-4f90-b36c-2d68ecc786ce,network=Network(1465dfcb-80a9-4c13-8ad2-d49990f27559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68041c9c-ff') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG os_vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:d6:0e,bridge_name='br-int',has_traffic_filtering=True,id=68041c9c-ff1f-4f90-b36c-2d68ecc786ce,network=Network(1465dfcb-80a9-4c13-8ad2-d49990f27559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68041c9c-ff') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46979b73-5354-59e0-934b-e140c5c58470', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68041c9c-ff, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68041c9c-ff, col_values=(('qos', UUID('79cd0116-9f18-4d0a-9193-771f41c77723')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68041c9c-ff, col_values=(('external_ids', {'iface-id': '68041c9c-ff1f-4f90-b36c-2d68ecc786ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:d6:0e', 'vm-uuid': 'd0853d6e-1178-4a53-a532-b45656d9e416'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: INFO os_vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:d6:0e,bridge_name='br-int',has_traffic_filtering=True,id=68041c9c-ff1f-4f90-b36c-2d68ecc786ce,network=Network(1465dfcb-80a9-4c13-8ad2-d49990f27559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68041c9c-ff')
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a95e799-9076-4024-809f-7de7acb57e68", "address": "fa:16:3e:91:fd:2b", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a95e799-90", "ovs_interfaceid": "5a95e799-9076-4024-809f-7de7acb57e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "5a95e799-9076-4024-809f-7de7acb57e68", "address": "fa:16:3e:91:fd:2b", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a95e799-90", "ovs_interfaceid": "5a95e799-9076-4024-809f-7de7acb57e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:fd:2b,bridge_name='br-int',has_traffic_filtering=True,id=5a95e799-9076-4024-809f-7de7acb57e68,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5a95e799-90') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG os_vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:fd:2b,bridge_name='br-int',has_traffic_filtering=True,id=5a95e799-9076-4024-809f-7de7acb57e68,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5a95e799-90') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3dba5ff0-cb7e-588e-b4a9-441dbf3b1afd', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a95e799-90, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a95e799-90, col_values=(('qos', UUID('87ebc16e-bcdb-41bf-a02e-f1789afc89b4')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a95e799-90, col_values=(('external_ids', {'iface-id': '5a95e799-9076-4024-809f-7de7acb57e68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:fd:2b', 'vm-uuid': 'd0853d6e-1178-4a53-a532-b45656d9e416'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: INFO os_vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:fd:2b,bridge_name='br-int',has_traffic_filtering=True,id=5a95e799-9076-4024-809f-7de7acb57e68,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5a95e799-90')
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74d60359-c0d5-442d-8b95-d97a937d5b98", "address": "fa:16:3e:35:d1:d0", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d60359-c0", "ovs_interfaceid": "74d60359-c0d5-442d-8b95-d97a937d5b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "74d60359-c0d5-442d-8b95-d97a937d5b98", "address": "fa:16:3e:35:d1:d0", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d60359-c0", "ovs_interfaceid": "74d60359-c0d5-442d-8b95-d97a937d5b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:d1:d0,bridge_name='br-int',has_traffic_filtering=True,id=74d60359-c0d5-442d-8b95-d97a937d5b98,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74d60359-c0') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG os_vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:d1:d0,bridge_name='br-int',has_traffic_filtering=True,id=74d60359-c0d5-442d-8b95-d97a937d5b98,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74d60359-c0') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a07b573-9134-5c41-a132-c099991c63dd', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74d60359-c0, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74d60359-c0, col_values=(('qos', UUID('2d7dfcd6-7c36-462c-b065-6e0817589d20')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74d60359-c0, col_values=(('external_ids', {'iface-id': '74d60359-c0d5-442d-8b95-d97a937d5b98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:d1:d0', 'vm-uuid': 'd0853d6e-1178-4a53-a532-b45656d9e416'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: INFO os_vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:d1:d0,bridge_name='br-int',has_traffic_filtering=True,id=74d60359-c0d5-442d-8b95-d97a937d5b98,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74d60359-c0')
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f385fbf1-2c52-42d5-addd-f950be2dac74", "address": "fa:16:3e:92:70:35", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf385fbf1-2c", "ovs_interfaceid": "f385fbf1-2c52-42d5-addd-f950be2dac74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "f385fbf1-2c52-42d5-addd-f950be2dac74", "address": "fa:16:3e:92:70:35", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf385fbf1-2c", "ovs_interfaceid": "f385fbf1-2c52-42d5-addd-f950be2dac74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:35,bridge_name='br-int',has_traffic_filtering=True,id=f385fbf1-2c52-42d5-addd-f950be2dac74,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf385fbf1-2c') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG os_vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:35,bridge_name='br-int',has_traffic_filtering=True,id=f385fbf1-2c52-42d5-addd-f950be2dac74,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf385fbf1-2c') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be176b1e-04dc-5a78-8e1a-180c1d4ad292', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf385fbf1-2c, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf385fbf1-2c, col_values=(('qos', UUID('583b6471-b0f8-48b0-8c46-ee55963f144a')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf385fbf1-2c, col_values=(('external_ids', {'iface-id': 'f385fbf1-2c52-42d5-addd-f950be2dac74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:70:35', 'vm-uuid': 'd0853d6e-1178-4a53-a532-b45656d9e416'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: INFO os_vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:35,bridge_name='br-int',has_traffic_filtering=True,id=f385fbf1-2c52-42d5-addd-f950be2dac74,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf385fbf1-2c')
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "address": "fa:16:3e:b6:48:d4", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1655af-51", "ovs_interfaceid": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "address": "fa:16:3e:b6:48:d4", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1655af-51", "ovs_interfaceid": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:48:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d1655af-51db-4dc6-8250-9e5d2aee112a,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1655af-51') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG os_vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:48:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d1655af-51db-4dc6-8250-9e5d2aee112a,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1655af-51') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48f78a4c-f281-59ea-b61a-f5083ba6c2f9', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d1655af-51, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d1655af-51, col_values=(('qos', UUID('e698b2cf-6216-4ab3-8706-2600dfee43a0')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d1655af-51, col_values=(('external_ids', {'iface-id': '3d1655af-51db-4dc6-8250-9e5d2aee112a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:48:d4', 'vm-uuid': 'd0853d6e-1178-4a53-a532-b45656d9e416'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: INFO os_vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:48:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d1655af-51db-4dc6-8250-9e5d2aee112a,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1655af-51')
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "address": "fa:16:3e:e1:e9:f1", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79c7eee-ed", "ovs_interfaceid": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "address": "fa:16:3e:e1:e9:f1", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79c7eee-ed", "ovs_interfaceid": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e9:f1,bridge_name='br-int',has_traffic_filtering=True,id=a79c7eee-edeb-42c7-813e-d8888ffdf514,network=Network(4f8bd835-da02-4926-9114-ffd0f16fea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa79c7eee-ed') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG os_vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e9:f1,bridge_name='br-int',has_traffic_filtering=True,id=a79c7eee-edeb-42c7-813e-d8888ffdf514,network=Network(4f8bd835-da02-4926-9114-ffd0f16fea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa79c7eee-ed') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63da3ff3-05ec-5014-96c6-757aa8e48f11', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa79c7eee-ed, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa79c7eee-ed, col_values=(('qos', UUID('569de94a-b1c1-4b3f-90c9-cb0d116a6918')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa79c7eee-ed, col_values=(('external_ids', {'iface-id': 'a79c7eee-edeb-42c7-813e-d8888ffdf514', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:e9:f1', 'vm-uuid': 'd0853d6e-1178-4a53-a532-b45656d9e416'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: INFO os_vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e9:f1,bridge_name='br-int',has_traffic_filtering=True,id=a79c7eee-edeb-42c7-813e-d8888ffdf514,network=Network(4f8bd835-da02-4926-9114-ffd0f16fea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa79c7eee-ed')
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c6fc688-5b31-41ae-b902-b1271c264078", "address": "fa:16:3e:47:f7:66", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c6fc688-5b", "ovs_interfaceid": "6c6fc688-5b31-41ae-b902-b1271c264078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "6c6fc688-5b31-41ae-b902-b1271c264078", "address": "fa:16:3e:47:f7:66", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c6fc688-5b", "ovs_interfaceid": "6c6fc688-5b31-41ae-b902-b1271c264078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:f7:66,bridge_name='br-int',has_traffic_filtering=True,id=6c6fc688-5b31-41ae-b902-b1271c264078,network=Network(4f8bd835-da02-4926-9114-ffd0f16fea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c6fc688-5b') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG os_vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:f7:66,bridge_name='br-int',has_traffic_filtering=True,id=6c6fc688-5b31-41ae-b902-b1271c264078,network=Network(4f8bd835-da02-4926-9114-ffd0f16fea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c6fc688-5b') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e21294f0-7851-5589-b372-665fac40010d', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c6fc688-5b, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c6fc688-5b, col_values=(('qos', UUID('84de0d35-0ffe-42be-aff5-999ec985774d')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c6fc688-5b, col_values=(('external_ids', {'iface-id': '6c6fc688-5b31-41ae-b902-b1271c264078', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:f7:66', 'vm-uuid': 'd0853d6e-1178-4a53-a532-b45656d9e416'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:33 user nova-compute[74611]: INFO os_vif [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:f7:66,bridge_name='br-int',has_traffic_filtering=True,id=6c6fc688-5b31-41ae-b902-b1271c264078,network=Network(4f8bd835-da02-4926-9114-ffd0f16fea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c6fc688-5b')
Nov 13 10:08:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] No BDM found with device name hda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:08:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:08:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] No VIF found with MAC fa:16:3e:e3:d6:0e, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:08:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] No VIF found with MAC fa:16:3e:b6:48:d4, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:08:33 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Using config drive
Nov 13 10:08:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:08:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:33 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:08:33 user nova-compute[74611]: INFO nova.compute.claims [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Claim successful on node user
Nov 13 10:08:33 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Creating config drive at /opt/stack/data/nova/instances/d0853d6e-1178-4a53-a532-b45656d9e416/disk.config
Nov 13 10:08:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d0853d6e-1178-4a53-a532-b45656d9e416/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzpjus1yv {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d0853d6e-1178-4a53-a532-b45656d9e416/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzpjus1yv" returned: 0 in 0.382s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.974s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG nova.network.neutron [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:08:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:08:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG nova.policy [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0428809075cd41f0a6eb84c21e9abfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0d3282d547249997fdad18cefc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:08:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Creating image(s)
Nov 13 10:08:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "/opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "/opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "/opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.198s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.201s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk 1073741824" returned: 0 in 0.087s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG nova.network.neutron [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Successfully created port: 50d7432d-bbe3-4f65-ae8a-6cc8387ba245 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.218s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Cannot resize image /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Ensure instance console log exists: /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-d6ee3ece-6c98-463b-8117-3780f16da44b req-7712d500-b541-44db-bf4d-cd70fe6a781c service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-68041c9c-ff1f-4f90-b36c-2d68ecc786ce {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d6ee3ece-6c98-463b-8117-3780f16da44b req-7712d500-b541-44db-bf4d-cd70fe6a781c service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d6ee3ece-6c98-463b-8117-3780f16da44b req-7712d500-b541-44db-bf4d-cd70fe6a781c service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d6ee3ece-6c98-463b-8117-3780f16da44b req-7712d500-b541-44db-bf4d-cd70fe6a781c service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-d6ee3ece-6c98-463b-8117-3780f16da44b req-7712d500-b541-44db-bf4d-cd70fe6a781c service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-68041c9c-ff1f-4f90-b36c-2d68ecc786ce {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:35 user nova-compute[74611]: WARNING nova.compute.manager [req-d6ee3ece-6c98-463b-8117-3780f16da44b req-7712d500-b541-44db-bf4d-cd70fe6a781c service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-68041c9c-ff1f-4f90-b36c-2d68ecc786ce for instance with vm_state building and task_state spawning.
Nov 13 10:08:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG nova.network.neutron [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Successfully updated port: 50d7432d-bbe3-4f65-ae8a-6cc8387ba245 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "refresh_cache-d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquired lock "refresh_cache-d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG nova.network.neutron [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-d2c178dc-539b-4da8-8eda-e07f8be32659 req-e4d5cb4e-a777-44b0-9503-9b602b2a22c4 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Received event network-changed-50d7432d-bbe3-4f65-ae8a-6cc8387ba245 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-d2c178dc-539b-4da8-8eda-e07f8be32659 req-e4d5cb4e-a777-44b0-9503-9b602b2a22c4 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Refreshing instance network info cache due to event network-changed-50d7432d-bbe3-4f65-ae8a-6cc8387ba245. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d2c178dc-539b-4da8-8eda-e07f8be32659 req-e4d5cb4e-a777-44b0-9503-9b602b2a22c4 service nova] Acquiring lock "refresh_cache-d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG nova.network.neutron [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-95dd3c0e-20a8-444e-8c6a-2d5e6866b55b req-a203efd6-a36f-4ac4-8faa-7128e4d00bf3 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-5a95e799-9076-4024-809f-7de7acb57e68 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-95dd3c0e-20a8-444e-8c6a-2d5e6866b55b req-a203efd6-a36f-4ac4-8faa-7128e4d00bf3 service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-95dd3c0e-20a8-444e-8c6a-2d5e6866b55b req-a203efd6-a36f-4ac4-8faa-7128e4d00bf3 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-95dd3c0e-20a8-444e-8c6a-2d5e6866b55b req-a203efd6-a36f-4ac4-8faa-7128e4d00bf3 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-95dd3c0e-20a8-444e-8c6a-2d5e6866b55b req-a203efd6-a36f-4ac4-8faa-7128e4d00bf3 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-5a95e799-9076-4024-809f-7de7acb57e68 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:36 user nova-compute[74611]: WARNING nova.compute.manager [req-95dd3c0e-20a8-444e-8c6a-2d5e6866b55b req-a203efd6-a36f-4ac4-8faa-7128e4d00bf3 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-5a95e799-9076-4024-809f-7de7acb57e68 for instance with vm_state building and task_state spawning.
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.network.neutron [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Updating instance_info_cache with network_info: [{"id": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "address": "fa:16:3e:21:34:4e", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d7432d-bb", "ovs_interfaceid": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Releasing lock "refresh_cache-d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.compute.manager [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Instance network_info: |[{"id": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "address": "fa:16:3e:21:34:4e", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d7432d-bb", "ovs_interfaceid": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d2c178dc-539b-4da8-8eda-e07f8be32659 req-e4d5cb4e-a777-44b0-9503-9b602b2a22c4 service nova] Acquired lock "refresh_cache-d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.network.neutron [req-d2c178dc-539b-4da8-8eda-e07f8be32659 req-e4d5cb4e-a777-44b0-9503-9b602b2a22c4 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Refreshing network info cache for port 50d7432d-bbe3-4f65-ae8a-6cc8387ba245 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Start _get_guest_xml network_info=[{"id": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "address": "fa:16:3e:21:34:4e", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d7432d-bb", "ovs_interfaceid": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:08:36 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:08:36 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:08:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1888160213',display_name='tempest-AttachVolumeTestJSON-server-1888160213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1888160213',id=39,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP07Lia7GULD96z7/7DV5nHnvBOerl/zhC0aJ6VcWlyvIm4qGbKm2i4gw/It4+HQkooCdfDdCBItxzOl0jsjP3JmysLXaq7o2Nx0PWhdpPh0r4VY5ImpCTNWTJyqs/epIw==',key_name='tempest-keypair-509476253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce3f0d3282d547249997fdad18cefc9c',ramdisk_id='',reservation_id='r-86fsezns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-658018398',owner_user_name='tempest-AttachVolumeTestJSON-658018398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:08:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0428809075cd41f0a6eb84c21e9abfed',uuid=d055568e-ab74-4fb6-89bf-2dd9f13bc2b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "address": "fa:16:3e:21:34:4e", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d7432d-bb", "ovs_interfaceid": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converting VIF {"id": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "address": "fa:16:3e:21:34:4e", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d7432d-bb", "ovs_interfaceid": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:34:4e,bridge_name='br-int',has_traffic_filtering=True,id=50d7432d-bbe3-4f65-ae8a-6cc8387ba245,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d7432d-bb') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.objects.instance [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'pci_devices' on Instance uuid d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:08:36 user nova-compute[74611]:   <uuid>d055568e-ab74-4fb6-89bf-2dd9f13bc2b9</uuid>
Nov 13 10:08:36 user nova-compute[74611]:   <name>instance-00000027</name>
Nov 13 10:08:36 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:08:36 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:08:36 user nova-compute[74611]:   <metadata>
Nov 13 10:08:36 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:08:36 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:08:36 user nova-compute[74611]:       <nova:name>tempest-AttachVolumeTestJSON-server-1888160213</nova:name>
Nov 13 10:08:36 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:08:36</nova:creationTime>
Nov 13 10:08:36 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:08:36 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:08:36 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:08:36 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:08:36 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:08:36 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:08:36 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:08:36 user nova-compute[74611]:       <nova:owner>
Nov 13 10:08:36 user nova-compute[74611]:         <nova:user uuid="0428809075cd41f0a6eb84c21e9abfed">tempest-AttachVolumeTestJSON-658018398-project-member</nova:user>
Nov 13 10:08:36 user nova-compute[74611]:         <nova:project uuid="ce3f0d3282d547249997fdad18cefc9c">tempest-AttachVolumeTestJSON-658018398</nova:project>
Nov 13 10:08:36 user nova-compute[74611]:       </nova:owner>
Nov 13 10:08:36 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:08:36 user nova-compute[74611]:       <nova:ports>
Nov 13 10:08:36 user nova-compute[74611]:         <nova:port uuid="50d7432d-bbe3-4f65-ae8a-6cc8387ba245">
Nov 13 10:08:36 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 10:08:36 user nova-compute[74611]:         </nova:port>
Nov 13 10:08:36 user nova-compute[74611]:       </nova:ports>
Nov 13 10:08:36 user nova-compute[74611]:     </nova:instance>
Nov 13 10:08:36 user nova-compute[74611]:   </metadata>
Nov 13 10:08:36 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:08:36 user nova-compute[74611]:     <system>
Nov 13 10:08:36 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:08:36 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:08:36 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:08:36 user nova-compute[74611]:       <entry name="serial">d055568e-ab74-4fb6-89bf-2dd9f13bc2b9</entry>
Nov 13 10:08:36 user nova-compute[74611]:       <entry name="uuid">d055568e-ab74-4fb6-89bf-2dd9f13bc2b9</entry>
Nov 13 10:08:36 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:08:36 user nova-compute[74611]:     </system>
Nov 13 10:08:36 user nova-compute[74611]:   </sysinfo>
Nov 13 10:08:36 user nova-compute[74611]:   <os>
Nov 13 10:08:36 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:08:36 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:08:36 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:08:36 user nova-compute[74611]:   </os>
Nov 13 10:08:36 user nova-compute[74611]:   <features>
Nov 13 10:08:36 user nova-compute[74611]:     <acpi/>
Nov 13 10:08:36 user nova-compute[74611]:     <apic/>
Nov 13 10:08:36 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:08:36 user nova-compute[74611]:   </features>
Nov 13 10:08:36 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:08:36 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:08:36 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:08:36 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:08:36 user nova-compute[74611]:   </clock>
Nov 13 10:08:36 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:08:36 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:08:36 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:08:36 user nova-compute[74611]:   </cpu>
Nov 13 10:08:36 user nova-compute[74611]:   <devices>
Nov 13 10:08:36 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:08:36 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:08:36 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk"/>
Nov 13 10:08:36 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:08:36 user nova-compute[74611]:     </disk>
Nov 13 10:08:36 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:08:36 user nova-compute[74611]:       <mac address="fa:16:3e:21:34:4e"/>
Nov 13 10:08:36 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:08:36 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:08:36 user nova-compute[74611]:       <target dev="tap50d7432d-bb"/>
Nov 13 10:08:36 user nova-compute[74611]:     </interface>
Nov 13 10:08:36 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:08:36 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/console.log" append="off"/>
Nov 13 10:08:36 user nova-compute[74611]:     </serial>
Nov 13 10:08:36 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:08:36 user nova-compute[74611]:     <video>
Nov 13 10:08:36 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:08:36 user nova-compute[74611]:     </video>
Nov 13 10:08:36 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:08:36 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:08:36 user nova-compute[74611]:     </rng>
Nov 13 10:08:36 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:08:36 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:08:36 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:08:36 user nova-compute[74611]:     </memballoon>
Nov 13 10:08:36 user nova-compute[74611]:   </devices>
Nov 13 10:08:36 user nova-compute[74611]: </domain>
Nov 13 10:08:36 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:08:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1888160213',display_name='tempest-AttachVolumeTestJSON-server-1888160213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1888160213',id=39,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP07Lia7GULD96z7/7DV5nHnvBOerl/zhC0aJ6VcWlyvIm4qGbKm2i4gw/It4+HQkooCdfDdCBItxzOl0jsjP3JmysLXaq7o2Nx0PWhdpPh0r4VY5ImpCTNWTJyqs/epIw==',key_name='tempest-keypair-509476253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce3f0d3282d547249997fdad18cefc9c',ramdisk_id='',reservation_id='r-86fsezns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-658018398',owner_user_name='tempest-AttachVolumeTestJSON-658018398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:08:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0428809075cd41f0a6eb84c21e9abfed',uuid=d055568e-ab74-4fb6-89bf-2dd9f13bc2b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "address": "fa:16:3e:21:34:4e", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d7432d-bb", "ovs_interfaceid": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converting VIF {"id": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "address": "fa:16:3e:21:34:4e", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d7432d-bb", "ovs_interfaceid": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:34:4e,bridge_name='br-int',has_traffic_filtering=True,id=50d7432d-bbe3-4f65-ae8a-6cc8387ba245,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d7432d-bb') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG os_vif [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:34:4e,bridge_name='br-int',has_traffic_filtering=True,id=50d7432d-bbe3-4f65-ae8a-6cc8387ba245,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d7432d-bb') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81567c20-8243-5793-8286-b5bc443dbdc3', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50d7432d-bb, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50d7432d-bb, col_values=(('qos', UUID('95991c15-601b-4c15-9c59-d93f9f97cae3')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50d7432d-bb, col_values=(('external_ids', {'iface-id': '50d7432d-bbe3-4f65-ae8a-6cc8387ba245', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:34:4e', 'vm-uuid': 'd055568e-ab74-4fb6-89bf-2dd9f13bc2b9'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: INFO os_vif [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:34:4e,bridge_name='br-int',has_traffic_filtering=True,id=50d7432d-bbe3-4f65-ae8a-6cc8387ba245,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d7432d-bb')
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] No VIF found with MAC fa:16:3e:21:34:4e, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.network.neutron [req-d2c178dc-539b-4da8-8eda-e07f8be32659 req-e4d5cb4e-a777-44b0-9503-9b602b2a22c4 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Updated VIF entry in instance network info cache for port 50d7432d-bbe3-4f65-ae8a-6cc8387ba245. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.network.neutron [req-d2c178dc-539b-4da8-8eda-e07f8be32659 req-e4d5cb4e-a777-44b0-9503-9b602b2a22c4 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Updating instance_info_cache with network_info: [{"id": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "address": "fa:16:3e:21:34:4e", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d7432d-bb", "ovs_interfaceid": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d2c178dc-539b-4da8-8eda-e07f8be32659 req-e4d5cb4e-a777-44b0-9503-9b602b2a22c4 service nova] Releasing lock "refresh_cache-d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-68041c9c-ff1f-4f90-b36c-2d68ecc786ce {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-68041c9c-ff1f-4f90-b36c-2d68ecc786ce {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:37 user nova-compute[74611]: WARNING nova.compute.manager [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-68041c9c-ff1f-4f90-b36c-2d68ecc786ce for instance with vm_state building and task_state spawning.
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-a79c7eee-edeb-42c7-813e-d8888ffdf514 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-a79c7eee-edeb-42c7-813e-d8888ffdf514 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:37 user nova-compute[74611]: WARNING nova.compute.manager [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-a79c7eee-edeb-42c7-813e-d8888ffdf514 for instance with vm_state building and task_state spawning.
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-a79c7eee-edeb-42c7-813e-d8888ffdf514 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-a79c7eee-edeb-42c7-813e-d8888ffdf514 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:37 user nova-compute[74611]: WARNING nova.compute.manager [req-b7f1bbba-7df8-4739-aaf5-823540160292 req-59fb87c3-8b31-4b6e-a795-d1122d324c85 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-a79c7eee-edeb-42c7-813e-d8888ffdf514 for instance with vm_state building and task_state spawning.
Nov 13 10:08:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-74d60359-c0d5-442d-8b95-d97a937d5b98 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-74d60359-c0d5-442d-8b95-d97a937d5b98 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:37 user nova-compute[74611]: WARNING nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-74d60359-c0d5-442d-8b95-d97a937d5b98 for instance with vm_state building and task_state spawning.
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-74d60359-c0d5-442d-8b95-d97a937d5b98 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-74d60359-c0d5-442d-8b95-d97a937d5b98 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:37 user nova-compute[74611]: WARNING nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-74d60359-c0d5-442d-8b95-d97a937d5b98 for instance with vm_state building and task_state spawning.
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-f385fbf1-2c52-42d5-addd-f950be2dac74 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-f385fbf1-2c52-42d5-addd-f950be2dac74 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:37 user nova-compute[74611]: WARNING nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-f385fbf1-2c52-42d5-addd-f950be2dac74 for instance with vm_state building and task_state spawning.
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-f385fbf1-2c52-42d5-addd-f950be2dac74 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-f385fbf1-2c52-42d5-addd-f950be2dac74 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:37 user nova-compute[74611]: WARNING nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-f385fbf1-2c52-42d5-addd-f950be2dac74 for instance with vm_state building and task_state spawning.
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-3d1655af-51db-4dc6-8250-9e5d2aee112a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-3d1655af-51db-4dc6-8250-9e5d2aee112a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:37 user nova-compute[74611]: WARNING nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-3d1655af-51db-4dc6-8250-9e5d2aee112a for instance with vm_state building and task_state spawning.
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-3d1655af-51db-4dc6-8250-9e5d2aee112a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-3d1655af-51db-4dc6-8250-9e5d2aee112a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:37 user nova-compute[74611]: WARNING nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-3d1655af-51db-4dc6-8250-9e5d2aee112a for instance with vm_state building and task_state spawning.
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-6c6fc688-5b31-41ae-b902-b1271c264078 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-6c6fc688-5b31-41ae-b902-b1271c264078 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:37 user nova-compute[74611]: WARNING nova.compute.manager [req-18bd187e-a0af-4db0-a536-a7ea0ffc6bef req-79cf5a64-6de7-4622-9902-209822217fab service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-6c6fc688-5b31-41ae-b902-b1271c264078 for instance with vm_state building and task_state spawning.
Nov 13 10:08:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-e6424141-94b9-4f32-b08d-7d84d2d441a0 req-9aedc2dc-69c0-4398-aae4-f42c25586d10 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-5a95e799-9076-4024-809f-7de7acb57e68 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e6424141-94b9-4f32-b08d-7d84d2d441a0 req-9aedc2dc-69c0-4398-aae4-f42c25586d10 service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e6424141-94b9-4f32-b08d-7d84d2d441a0 req-9aedc2dc-69c0-4398-aae4-f42c25586d10 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e6424141-94b9-4f32-b08d-7d84d2d441a0 req-9aedc2dc-69c0-4398-aae4-f42c25586d10 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-e6424141-94b9-4f32-b08d-7d84d2d441a0 req-9aedc2dc-69c0-4398-aae4-f42c25586d10 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-5a95e799-9076-4024-809f-7de7acb57e68 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:38 user nova-compute[74611]: WARNING nova.compute.manager [req-e6424141-94b9-4f32-b08d-7d84d2d441a0 req-9aedc2dc-69c0-4398-aae4-f42c25586d10 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-5a95e799-9076-4024-809f-7de7acb57e68 for instance with vm_state building and task_state spawning.
Nov 13 10:08:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-5e88c630-acfc-4f87-b55d-3f7201d23bc3 req-ed756317-76a6-4958-8b83-6ac70965125a service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-6c6fc688-5b31-41ae-b902-b1271c264078 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5e88c630-acfc-4f87-b55d-3f7201d23bc3 req-ed756317-76a6-4958-8b83-6ac70965125a service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5e88c630-acfc-4f87-b55d-3f7201d23bc3 req-ed756317-76a6-4958-8b83-6ac70965125a service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5e88c630-acfc-4f87-b55d-3f7201d23bc3 req-ed756317-76a6-4958-8b83-6ac70965125a service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-5e88c630-acfc-4f87-b55d-3f7201d23bc3 req-ed756317-76a6-4958-8b83-6ac70965125a service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-6c6fc688-5b31-41ae-b902-b1271c264078 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:40 user nova-compute[74611]: WARNING nova.compute.manager [req-5e88c630-acfc-4f87-b55d-3f7201d23bc3 req-ed756317-76a6-4958-8b83-6ac70965125a service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-6c6fc688-5b31-41ae-b902-b1271c264078 for instance with vm_state building and task_state spawning.
Nov 13 10:08:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-74440d68-e42a-4327-9634-e8df64a2ebcd req-7caa9ccb-a8f0-4adc-a33b-7b1d980b92b2 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Received event network-vif-plugged-50d7432d-bbe3-4f65-ae8a-6cc8387ba245 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-74440d68-e42a-4327-9634-e8df64a2ebcd req-7caa9ccb-a8f0-4adc-a33b-7b1d980b92b2 service nova] Acquiring lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-74440d68-e42a-4327-9634-e8df64a2ebcd req-7caa9ccb-a8f0-4adc-a33b-7b1d980b92b2 service nova] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-74440d68-e42a-4327-9634-e8df64a2ebcd req-7caa9ccb-a8f0-4adc-a33b-7b1d980b92b2 service nova] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-74440d68-e42a-4327-9634-e8df64a2ebcd req-7caa9ccb-a8f0-4adc-a33b-7b1d980b92b2 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] No waiting events found dispatching network-vif-plugged-50d7432d-bbe3-4f65-ae8a-6cc8387ba245 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:40 user nova-compute[74611]: WARNING nova.compute.manager [req-74440d68-e42a-4327-9634-e8df64a2ebcd req-7caa9ccb-a8f0-4adc-a33b-7b1d980b92b2 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Received unexpected event network-vif-plugged-50d7432d-bbe3-4f65-ae8a-6cc8387ba245 for instance with vm_state building and task_state spawning.
Nov 13 10:08:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-74440d68-e42a-4327-9634-e8df64a2ebcd req-7caa9ccb-a8f0-4adc-a33b-7b1d980b92b2 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Received event network-vif-plugged-50d7432d-bbe3-4f65-ae8a-6cc8387ba245 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-74440d68-e42a-4327-9634-e8df64a2ebcd req-7caa9ccb-a8f0-4adc-a33b-7b1d980b92b2 service nova] Acquiring lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-74440d68-e42a-4327-9634-e8df64a2ebcd req-7caa9ccb-a8f0-4adc-a33b-7b1d980b92b2 service nova] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-74440d68-e42a-4327-9634-e8df64a2ebcd req-7caa9ccb-a8f0-4adc-a33b-7b1d980b92b2 service nova] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-74440d68-e42a-4327-9634-e8df64a2ebcd req-7caa9ccb-a8f0-4adc-a33b-7b1d980b92b2 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] No waiting events found dispatching network-vif-plugged-50d7432d-bbe3-4f65-ae8a-6cc8387ba245 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:40 user nova-compute[74611]: WARNING nova.compute.manager [req-74440d68-e42a-4327-9634-e8df64a2ebcd req-7caa9ccb-a8f0-4adc-a33b-7b1d980b92b2 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Received unexpected event network-vif-plugged-50d7432d-bbe3-4f65-ae8a-6cc8387ba245 for instance with vm_state building and task_state spawning.
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:08:41 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Instance spawned successfully.
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.compute.manager [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:08:41 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Instance spawned successfully.
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:08:41 user nova-compute[74611]: INFO nova.compute.manager [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Took 6.98 seconds to spawn the instance on the hypervisor.
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.compute.manager [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:08:41 user nova-compute[74611]: INFO nova.compute.manager [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Took 13.38 seconds to spawn the instance on the hypervisor.
Nov 13 10:08:41 user nova-compute[74611]: DEBUG nova.compute.manager [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:08:41 user nova-compute[74611]: INFO nova.compute.manager [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Took 8.34 seconds to build instance.
Nov 13 10:08:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-95e38185-1edd-4331-9f2c-c146bebe84a7 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.437s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:41 user nova-compute[74611]: INFO nova.compute.manager [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Took 39.17 seconds to build instance.
Nov 13 10:08:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4a442a6f-0c1d-420a-9991-6aedf21a471f tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "d0853d6e-1178-4a53-a532-b45656d9e416" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.292s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:42 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:08:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:08:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:08:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:08:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:08:42 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:08:42 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Updating instance_info_cache with network_info: [{"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:43 user nova-compute[74611]: INFO nova.compute.manager [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Terminating instance
Nov 13 10:08:43 user nova-compute[74611]: DEBUG nova.compute.manager [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-ab622bae-2594-46a4-891d-e8098632e53d req-88e40c3a-6025-4283-9548-a9056471c4b4 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-vif-unplugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ab622bae-2594-46a4-891d-e8098632e53d req-88e40c3a-6025-4283-9548-a9056471c4b4 service nova] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ab622bae-2594-46a4-891d-e8098632e53d req-88e40c3a-6025-4283-9548-a9056471c4b4 service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ab622bae-2594-46a4-891d-e8098632e53d req-88e40c3a-6025-4283-9548-a9056471c4b4 service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-ab622bae-2594-46a4-891d-e8098632e53d req-88e40c3a-6025-4283-9548-a9056471c4b4 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] No waiting events found dispatching network-vif-unplugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-ab622bae-2594-46a4-891d-e8098632e53d req-88e40c3a-6025-4283-9548-a9056471c4b4 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-vif-unplugged-ffb1eb13-f028-447f-a01d-45bae2d17edd for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:08:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:44 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Instance destroyed successfully.
Nov 13 10:08:44 user nova-compute[74611]: DEBUG nova.objects.instance [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'resources' on Instance uuid 4fa9e23b-30f2-41ae-83ed-86145389d474 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:08:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-444308231',display_name='tempest-ServerRescueNegativeTestJSON-server-444308231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-444308231',id=28,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIRCQ9tYBQJ2Euvs7EpBOn3hJTaw2Vrx9tlGYc3FTElAI39JHbVLOxgQPucNZb3Ubif7cKCIZtlfjaxGMqTy7zAtScYXSjAUwAvWJc8/a4aSJoP6GFgfWY4Zy4/89qcIA==',key_name='tempest-keypair-1249039539',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae9ab18bb67e4db19e6c3366771ad218',ramdisk_id='',reservation_id='r-3wrgft7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-961432289',owner_user_name='tempest-ServerRescueNegativeTestJSON-961432289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863471360be04ab5acb07ef3e99007c4',uuid=4fa9e23b-30f2-41ae-83ed-86145389d474,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:08:44 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converting VIF {"id": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "address": "fa:16:3e:39:0a:26", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb1eb13-f0", "ovs_interfaceid": "ffb1eb13-f028-447f-a01d-45bae2d17edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:08:44 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:0a:26,bridge_name='br-int',has_traffic_filtering=True,id=ffb1eb13-f028-447f-a01d-45bae2d17edd,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb1eb13-f0') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:08:44 user nova-compute[74611]: DEBUG os_vif [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:0a:26,bridge_name='br-int',has_traffic_filtering=True,id=ffb1eb13-f028-447f-a01d-45bae2d17edd,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb1eb13-f0') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:08:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffb1eb13-f0, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c977beb7-0a8c-44c4-b6f7-ff14945dabd0) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:08:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:08:44 user nova-compute[74611]: INFO os_vif [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:0a:26,bridge_name='br-int',has_traffic_filtering=True,id=ffb1eb13-f028-447f-a01d-45bae2d17edd,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb1eb13-f0')
Nov 13 10:08:44 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Deleting instance files /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474_del
Nov 13 10:08:44 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Deletion of /opt/stack/data/nova/instances/4fa9e23b-30f2-41ae-83ed-86145389d474_del complete
Nov 13 10:08:44 user nova-compute[74611]: INFO nova.compute.manager [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 13 10:08:44 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:08:44 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:08:44 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:08:45 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:08:45 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Took 1.30 seconds to deallocate network for instance.
Nov 13 10:08:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-22437e37-ac39-4b8f-b5bd-b593d937fe86 req-039b7860-4e0e-4f70-928f-cab2bc260849 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-22437e37-ac39-4b8f-b5bd-b593d937fe86 req-039b7860-4e0e-4f70-928f-cab2bc260849 service nova] Acquiring lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-22437e37-ac39-4b8f-b5bd-b593d937fe86 req-039b7860-4e0e-4f70-928f-cab2bc260849 service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-22437e37-ac39-4b8f-b5bd-b593d937fe86 req-039b7860-4e0e-4f70-928f-cab2bc260849 service nova] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-22437e37-ac39-4b8f-b5bd-b593d937fe86 req-039b7860-4e0e-4f70-928f-cab2bc260849 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] No waiting events found dispatching network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:45 user nova-compute[74611]: WARNING nova.compute.manager [req-22437e37-ac39-4b8f-b5bd-b593d937fe86 req-039b7860-4e0e-4f70-928f-cab2bc260849 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received unexpected event network-vif-plugged-ffb1eb13-f028-447f-a01d-45bae2d17edd for instance with vm_state deleted and task_state None.
Nov 13 10:08:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-22437e37-ac39-4b8f-b5bd-b593d937fe86 req-039b7860-4e0e-4f70-928f-cab2bc260849 service nova] [instance: 4fa9e23b-30f2-41ae-83ed-86145389d474] Received event network-vif-deleted-ffb1eb13-f028-447f-a01d-45bae2d17edd {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:46 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:08:46 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:08:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.621s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:46 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Deleted allocations for instance 4fa9e23b-30f2-41ae-83ed-86145389d474
Nov 13 10:08:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625bd8db-1e81-4102-91b5-0b8951e791a0 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "4fa9e23b-30f2-41ae-83ed-86145389d474" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.199s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:47 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:08:48 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:08:48 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:08:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:08:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:49 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:08:49 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:08:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:08:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:55 user nova-compute[74611]: INFO nova.compute.manager [None req-8aaae46f-a43a-43ab-a129-c78e31582524 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Unrescuing
Nov 13 10:08:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8aaae46f-a43a-43ab-a129-c78e31582524 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "refresh_cache-f059d809-84b0-40c4-be84-bc89a9dc182e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:08:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8aaae46f-a43a-43ab-a129-c78e31582524 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquired lock "refresh_cache-f059d809-84b0-40c4-be84-bc89a9dc182e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:08:55 user nova-compute[74611]: DEBUG nova.network.neutron [None req-8aaae46f-a43a-43ab-a129-c78e31582524 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:08:55 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:08:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:55 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:08:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:55 user nova-compute[74611]: DEBUG nova.network.neutron [None req-8aaae46f-a43a-43ab-a129-c78e31582524 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Updating instance_info_cache with network_info: [{"id": "0a10fea9-0757-4257-b637-952cffdf0114", "address": "fa:16:3e:21:cf:80", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a10fea9-07", "ovs_interfaceid": "0a10fea9-0757-4257-b637-952cffdf0114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:08:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8aaae46f-a43a-43ab-a129-c78e31582524 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Releasing lock "refresh_cache-f059d809-84b0-40c4-be84-bc89a9dc182e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:08:55 user nova-compute[74611]: DEBUG nova.objects.instance [None req-8aaae46f-a43a-43ab-a129-c78e31582524 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'flavor' on Instance uuid f059d809-84b0-40c4-be84-bc89a9dc182e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:08:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:08:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:08:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:56 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Instance destroyed successfully.
Nov 13 10:08:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-c45f6167-07e1-4ac4-8838-8ece2fccf33c req-8147579f-ae7b-4b0e-9291-312a9311ca8a service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received event network-vif-unplugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c45f6167-07e1-4ac4-8838-8ece2fccf33c req-8147579f-ae7b-4b0e-9291-312a9311ca8a service nova] Acquiring lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c45f6167-07e1-4ac4-8838-8ece2fccf33c req-8147579f-ae7b-4b0e-9291-312a9311ca8a service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c45f6167-07e1-4ac4-8838-8ece2fccf33c req-8147579f-ae7b-4b0e-9291-312a9311ca8a service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-c45f6167-07e1-4ac4-8838-8ece2fccf33c req-8147579f-ae7b-4b0e-9291-312a9311ca8a service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] No waiting events found dispatching network-vif-unplugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:56 user nova-compute[74611]: WARNING nova.compute.manager [req-c45f6167-07e1-4ac4-8838-8ece2fccf33c req-8147579f-ae7b-4b0e-9291-312a9311ca8a service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received unexpected event network-vif-unplugged-0a10fea9-0757-4257-b637-952cffdf0114 for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:08:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:08:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:08:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:08:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:58 user nova-compute[74611]: DEBUG nova.compute.manager [req-eeeec677-7df5-4f61-ab56-ad3aee2402aa req-2e81809a-dbba-4c14-b7f7-1499ab90d500 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:08:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-eeeec677-7df5-4f61-ab56-ad3aee2402aa req-2e81809a-dbba-4c14-b7f7-1499ab90d500 service nova] Acquiring lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:08:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-eeeec677-7df5-4f61-ab56-ad3aee2402aa req-2e81809a-dbba-4c14-b7f7-1499ab90d500 service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:08:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-eeeec677-7df5-4f61-ab56-ad3aee2402aa req-2e81809a-dbba-4c14-b7f7-1499ab90d500 service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:08:58 user nova-compute[74611]: DEBUG nova.compute.manager [req-eeeec677-7df5-4f61-ab56-ad3aee2402aa req-2e81809a-dbba-4c14-b7f7-1499ab90d500 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] No waiting events found dispatching network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:08:58 user nova-compute[74611]: WARNING nova.compute.manager [req-eeeec677-7df5-4f61-ab56-ad3aee2402aa req-2e81809a-dbba-4c14-b7f7-1499ab90d500 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received unexpected event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:08:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:08:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:08:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:08:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:08:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG nova.compute.manager [None req-8aaae46f-a43a-43ab-a129-c78e31582524 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:09:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:09:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:09:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=7480MB free_disk=25.149547576904297GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 85cb3adb-b2b3-49ec-92ab-c2b7a028241a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f059d809-84b0-40c4-be84-bc89a9dc182e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance e9ed65b3-b8fc-4320-9625-e5028b6e340d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance d0853d6e-1178-4a53-a532-b45656d9e416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:09:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:09:01 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:09:01 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:09:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:09:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.774s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:02 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:09:03 user nova-compute[74611]: DEBUG nova.compute.manager [req-ea9556e1-7711-4b95-a2d4-add787f0f469 req-d2529d22-b6e2-4ada-b631-c5ed8642d86b service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ea9556e1-7711-4b95-a2d4-add787f0f469 req-d2529d22-b6e2-4ada-b631-c5ed8642d86b service nova] Acquiring lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ea9556e1-7711-4b95-a2d4-add787f0f469 req-d2529d22-b6e2-4ada-b631-c5ed8642d86b service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ea9556e1-7711-4b95-a2d4-add787f0f469 req-d2529d22-b6e2-4ada-b631-c5ed8642d86b service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:03 user nova-compute[74611]: DEBUG nova.compute.manager [req-ea9556e1-7711-4b95-a2d4-add787f0f469 req-d2529d22-b6e2-4ada-b631-c5ed8642d86b service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] No waiting events found dispatching network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:03 user nova-compute[74611]: WARNING nova.compute.manager [req-ea9556e1-7711-4b95-a2d4-add787f0f469 req-d2529d22-b6e2-4ada-b631-c5ed8642d86b service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received unexpected event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 for instance with vm_state active and task_state None.
Nov 13 10:09:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:03 user nova-compute[74611]: DEBUG nova.compute.manager [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:09:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:03 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:09:03 user nova-compute[74611]: INFO nova.compute.claims [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Claim successful on node user
Nov 13 10:09:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:04 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:09:04 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:09:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:04 user nova-compute[74611]: DEBUG nova.compute.manager [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:09:04 user nova-compute[74611]: DEBUG nova.compute.manager [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:09:04 user nova-compute[74611]: DEBUG nova.network.neutron [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:09:04 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:09:04 user nova-compute[74611]: DEBUG nova.compute.manager [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:09:04 user nova-compute[74611]: DEBUG nova.policy [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b55061d274ba4b0ea3c0a695649b96a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282fac4cc8704e0f985ab149c35aaf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:09:04 user nova-compute[74611]: DEBUG nova.compute.manager [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:09:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:09:04 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Creating image(s)
Nov 13 10:09:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "/opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "/opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.200s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.225s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk 1073741824" returned: 0 in 0.085s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-5fcd36fa-62c9-471a-998f-c0df1489116d req-9757727f-35d0-4c27-aa60-8eb2dafcc76f service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5fcd36fa-62c9-471a-998f-c0df1489116d req-9757727f-35d0-4c27-aa60-8eb2dafcc76f service nova] Acquiring lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5fcd36fa-62c9-471a-998f-c0df1489116d req-9757727f-35d0-4c27-aa60-8eb2dafcc76f service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5fcd36fa-62c9-471a-998f-c0df1489116d req-9757727f-35d0-4c27-aa60-8eb2dafcc76f service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-5fcd36fa-62c9-471a-998f-c0df1489116d req-9757727f-35d0-4c27-aa60-8eb2dafcc76f service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] No waiting events found dispatching network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:05 user nova-compute[74611]: WARNING nova.compute.manager [req-5fcd36fa-62c9-471a-998f-c0df1489116d req-9757727f-35d0-4c27-aa60-8eb2dafcc76f service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received unexpected event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 for instance with vm_state active and task_state None.
Nov 13 10:09:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.227s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG nova.network.neutron [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Successfully created port: 9fa1d68a-42d8-4e69-9863-ff60ec956664 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Cannot resize image /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Ensure instance console log exists: /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.network.neutron [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Successfully updated port: 9fa1d68a-42d8-4e69-9863-ff60ec956664 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "refresh_cache-ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquired lock "refresh_cache-ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.network.neutron [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.network.neutron [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.network.neutron [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Updating instance_info_cache with network_info: [{"id": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "address": "fa:16:3e:8c:f7:c5", "network": {"id": "a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1029865477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "282fac4cc8704e0f985ab149c35aaf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa1d68a-42", "ovs_interfaceid": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Releasing lock "refresh_cache-ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.compute.manager [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Instance network_info: |[{"id": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "address": "fa:16:3e:8c:f7:c5", "network": {"id": "a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1029865477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "282fac4cc8704e0f985ab149c35aaf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa1d68a-42", "ovs_interfaceid": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Start _get_guest_xml network_info=[{"id": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "address": "fa:16:3e:8c:f7:c5", "network": {"id": "a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1029865477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "282fac4cc8704e0f985ab149c35aaf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa1d68a-42", "ovs_interfaceid": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:09:06 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:09:06 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-465934460',display_name='tempest-SnapshotDataIntegrityTests-server-465934460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-465934460',id=40,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ95XQ5kHLmMjYnxdwVfR2w/1LdLhQp3xlENuDJOT+yNPrm9alErZe8HSaDMQQGvloEODd7olKYbiYb0bB36WOVmeqp/cB3At1Y38HnhXJFFLuHLEN9kzzQacmcI7w8dkA==',key_name='tempest-keypair-865768467',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='282fac4cc8704e0f985ab149c35aaf1c',ramdisk_id='',reservation_id='r-ueg5xeoy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1264141589',owner_user_name='tempest-SnapshotDataIntegrityTests-1264141589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b55061d274ba4b0ea3c0a695649b96a6',uuid=ddbea46e-4eaf-4797-a1fb-6e5eeef170b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "address": "fa:16:3e:8c:f7:c5", "network": {"id": "a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1029865477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "282fac4cc8704e0f985ab149c35aaf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa1d68a-42", "ovs_interfaceid": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Converting VIF {"id": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "address": "fa:16:3e:8c:f7:c5", "network": {"id": "a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1029865477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "282fac4cc8704e0f985ab149c35aaf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa1d68a-42", "ovs_interfaceid": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=9fa1d68a-42d8-4e69-9863-ff60ec956664,network=Network(a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa1d68a-42') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.objects.instance [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lazy-loading 'pci_devices' on Instance uuid ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:09:06 user nova-compute[74611]:   <uuid>ddbea46e-4eaf-4797-a1fb-6e5eeef170b2</uuid>
Nov 13 10:09:06 user nova-compute[74611]:   <name>instance-00000028</name>
Nov 13 10:09:06 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:09:06 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:09:06 user nova-compute[74611]:   <metadata>
Nov 13 10:09:06 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:09:06 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:09:06 user nova-compute[74611]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-465934460</nova:name>
Nov 13 10:09:06 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:09:06</nova:creationTime>
Nov 13 10:09:06 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:09:06 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:09:06 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:09:06 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:09:06 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:09:06 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:09:06 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:09:06 user nova-compute[74611]:       <nova:owner>
Nov 13 10:09:06 user nova-compute[74611]:         <nova:user uuid="b55061d274ba4b0ea3c0a695649b96a6">tempest-SnapshotDataIntegrityTests-1264141589-project-member</nova:user>
Nov 13 10:09:06 user nova-compute[74611]:         <nova:project uuid="282fac4cc8704e0f985ab149c35aaf1c">tempest-SnapshotDataIntegrityTests-1264141589</nova:project>
Nov 13 10:09:06 user nova-compute[74611]:       </nova:owner>
Nov 13 10:09:06 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:09:06 user nova-compute[74611]:       <nova:ports>
Nov 13 10:09:06 user nova-compute[74611]:         <nova:port uuid="9fa1d68a-42d8-4e69-9863-ff60ec956664">
Nov 13 10:09:06 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 10:09:06 user nova-compute[74611]:         </nova:port>
Nov 13 10:09:06 user nova-compute[74611]:       </nova:ports>
Nov 13 10:09:06 user nova-compute[74611]:     </nova:instance>
Nov 13 10:09:06 user nova-compute[74611]:   </metadata>
Nov 13 10:09:06 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:09:06 user nova-compute[74611]:     <system>
Nov 13 10:09:06 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:09:06 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:09:06 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:09:06 user nova-compute[74611]:       <entry name="serial">ddbea46e-4eaf-4797-a1fb-6e5eeef170b2</entry>
Nov 13 10:09:06 user nova-compute[74611]:       <entry name="uuid">ddbea46e-4eaf-4797-a1fb-6e5eeef170b2</entry>
Nov 13 10:09:06 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:09:06 user nova-compute[74611]:     </system>
Nov 13 10:09:06 user nova-compute[74611]:   </sysinfo>
Nov 13 10:09:06 user nova-compute[74611]:   <os>
Nov 13 10:09:06 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:09:06 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:09:06 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:09:06 user nova-compute[74611]:   </os>
Nov 13 10:09:06 user nova-compute[74611]:   <features>
Nov 13 10:09:06 user nova-compute[74611]:     <acpi/>
Nov 13 10:09:06 user nova-compute[74611]:     <apic/>
Nov 13 10:09:06 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:09:06 user nova-compute[74611]:   </features>
Nov 13 10:09:06 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:09:06 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:09:06 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:09:06 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:09:06 user nova-compute[74611]:   </clock>
Nov 13 10:09:06 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:09:06 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:09:06 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:09:06 user nova-compute[74611]:   </cpu>
Nov 13 10:09:06 user nova-compute[74611]:   <devices>
Nov 13 10:09:06 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:09:06 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:09:06 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk"/>
Nov 13 10:09:06 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:09:06 user nova-compute[74611]:     </disk>
Nov 13 10:09:06 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:09:06 user nova-compute[74611]:       <mac address="fa:16:3e:8c:f7:c5"/>
Nov 13 10:09:06 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:09:06 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:09:06 user nova-compute[74611]:       <target dev="tap9fa1d68a-42"/>
Nov 13 10:09:06 user nova-compute[74611]:     </interface>
Nov 13 10:09:06 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:09:06 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/console.log" append="off"/>
Nov 13 10:09:06 user nova-compute[74611]:     </serial>
Nov 13 10:09:06 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:09:06 user nova-compute[74611]:     <video>
Nov 13 10:09:06 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:09:06 user nova-compute[74611]:     </video>
Nov 13 10:09:06 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:09:06 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:09:06 user nova-compute[74611]:     </rng>
Nov 13 10:09:06 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:09:06 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:09:06 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:09:06 user nova-compute[74611]:     </memballoon>
Nov 13 10:09:06 user nova-compute[74611]:   </devices>
Nov 13 10:09:06 user nova-compute[74611]: </domain>
Nov 13 10:09:06 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-465934460',display_name='tempest-SnapshotDataIntegrityTests-server-465934460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-465934460',id=40,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ95XQ5kHLmMjYnxdwVfR2w/1LdLhQp3xlENuDJOT+yNPrm9alErZe8HSaDMQQGvloEODd7olKYbiYb0bB36WOVmeqp/cB3At1Y38HnhXJFFLuHLEN9kzzQacmcI7w8dkA==',key_name='tempest-keypair-865768467',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='282fac4cc8704e0f985ab149c35aaf1c',ramdisk_id='',reservation_id='r-ueg5xeoy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1264141589',owner_user_name='tempest-SnapshotDataIntegrityTests-1264141589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b55061d274ba4b0ea3c0a695649b96a6',uuid=ddbea46e-4eaf-4797-a1fb-6e5eeef170b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "address": "fa:16:3e:8c:f7:c5", "network": {"id": "a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1029865477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "282fac4cc8704e0f985ab149c35aaf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa1d68a-42", "ovs_interfaceid": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Converting VIF {"id": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "address": "fa:16:3e:8c:f7:c5", "network": {"id": "a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1029865477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "282fac4cc8704e0f985ab149c35aaf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa1d68a-42", "ovs_interfaceid": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=9fa1d68a-42d8-4e69-9863-ff60ec956664,network=Network(a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa1d68a-42') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG os_vif [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=9fa1d68a-42d8-4e69-9863-ff60ec956664,network=Network(a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa1d68a-42') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f2faed1-91dc-5848-8428-4afa0df0c900', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fa1d68a-42, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9fa1d68a-42, col_values=(('qos', UUID('77a9f67c-5c15-40d6-ad7a-9c4ea40179d7')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9fa1d68a-42, col_values=(('external_ids', {'iface-id': '9fa1d68a-42d8-4e69-9863-ff60ec956664', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:f7:c5', 'vm-uuid': 'ddbea46e-4eaf-4797-a1fb-6e5eeef170b2'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:06 user nova-compute[74611]: INFO os_vif [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=9fa1d68a-42d8-4e69-9863-ff60ec956664,network=Network(a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa1d68a-42')
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:09:06 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] No VIF found with MAC fa:16:3e:8c:f7:c5, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:09:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-1dcc028d-af8f-4a73-b80a-a94c9c8601ad req-5579a094-0c28-4a58-afaf-c8b3dda7d439 service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Received event network-changed-9fa1d68a-42d8-4e69-9863-ff60ec956664 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-1dcc028d-af8f-4a73-b80a-a94c9c8601ad req-5579a094-0c28-4a58-afaf-c8b3dda7d439 service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Refreshing instance network info cache due to event network-changed-9fa1d68a-42d8-4e69-9863-ff60ec956664. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:09:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1dcc028d-af8f-4a73-b80a-a94c9c8601ad req-5579a094-0c28-4a58-afaf-c8b3dda7d439 service nova] Acquiring lock "refresh_cache-ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:09:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1dcc028d-af8f-4a73-b80a-a94c9c8601ad req-5579a094-0c28-4a58-afaf-c8b3dda7d439 service nova] Acquired lock "refresh_cache-ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:09:07 user nova-compute[74611]: DEBUG nova.network.neutron [req-1dcc028d-af8f-4a73-b80a-a94c9c8601ad req-5579a094-0c28-4a58-afaf-c8b3dda7d439 service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Refreshing network info cache for port 9fa1d68a-42d8-4e69-9863-ff60ec956664 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:09:07 user nova-compute[74611]: DEBUG nova.network.neutron [req-1dcc028d-af8f-4a73-b80a-a94c9c8601ad req-5579a094-0c28-4a58-afaf-c8b3dda7d439 service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Updated VIF entry in instance network info cache for port 9fa1d68a-42d8-4e69-9863-ff60ec956664. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:09:07 user nova-compute[74611]: DEBUG nova.network.neutron [req-1dcc028d-af8f-4a73-b80a-a94c9c8601ad req-5579a094-0c28-4a58-afaf-c8b3dda7d439 service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Updating instance_info_cache with network_info: [{"id": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "address": "fa:16:3e:8c:f7:c5", "network": {"id": "a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1029865477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "282fac4cc8704e0f985ab149c35aaf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa1d68a-42", "ovs_interfaceid": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:09:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1dcc028d-af8f-4a73-b80a-a94c9c8601ad req-5579a094-0c28-4a58-afaf-c8b3dda7d439 service nova] Releasing lock "refresh_cache-ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:09:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-840ab7ee-670e-49a7-a1a1-b94720ae6f17 req-d8403b68-7772-4e8d-acb3-36e9a67bb01b service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Received event network-vif-plugged-9fa1d68a-42d8-4e69-9863-ff60ec956664 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-840ab7ee-670e-49a7-a1a1-b94720ae6f17 req-d8403b68-7772-4e8d-acb3-36e9a67bb01b service nova] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-840ab7ee-670e-49a7-a1a1-b94720ae6f17 req-d8403b68-7772-4e8d-acb3-36e9a67bb01b service nova] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-840ab7ee-670e-49a7-a1a1-b94720ae6f17 req-d8403b68-7772-4e8d-acb3-36e9a67bb01b service nova] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-840ab7ee-670e-49a7-a1a1-b94720ae6f17 req-d8403b68-7772-4e8d-acb3-36e9a67bb01b service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] No waiting events found dispatching network-vif-plugged-9fa1d68a-42d8-4e69-9863-ff60ec956664 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:08 user nova-compute[74611]: WARNING nova.compute.manager [req-840ab7ee-670e-49a7-a1a1-b94720ae6f17 req-d8403b68-7772-4e8d-acb3-36e9a67bb01b service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Received unexpected event network-vif-plugged-9fa1d68a-42d8-4e69-9863-ff60ec956664 for instance with vm_state building and task_state spawning.
Nov 13 10:09:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:09:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:09:10 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Instance spawned successfully.
Nov 13 10:09:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:09:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:09:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:09:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:09:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:09:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:09:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:09:10 user nova-compute[74611]: INFO nova.compute.manager [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 13 10:09:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:09:10 user nova-compute[74611]: DEBUG nova.compute.manager [req-15929591-21bd-43b1-94a3-acafd829e66a req-8e0d3870-e7f1-498d-9cfe-a6589f2cafbf service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Received event network-vif-plugged-9fa1d68a-42d8-4e69-9863-ff60ec956664 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-15929591-21bd-43b1-94a3-acafd829e66a req-8e0d3870-e7f1-498d-9cfe-a6589f2cafbf service nova] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-15929591-21bd-43b1-94a3-acafd829e66a req-8e0d3870-e7f1-498d-9cfe-a6589f2cafbf service nova] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-15929591-21bd-43b1-94a3-acafd829e66a req-8e0d3870-e7f1-498d-9cfe-a6589f2cafbf service nova] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:10 user nova-compute[74611]: DEBUG nova.compute.manager [req-15929591-21bd-43b1-94a3-acafd829e66a req-8e0d3870-e7f1-498d-9cfe-a6589f2cafbf service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] No waiting events found dispatching network-vif-plugged-9fa1d68a-42d8-4e69-9863-ff60ec956664 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:10 user nova-compute[74611]: WARNING nova.compute.manager [req-15929591-21bd-43b1-94a3-acafd829e66a req-8e0d3870-e7f1-498d-9cfe-a6589f2cafbf service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Received unexpected event network-vif-plugged-9fa1d68a-42d8-4e69-9863-ff60ec956664 for instance with vm_state building and task_state spawning.
Nov 13 10:09:10 user nova-compute[74611]: INFO nova.compute.manager [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Took 6.95 seconds to build instance.
Nov 13 10:09:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-00c83e26-577b-47aa-981c-2372ee953426 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.064s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa604d06-2fc5-4b23-a0c9-35e695ddec59 req-fe8ad233-7e7e-4d22-bcf8-29c8e3b2a486 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Received event network-changed-71ffa4ff-d077-44f9-b3d1-3c2a921d6334 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa604d06-2fc5-4b23-a0c9-35e695ddec59 req-fe8ad233-7e7e-4d22-bcf8-29c8e3b2a486 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Refreshing instance network info cache due to event network-changed-71ffa4ff-d077-44f9-b3d1-3c2a921d6334. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:09:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa604d06-2fc5-4b23-a0c9-35e695ddec59 req-fe8ad233-7e7e-4d22-bcf8-29c8e3b2a486 service nova] Acquiring lock "refresh_cache-e9ed65b3-b8fc-4320-9625-e5028b6e340d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:09:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa604d06-2fc5-4b23-a0c9-35e695ddec59 req-fe8ad233-7e7e-4d22-bcf8-29c8e3b2a486 service nova] Acquired lock "refresh_cache-e9ed65b3-b8fc-4320-9625-e5028b6e340d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:09:32 user nova-compute[74611]: DEBUG nova.network.neutron [req-aa604d06-2fc5-4b23-a0c9-35e695ddec59 req-fe8ad233-7e7e-4d22-bcf8-29c8e3b2a486 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Refreshing network info cache for port 71ffa4ff-d077-44f9-b3d1-3c2a921d6334 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:09:32 user nova-compute[74611]: DEBUG nova.network.neutron [req-aa604d06-2fc5-4b23-a0c9-35e695ddec59 req-fe8ad233-7e7e-4d22-bcf8-29c8e3b2a486 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Updated VIF entry in instance network info cache for port 71ffa4ff-d077-44f9-b3d1-3c2a921d6334. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:09:32 user nova-compute[74611]: DEBUG nova.network.neutron [req-aa604d06-2fc5-4b23-a0c9-35e695ddec59 req-fe8ad233-7e7e-4d22-bcf8-29c8e3b2a486 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Updating instance_info_cache with network_info: [{"id": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "address": "fa:16:3e:9c:24:82", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ffa4ff-d0", "ovs_interfaceid": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:09:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa604d06-2fc5-4b23-a0c9-35e695ddec59 req-fe8ad233-7e7e-4d22-bcf8-29c8e3b2a486 service nova] Releasing lock "refresh_cache-e9ed65b3-b8fc-4320-9625-e5028b6e340d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:09:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "e9ed65b3-b8fc-4320-9625-e5028b6e340d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "e9ed65b3-b8fc-4320-9625-e5028b6e340d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "e9ed65b3-b8fc-4320-9625-e5028b6e340d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "e9ed65b3-b8fc-4320-9625-e5028b6e340d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "e9ed65b3-b8fc-4320-9625-e5028b6e340d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:33 user nova-compute[74611]: INFO nova.compute.manager [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Terminating instance
Nov 13 10:09:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:09:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Instance destroyed successfully.
Nov 13 10:09:34 user nova-compute[74611]: DEBUG nova.objects.instance [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lazy-loading 'resources' on Instance uuid e9ed65b3-b8fc-4320-9625-e5028b6e340d {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-8480901',display_name='tempest-TestVolumeBootPattern-server-8480901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-8480901',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjRXcM+iAZvLJco7tBubak1kGHq/45jJ2KKO6E3tr61cFQKM/YqE/xURoOe/LdnL01vr4FH+cPhy0FHq1+WQre34a6xvIem5nHqznPEd2v959ht3Wgct9dv/En52XotjA==',key_name='tempest-TestVolumeBootPattern-1763350711',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:07:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-e0xb40sn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:07:51Z,user_data=None,user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=e9ed65b3-b8fc-4320-9625-e5028b6e340d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "address": "fa:16:3e:9c:24:82", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ffa4ff-d0", "ovs_interfaceid": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "address": "fa:16:3e:9c:24:82", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ffa4ff-d0", "ovs_interfaceid": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:24:82,bridge_name='br-int',has_traffic_filtering=True,id=71ffa4ff-d077-44f9-b3d1-3c2a921d6334,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ffa4ff-d0') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_vif [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:24:82,bridge_name='br-int',has_traffic_filtering=True,id=71ffa4ff-d077-44f9-b3d1-3c2a921d6334,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ffa4ff-d0') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71ffa4ff-d0, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9abfb63-76bb-47c4-8f6c-47d569fd2fad) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:34 user nova-compute[74611]: INFO os_vif [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:24:82,bridge_name='br-int',has_traffic_filtering=True,id=71ffa4ff-d077-44f9-b3d1-3c2a921d6334,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ffa4ff-d0')
Nov 13 10:09:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZTPNuGJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:09:34 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[78edc280-5078-4024-94d9-df4329a0098e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:09:34 user nova-compute[74611]: No targets found.
Nov 13 10:09:34 user nova-compute[74611]: iSNS:
Nov 13 10:09:34 user nova-compute[74611]: No targets found.
Nov 13 10:09:34 user nova-compute[74611]: STATIC:
Nov 13 10:09:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd
Nov 13 10:09:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc
Nov 13 10:09:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740
Nov 13 10:09:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6
Nov 13 10:09:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc
Nov 13 10:09:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd
Nov 13 10:09:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:09:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:34 user nova-compute[74611]: FIRMWARE:
Nov 13 10:09:34 user nova-compute[74611]: No targets found.
Nov 13 10:09:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:09:34 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:09:34 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[332807ae-9478-4672-9b6f-1987eea0ea23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fb0f8e-0f49-4711-a679-fd00dbb83157]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:09:34 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:09:34 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:09:34 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:09:34 user nova-compute[74611]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)
Nov 13 10:09:34 user nova-compute[74611]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)
Nov 13 10:09:34 user nova-compute[74611]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 (non-flash)
Nov 13 10:09:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:09:34 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:09:34 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:09:34 user nova-compute[74611]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 (non-flash)
Nov 13 10:09:34 user nova-compute[74611]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)
Nov 13 10:09:34 user nova-compute[74611]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)
Nov 13 10:09:34 user nova-compute[74611]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 (non-flash)
Nov 13 10:09:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64628f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740'): ({'sde'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Removing single pathed devices sde {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2ba953-c135-4b64-9b8d-79f94d288bff]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[30942fe9-32be-4963-a9d3-d5d9b7413033]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flushing IO for device /dev/sde {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbed981a-05e5-468a-8c90-1a00fb53ea52]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[31145891-694e-4f07-aba7-c2d718699e56]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] SCSI volumes sde have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c27121-06cf-444d-9507-d885d218b408]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a73b714-b9c0-44e1-b459-44605732765c]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740, portal: 172.16.0.220,3260]
Nov 13 10:09:34 user nova-compute[74611]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740, portal: 172.16.0.220,3260] successful.
Nov 13 10:09:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aedff532-9929-4ffa-8aac-ef4ad576a740 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab71b131-82b5-40db-abf0-dc244ac2a441]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== disconnect_volume: return (366ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:09:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Deleting instance files /opt/stack/data/nova/instances/e9ed65b3-b8fc-4320-9625-e5028b6e340d_del
Nov 13 10:09:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Deletion of /opt/stack/data/nova/instances/e9ed65b3-b8fc-4320-9625-e5028b6e340d_del complete
Nov 13 10:09:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-52d7d837-2682-4bbc-8410-f74c4d8488a1 req-6c9f03a9-1187-41d7-ab41-b1586277b783 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Received event network-changed-71ffa4ff-d077-44f9-b3d1-3c2a921d6334 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-52d7d837-2682-4bbc-8410-f74c4d8488a1 req-6c9f03a9-1187-41d7-ab41-b1586277b783 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Refreshing instance network info cache due to event network-changed-71ffa4ff-d077-44f9-b3d1-3c2a921d6334. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-52d7d837-2682-4bbc-8410-f74c4d8488a1 req-6c9f03a9-1187-41d7-ab41-b1586277b783 service nova] Acquiring lock "refresh_cache-e9ed65b3-b8fc-4320-9625-e5028b6e340d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-52d7d837-2682-4bbc-8410-f74c4d8488a1 req-6c9f03a9-1187-41d7-ab41-b1586277b783 service nova] Acquired lock "refresh_cache-e9ed65b3-b8fc-4320-9625-e5028b6e340d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG nova.network.neutron [req-52d7d837-2682-4bbc-8410-f74c4d8488a1 req-6c9f03a9-1187-41d7-ab41-b1586277b783 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Refreshing network info cache for port 71ffa4ff-d077-44f9-b3d1-3c2a921d6334 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:09:34 user nova-compute[74611]: INFO nova.compute.manager [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 13 10:09:34 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:09:34 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:09:35 user nova-compute[74611]: DEBUG nova.network.neutron [req-52d7d837-2682-4bbc-8410-f74c4d8488a1 req-6c9f03a9-1187-41d7-ab41-b1586277b783 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Updated VIF entry in instance network info cache for port 71ffa4ff-d077-44f9-b3d1-3c2a921d6334. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:09:35 user nova-compute[74611]: DEBUG nova.network.neutron [req-52d7d837-2682-4bbc-8410-f74c4d8488a1 req-6c9f03a9-1187-41d7-ab41-b1586277b783 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Updating instance_info_cache with network_info: [{"id": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "address": "fa:16:3e:9c:24:82", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ffa4ff-d0", "ovs_interfaceid": "71ffa4ff-d077-44f9-b3d1-3c2a921d6334", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:09:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-52d7d837-2682-4bbc-8410-f74c4d8488a1 req-6c9f03a9-1187-41d7-ab41-b1586277b783 service nova] Releasing lock "refresh_cache-e9ed65b3-b8fc-4320-9625-e5028b6e340d" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:09:35 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:09:35 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Took 1.15 seconds to deallocate network for instance.
Nov 13 10:09:36 user nova-compute[74611]: INFO nova.compute.manager [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Took 0.74 seconds to detach 1 volumes for instance.
Nov 13 10:09:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-b1523277-9254-44a9-b3bf-8530274849c8 req-98c44755-ed70-4ca4-9a65-78903f9c1510 service nova] [instance: e9ed65b3-b8fc-4320-9625-e5028b6e340d] Received event network-vif-deleted-71ffa4ff-d077-44f9-b3d1-3c2a921d6334 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:36 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:09:36 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:37 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Deleted allocations for instance e9ed65b3-b8fc-4320-9625-e5028b6e340d
Nov 13 10:09:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fb5bcd61-9965-485c-873f-7c51873da558 tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "e9ed65b3-b8fc-4320-9625-e5028b6e340d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.842s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:37 user nova-compute[74611]: INFO nova.compute.manager [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Terminating instance
Nov 13 10:09:37 user nova-compute[74611]: DEBUG nova.compute.manager [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-e574d60e-55df-4a27-9b6d-4381b7f4fe9f req-6ea84838-f7ca-4ea3-81a5-953120d59999 service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received event network-vif-unplugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e574d60e-55df-4a27-9b6d-4381b7f4fe9f req-6ea84838-f7ca-4ea3-81a5-953120d59999 service nova] Acquiring lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e574d60e-55df-4a27-9b6d-4381b7f4fe9f req-6ea84838-f7ca-4ea3-81a5-953120d59999 service nova] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e574d60e-55df-4a27-9b6d-4381b7f4fe9f req-6ea84838-f7ca-4ea3-81a5-953120d59999 service nova] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-e574d60e-55df-4a27-9b6d-4381b7f4fe9f req-6ea84838-f7ca-4ea3-81a5-953120d59999 service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] No waiting events found dispatching network-vif-unplugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-e574d60e-55df-4a27-9b6d-4381b7f4fe9f req-6ea84838-f7ca-4ea3-81a5-953120d59999 service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received event network-vif-unplugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:38 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Instance destroyed successfully.
Nov 13 10:09:38 user nova-compute[74611]: DEBUG nova.objects.instance [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'resources' on Instance uuid 85cb3adb-b2b3-49ec-92ab-c2b7a028241a {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-500108257',display_name='tempest-ServerRescueNegativeTestJSON-server-500108257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-500108257',id=3,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:55:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae9ab18bb67e4db19e6c3366771ad218',ramdisk_id='',reservation_id='r-vpxab583',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-961432289',owner_user_name='tempest-ServerRescueNegativeTestJSON-961432289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:55:38Z,user_data=None,user_id='863471360be04ab5acb07ef3e99007c4',uuid=85cb3adb-b2b3-49ec-92ab-c2b7a028241a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "address": "fa:16:3e:ea:e8:de", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e875b56-fd", "ovs_interfaceid": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converting VIF {"id": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "address": "fa:16:3e:ea:e8:de", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e875b56-fd", "ovs_interfaceid": "7e875b56-fd2e-4ec6-9303-ef3965a6c7ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:e8:de,bridge_name='br-int',has_traffic_filtering=True,id=7e875b56-fd2e-4ec6-9303-ef3965a6c7ae,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e875b56-fd') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG os_vif [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:e8:de,bridge_name='br-int',has_traffic_filtering=True,id=7e875b56-fd2e-4ec6-9303-ef3965a6c7ae,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e875b56-fd') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e875b56-fd, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33fce92d-c4bf-43a5-8c6f-8608a452b27f) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:38 user nova-compute[74611]: INFO os_vif [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:e8:de,bridge_name='br-int',has_traffic_filtering=True,id=7e875b56-fd2e-4ec6-9303-ef3965a6c7ae,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e875b56-fd')
Nov 13 10:09:38 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Deleting instance files /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a_del
Nov 13 10:09:38 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Deletion of /opt/stack/data/nova/instances/85cb3adb-b2b3-49ec-92ab-c2b7a028241a_del complete
Nov 13 10:09:38 user nova-compute[74611]: INFO nova.compute.manager [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 10:09:38 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Acquiring lock "a05d41b7-4084-4be9-9c56-bcd01478c349" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lock "a05d41b7-4084-4be9-9c56-bcd01478c349" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG nova.compute.manager [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:09:38 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Took 0.45 seconds to deallocate network for instance.
Nov 13 10:09:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-29a3d726-ccbd-4d90-bbe7-22a53dc85e77 req-a3581a37-f115-46b2-b181-4db20e6c39b6 service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received event network-vif-deleted-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:38 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:09:38 user nova-compute[74611]: INFO nova.compute.claims [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Claim successful on node user
Nov 13 10:09:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.403s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG nova.network.neutron [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:09:39 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:09:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG nova.policy [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9dd6e9f050c44adf82c9c28b82e4d8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd08ee7e3b4e578ac00f6995287e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG nova.compute.manager [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:09:39 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Creating image(s)
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Acquiring lock "/opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lock "/opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lock "/opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:39 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Deleted allocations for instance 85cb3adb-b2b3-49ec-92ab-c2b7a028241a
Nov 13 10:09:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-c6b8966b-04b1-426c-bd4b-9f2ca3e8d0ef req-a8f2028b-f2d4-4e35-8a87-e77754f884c9 service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received event network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c6b8966b-04b1-426c-bd4b-9f2ca3e8d0ef req-a8f2028b-f2d4-4e35-8a87-e77754f884c9 service nova] Acquiring lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c6b8966b-04b1-426c-bd4b-9f2ca3e8d0ef req-a8f2028b-f2d4-4e35-8a87-e77754f884c9 service nova] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c6b8966b-04b1-426c-bd4b-9f2ca3e8d0ef req-a8f2028b-f2d4-4e35-8a87-e77754f884c9 service nova] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-c6b8966b-04b1-426c-bd4b-9f2ca3e8d0ef req-a8f2028b-f2d4-4e35-8a87-e77754f884c9 service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] No waiting events found dispatching network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:39 user nova-compute[74611]: WARNING nova.compute.manager [req-c6b8966b-04b1-426c-bd4b-9f2ca3e8d0ef req-a8f2028b-f2d4-4e35-8a87-e77754f884c9 service nova] [instance: 85cb3adb-b2b3-49ec-92ab-c2b7a028241a] Received unexpected event network-vif-plugged-7e875b56-fd2e-4ec6-9303-ef3965a6c7ae for instance with vm_state deleted and task_state None.
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-58bdd861-17b0-42a6-8d1a-b88fdce13eee tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "85cb3adb-b2b3-49ec-92ab-c2b7a028241a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.387s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.190s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk 1073741824" returned: 0 in 0.051s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG nova.network.neutron [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Successfully created port: 6837255f-df3c-458c-9d4b-e6bca6b127a8 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.168s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] There are 0 instances to clean {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Cannot resize image /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Ensure instance console log exists: /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG nova.network.neutron [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Successfully updated port: 6837255f-df3c-458c-9d4b-e6bca6b127a8 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Acquiring lock "refresh_cache-a05d41b7-4084-4be9-9c56-bcd01478c349" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Acquired lock "refresh_cache-a05d41b7-4084-4be9-9c56-bcd01478c349" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG nova.network.neutron [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:09:40 user nova-compute[74611]: DEBUG nova.network.neutron [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.compute.manager [req-42f86ed6-25ce-4f37-b40f-9241fdc290e0 req-75323379-216b-4140-9b36-65c0c70bfa30 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Received event network-changed-6837255f-df3c-458c-9d4b-e6bca6b127a8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.compute.manager [req-42f86ed6-25ce-4f37-b40f-9241fdc290e0 req-75323379-216b-4140-9b36-65c0c70bfa30 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Refreshing instance network info cache due to event network-changed-6837255f-df3c-458c-9d4b-e6bca6b127a8. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-42f86ed6-25ce-4f37-b40f-9241fdc290e0 req-75323379-216b-4140-9b36-65c0c70bfa30 service nova] Acquiring lock "refresh_cache-a05d41b7-4084-4be9-9c56-bcd01478c349" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.network.neutron [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Updating instance_info_cache with network_info: [{"id": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "address": "fa:16:3e:f1:d8:f6", "network": {"id": "fe173153-e1c0-4db7-8d4f-f944d05fd95a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385554225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdd08ee7e3b4e578ac00f6995287e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837255f-df", "ovs_interfaceid": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Releasing lock "refresh_cache-a05d41b7-4084-4be9-9c56-bcd01478c349" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.compute.manager [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Instance network_info: |[{"id": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "address": "fa:16:3e:f1:d8:f6", "network": {"id": "fe173153-e1c0-4db7-8d4f-f944d05fd95a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385554225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdd08ee7e3b4e578ac00f6995287e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837255f-df", "ovs_interfaceid": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-42f86ed6-25ce-4f37-b40f-9241fdc290e0 req-75323379-216b-4140-9b36-65c0c70bfa30 service nova] Acquired lock "refresh_cache-a05d41b7-4084-4be9-9c56-bcd01478c349" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.network.neutron [req-42f86ed6-25ce-4f37-b40f-9241fdc290e0 req-75323379-216b-4140-9b36-65c0c70bfa30 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Refreshing network info cache for port 6837255f-df3c-458c-9d4b-e6bca6b127a8 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Start _get_guest_xml network_info=[{"id": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "address": "fa:16:3e:f1:d8:f6", "network": {"id": "fe173153-e1c0-4db7-8d4f-f944d05fd95a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385554225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdd08ee7e3b4e578ac00f6995287e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837255f-df", "ovs_interfaceid": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:09:41 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:09:41 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:09:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-814468898',display_name='tempest-VolumesActionsTest-instance-814468898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-814468898',id=41,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cdd08ee7e3b4e578ac00f6995287e07',ramdisk_id='',reservation_id='r-yq2eaw50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1393528161',owner_user_name='tempest-VolumesActionsTest-1393528161-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:09:40Z,user_data=None,user_id='9dd6e9f050c44adf82c9c28b82e4d8ca',uuid=a05d41b7-4084-4be9-9c56-bcd01478c349,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "address": "fa:16:3e:f1:d8:f6", "network": {"id": "fe173153-e1c0-4db7-8d4f-f944d05fd95a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385554225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdd08ee7e3b4e578ac00f6995287e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837255f-df", "ovs_interfaceid": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Converting VIF {"id": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "address": "fa:16:3e:f1:d8:f6", "network": {"id": "fe173153-e1c0-4db7-8d4f-f944d05fd95a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385554225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdd08ee7e3b4e578ac00f6995287e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837255f-df", "ovs_interfaceid": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d8:f6,bridge_name='br-int',has_traffic_filtering=True,id=6837255f-df3c-458c-9d4b-e6bca6b127a8,network=Network(fe173153-e1c0-4db7-8d4f-f944d05fd95a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6837255f-df') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.objects.instance [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lazy-loading 'pci_devices' on Instance uuid a05d41b7-4084-4be9-9c56-bcd01478c349 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:09:41 user nova-compute[74611]:   <uuid>a05d41b7-4084-4be9-9c56-bcd01478c349</uuid>
Nov 13 10:09:41 user nova-compute[74611]:   <name>instance-00000029</name>
Nov 13 10:09:41 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:09:41 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:09:41 user nova-compute[74611]:   <metadata>
Nov 13 10:09:41 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:09:41 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:09:41 user nova-compute[74611]:       <nova:name>tempest-VolumesActionsTest-instance-814468898</nova:name>
Nov 13 10:09:41 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:09:41</nova:creationTime>
Nov 13 10:09:41 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:09:41 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:09:41 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:09:41 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:09:41 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:09:41 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:09:41 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:09:41 user nova-compute[74611]:       <nova:owner>
Nov 13 10:09:41 user nova-compute[74611]:         <nova:user uuid="9dd6e9f050c44adf82c9c28b82e4d8ca">tempest-VolumesActionsTest-1393528161-project-member</nova:user>
Nov 13 10:09:41 user nova-compute[74611]:         <nova:project uuid="0cdd08ee7e3b4e578ac00f6995287e07">tempest-VolumesActionsTest-1393528161</nova:project>
Nov 13 10:09:41 user nova-compute[74611]:       </nova:owner>
Nov 13 10:09:41 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:09:41 user nova-compute[74611]:       <nova:ports>
Nov 13 10:09:41 user nova-compute[74611]:         <nova:port uuid="6837255f-df3c-458c-9d4b-e6bca6b127a8">
Nov 13 10:09:41 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 10:09:41 user nova-compute[74611]:         </nova:port>
Nov 13 10:09:41 user nova-compute[74611]:       </nova:ports>
Nov 13 10:09:41 user nova-compute[74611]:     </nova:instance>
Nov 13 10:09:41 user nova-compute[74611]:   </metadata>
Nov 13 10:09:41 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:09:41 user nova-compute[74611]:     <system>
Nov 13 10:09:41 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:09:41 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:09:41 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:09:41 user nova-compute[74611]:       <entry name="serial">a05d41b7-4084-4be9-9c56-bcd01478c349</entry>
Nov 13 10:09:41 user nova-compute[74611]:       <entry name="uuid">a05d41b7-4084-4be9-9c56-bcd01478c349</entry>
Nov 13 10:09:41 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:09:41 user nova-compute[74611]:     </system>
Nov 13 10:09:41 user nova-compute[74611]:   </sysinfo>
Nov 13 10:09:41 user nova-compute[74611]:   <os>
Nov 13 10:09:41 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:09:41 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:09:41 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:09:41 user nova-compute[74611]:   </os>
Nov 13 10:09:41 user nova-compute[74611]:   <features>
Nov 13 10:09:41 user nova-compute[74611]:     <acpi/>
Nov 13 10:09:41 user nova-compute[74611]:     <apic/>
Nov 13 10:09:41 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:09:41 user nova-compute[74611]:   </features>
Nov 13 10:09:41 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:09:41 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:09:41 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:09:41 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:09:41 user nova-compute[74611]:   </clock>
Nov 13 10:09:41 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:09:41 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:09:41 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:09:41 user nova-compute[74611]:   </cpu>
Nov 13 10:09:41 user nova-compute[74611]:   <devices>
Nov 13 10:09:41 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:09:41 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:09:41 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk"/>
Nov 13 10:09:41 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:09:41 user nova-compute[74611]:     </disk>
Nov 13 10:09:41 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:09:41 user nova-compute[74611]:       <mac address="fa:16:3e:f1:d8:f6"/>
Nov 13 10:09:41 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:09:41 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:09:41 user nova-compute[74611]:       <target dev="tap6837255f-df"/>
Nov 13 10:09:41 user nova-compute[74611]:     </interface>
Nov 13 10:09:41 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:09:41 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/console.log" append="off"/>
Nov 13 10:09:41 user nova-compute[74611]:     </serial>
Nov 13 10:09:41 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:09:41 user nova-compute[74611]:     <video>
Nov 13 10:09:41 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:09:41 user nova-compute[74611]:     </video>
Nov 13 10:09:41 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:09:41 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:09:41 user nova-compute[74611]:     </rng>
Nov 13 10:09:41 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:09:41 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:09:41 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:09:41 user nova-compute[74611]:     </memballoon>
Nov 13 10:09:41 user nova-compute[74611]:   </devices>
Nov 13 10:09:41 user nova-compute[74611]: </domain>
Nov 13 10:09:41 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:09:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-814468898',display_name='tempest-VolumesActionsTest-instance-814468898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-814468898',id=41,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cdd08ee7e3b4e578ac00f6995287e07',ramdisk_id='',reservation_id='r-yq2eaw50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1393528161',owner_user_name='tempest-VolumesActionsTest-1393528161-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:09:40Z,user_data=None,user_id='9dd6e9f050c44adf82c9c28b82e4d8ca',uuid=a05d41b7-4084-4be9-9c56-bcd01478c349,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "address": "fa:16:3e:f1:d8:f6", "network": {"id": "fe173153-e1c0-4db7-8d4f-f944d05fd95a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385554225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdd08ee7e3b4e578ac00f6995287e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837255f-df", "ovs_interfaceid": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Converting VIF {"id": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "address": "fa:16:3e:f1:d8:f6", "network": {"id": "fe173153-e1c0-4db7-8d4f-f944d05fd95a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385554225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdd08ee7e3b4e578ac00f6995287e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837255f-df", "ovs_interfaceid": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d8:f6,bridge_name='br-int',has_traffic_filtering=True,id=6837255f-df3c-458c-9d4b-e6bca6b127a8,network=Network(fe173153-e1c0-4db7-8d4f-f944d05fd95a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6837255f-df') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG os_vif [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d8:f6,bridge_name='br-int',has_traffic_filtering=True,id=6837255f-df3c-458c-9d4b-e6bca6b127a8,network=Network(fe173153-e1c0-4db7-8d4f-f944d05fd95a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6837255f-df') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '891bce19-9295-5e6a-9570-5859ffeeb7e2', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6837255f-df, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6837255f-df, col_values=(('qos', UUID('069013f9-5474-4091-a959-ac5cd6eb4330')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6837255f-df, col_values=(('external_ids', {'iface-id': '6837255f-df3c-458c-9d4b-e6bca6b127a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:d8:f6', 'vm-uuid': 'a05d41b7-4084-4be9-9c56-bcd01478c349'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:41 user nova-compute[74611]: INFO os_vif [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d8:f6,bridge_name='br-int',has_traffic_filtering=True,id=6837255f-df3c-458c-9d4b-e6bca6b127a8,network=Network(fe173153-e1c0-4db7-8d4f-f944d05fd95a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6837255f-df')
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] No VIF found with MAC fa:16:3e:f1:d8:f6, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.network.neutron [req-42f86ed6-25ce-4f37-b40f-9241fdc290e0 req-75323379-216b-4140-9b36-65c0c70bfa30 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Updated VIF entry in instance network info cache for port 6837255f-df3c-458c-9d4b-e6bca6b127a8. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG nova.network.neutron [req-42f86ed6-25ce-4f37-b40f-9241fdc290e0 req-75323379-216b-4140-9b36-65c0c70bfa30 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Updating instance_info_cache with network_info: [{"id": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "address": "fa:16:3e:f1:d8:f6", "network": {"id": "fe173153-e1c0-4db7-8d4f-f944d05fd95a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385554225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdd08ee7e3b4e578ac00f6995287e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837255f-df", "ovs_interfaceid": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:09:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-42f86ed6-25ce-4f37-b40f-9241fdc290e0 req-75323379-216b-4140-9b36-65c0c70bfa30 service nova] Releasing lock "refresh_cache-a05d41b7-4084-4be9-9c56-bcd01478c349" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:09:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-8ad990fd-e3d0-44e3-88e8-19d556abbd1f req-64993a4b-ad58-46fb-8871-6ab23f947595 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Received event network-vif-plugged-6837255f-df3c-458c-9d4b-e6bca6b127a8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8ad990fd-e3d0-44e3-88e8-19d556abbd1f req-64993a4b-ad58-46fb-8871-6ab23f947595 service nova] Acquiring lock "a05d41b7-4084-4be9-9c56-bcd01478c349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8ad990fd-e3d0-44e3-88e8-19d556abbd1f req-64993a4b-ad58-46fb-8871-6ab23f947595 service nova] Lock "a05d41b7-4084-4be9-9c56-bcd01478c349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8ad990fd-e3d0-44e3-88e8-19d556abbd1f req-64993a4b-ad58-46fb-8871-6ab23f947595 service nova] Lock "a05d41b7-4084-4be9-9c56-bcd01478c349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-8ad990fd-e3d0-44e3-88e8-19d556abbd1f req-64993a4b-ad58-46fb-8871-6ab23f947595 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] No waiting events found dispatching network-vif-plugged-6837255f-df3c-458c-9d4b-e6bca6b127a8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:43 user nova-compute[74611]: WARNING nova.compute.manager [req-8ad990fd-e3d0-44e3-88e8-19d556abbd1f req-64993a4b-ad58-46fb-8871-6ab23f947595 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Received unexpected event network-vif-plugged-6837255f-df3c-458c-9d4b-e6bca6b127a8 for instance with vm_state building and task_state spawning.
Nov 13 10:09:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-8ad990fd-e3d0-44e3-88e8-19d556abbd1f req-64993a4b-ad58-46fb-8871-6ab23f947595 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Received event network-vif-plugged-6837255f-df3c-458c-9d4b-e6bca6b127a8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8ad990fd-e3d0-44e3-88e8-19d556abbd1f req-64993a4b-ad58-46fb-8871-6ab23f947595 service nova] Acquiring lock "a05d41b7-4084-4be9-9c56-bcd01478c349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8ad990fd-e3d0-44e3-88e8-19d556abbd1f req-64993a4b-ad58-46fb-8871-6ab23f947595 service nova] Lock "a05d41b7-4084-4be9-9c56-bcd01478c349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8ad990fd-e3d0-44e3-88e8-19d556abbd1f req-64993a4b-ad58-46fb-8871-6ab23f947595 service nova] Lock "a05d41b7-4084-4be9-9c56-bcd01478c349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-8ad990fd-e3d0-44e3-88e8-19d556abbd1f req-64993a4b-ad58-46fb-8871-6ab23f947595 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] No waiting events found dispatching network-vif-plugged-6837255f-df3c-458c-9d4b-e6bca6b127a8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:43 user nova-compute[74611]: WARNING nova.compute.manager [req-8ad990fd-e3d0-44e3-88e8-19d556abbd1f req-64993a4b-ad58-46fb-8871-6ab23f947595 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Received unexpected event network-vif-plugged-6837255f-df3c-458c-9d4b-e6bca6b127a8 for instance with vm_state building and task_state spawning.
Nov 13 10:09:43 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Updating instance_info_cache with network_info: [{"id": "e5967c05-de89-4853-b421-516eb483271e", "address": "fa:16:3e:c6:32:07", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5967c05-de", "ovs_interfaceid": "e5967c05-de89-4853-b421-516eb483271e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:09:43 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:09:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:44 user nova-compute[74611]: DEBUG nova.compute.manager [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:09:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:09:44 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Instance spawned successfully.
Nov 13 10:09:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:09:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:09:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:09:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:09:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:09:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:09:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:09:44 user nova-compute[74611]: INFO nova.compute.manager [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 13 10:09:44 user nova-compute[74611]: DEBUG nova.compute.manager [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:09:44 user nova-compute[74611]: INFO nova.compute.manager [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Took 6.05 seconds to build instance.
Nov 13 10:09:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-625e0140-34f0-408b-82cf-1a143341e607 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lock "a05d41b7-4084-4be9-9c56-bcd01478c349" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.165s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:48 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:09:48 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:09:49 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:09:49 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:09:49 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:09:49 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:09:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:09:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:53 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:09:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-e22017a7-3d7d-4fb8-8968-81be0482362f req-57737b3a-4867-4505-b3a3-6199cc3c3c4c service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-changed-68041c9c-ff1f-4f90-b36c-2d68ecc786ce {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-e22017a7-3d7d-4fb8-8968-81be0482362f req-57737b3a-4867-4505-b3a3-6199cc3c3c4c service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Refreshing instance network info cache due to event network-changed-68041c9c-ff1f-4f90-b36c-2d68ecc786ce. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:09:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e22017a7-3d7d-4fb8-8968-81be0482362f req-57737b3a-4867-4505-b3a3-6199cc3c3c4c service nova] Acquiring lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:09:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e22017a7-3d7d-4fb8-8968-81be0482362f req-57737b3a-4867-4505-b3a3-6199cc3c3c4c service nova] Acquired lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:09:54 user nova-compute[74611]: DEBUG nova.network.neutron [req-e22017a7-3d7d-4fb8-8968-81be0482362f req-57737b3a-4867-4505-b3a3-6199cc3c3c4c service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Refreshing network info cache for port 68041c9c-ff1f-4f90-b36c-2d68ecc786ce {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:09:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:54 user nova-compute[74611]: DEBUG nova.network.neutron [req-e22017a7-3d7d-4fb8-8968-81be0482362f req-57737b3a-4867-4505-b3a3-6199cc3c3c4c service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Updated VIF entry in instance network info cache for port 68041c9c-ff1f-4f90-b36c-2d68ecc786ce. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:09:54 user nova-compute[74611]: DEBUG nova.network.neutron [req-e22017a7-3d7d-4fb8-8968-81be0482362f req-57737b3a-4867-4505-b3a3-6199cc3c3c4c service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Updating instance_info_cache with network_info: [{"id": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "address": "fa:16:3e:e3:d6:0e", "network": {"id": "1465dfcb-80a9-4c13-8ad2-d49990f27559", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-614630284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68041c9c-ff", "ovs_interfaceid": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a95e799-9076-4024-809f-7de7acb57e68", "address": "fa:16:3e:91:fd:2b", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a95e799-90", "ovs_interfaceid": "5a95e799-9076-4024-809f-7de7acb57e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74d60359-c0d5-442d-8b95-d97a937d5b98", "address": "fa:16:3e:35:d1:d0", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d60359-c0", "ovs_interfaceid": "74d60359-c0d5-442d-8b95-d97a937d5b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f385fbf1-2c52-42d5-addd-f950be2dac74", "address": "fa:16:3e:92:70:35", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf385fbf1-2c", "ovs_interfaceid": "f385fbf1-2c52-42d5-addd-f950be2dac74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "address": "fa:16:3e:b6:48:d4", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1655af-51", "ovs_interfaceid": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "address": "fa:16:3e:e1:e9:f1", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79c7eee-ed", "ovs_interfaceid": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c6fc688-5b31-41ae-b902-b1271c264078", "address": "fa:16:3e:47:f7:66", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c6fc688-5b", "ovs_interfaceid": "6c6fc688-5b31-41ae-b902-b1271c264078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:09:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e22017a7-3d7d-4fb8-8968-81be0482362f req-57737b3a-4867-4505-b3a3-6199cc3c3c4c service nova] Releasing lock "refresh_cache-d0853d6e-1178-4a53-a532-b45656d9e416" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:09:55 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:09:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:55 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:09:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:09:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:09:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "d0853d6e-1178-4a53-a532-b45656d9e416" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:56 user nova-compute[74611]: INFO nova.compute.manager [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Terminating instance
Nov 13 10:09:56 user nova-compute[74611]: DEBUG nova.compute.manager [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-267cd244-9953-46be-ac01-f8c212b8711b req-2052ef1d-b307-4fa3-ae32-12f32e8cc11a service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-unplugged-68041c9c-ff1f-4f90-b36c-2d68ecc786ce {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-267cd244-9953-46be-ac01-f8c212b8711b req-2052ef1d-b307-4fa3-ae32-12f32e8cc11a service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-267cd244-9953-46be-ac01-f8c212b8711b req-2052ef1d-b307-4fa3-ae32-12f32e8cc11a service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-267cd244-9953-46be-ac01-f8c212b8711b req-2052ef1d-b307-4fa3-ae32-12f32e8cc11a service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-267cd244-9953-46be-ac01-f8c212b8711b req-2052ef1d-b307-4fa3-ae32-12f32e8cc11a service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-unplugged-68041c9c-ff1f-4f90-b36c-2d68ecc786ce {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-267cd244-9953-46be-ac01-f8c212b8711b req-2052ef1d-b307-4fa3-ae32-12f32e8cc11a service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-unplugged-68041c9c-ff1f-4f90-b36c-2d68ecc786ce for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-28695736-c708-4909-861d-8de29a91c0c1 req-0e6ca019-ed3c-48eb-9f8b-5d39b601d4fe service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-unplugged-5a95e799-9076-4024-809f-7de7acb57e68 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-28695736-c708-4909-861d-8de29a91c0c1 req-0e6ca019-ed3c-48eb-9f8b-5d39b601d4fe service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-28695736-c708-4909-861d-8de29a91c0c1 req-0e6ca019-ed3c-48eb-9f8b-5d39b601d4fe service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-28695736-c708-4909-861d-8de29a91c0c1 req-0e6ca019-ed3c-48eb-9f8b-5d39b601d4fe service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-28695736-c708-4909-861d-8de29a91c0c1 req-0e6ca019-ed3c-48eb-9f8b-5d39b601d4fe service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-unplugged-5a95e799-9076-4024-809f-7de7acb57e68 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-28695736-c708-4909-861d-8de29a91c0c1 req-0e6ca019-ed3c-48eb-9f8b-5d39b601d4fe service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-unplugged-5a95e799-9076-4024-809f-7de7acb57e68 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG nova.compute.manager [req-d7b2def9-2b1d-4169-b217-9a4e382e2990 req-b934baca-8f3d-4da0-8c72-b744c1a54968 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-unplugged-74d60359-c0d5-442d-8b95-d97a937d5b98 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d7b2def9-2b1d-4169-b217-9a4e382e2990 req-b934baca-8f3d-4da0-8c72-b744c1a54968 service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d7b2def9-2b1d-4169-b217-9a4e382e2990 req-b934baca-8f3d-4da0-8c72-b744c1a54968 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d7b2def9-2b1d-4169-b217-9a4e382e2990 req-b934baca-8f3d-4da0-8c72-b744c1a54968 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG nova.compute.manager [req-d7b2def9-2b1d-4169-b217-9a4e382e2990 req-b934baca-8f3d-4da0-8c72-b744c1a54968 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-unplugged-74d60359-c0d5-442d-8b95-d97a937d5b98 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG nova.compute.manager [req-d7b2def9-2b1d-4169-b217-9a4e382e2990 req-b934baca-8f3d-4da0-8c72-b744c1a54968 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-unplugged-74d60359-c0d5-442d-8b95-d97a937d5b98 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:58 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Instance destroyed successfully.
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.objects.instance [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lazy-loading 'resources' on Instance uuid d0853d6e-1178-4a53-a532-b45656d9e416 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:08:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:08:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "address": "fa:16:3e:e3:d6:0e", "network": {"id": "1465dfcb-80a9-4c13-8ad2-d49990f27559", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-614630284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68041c9c-ff", "ovs_interfaceid": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "address": "fa:16:3e:e3:d6:0e", "network": {"id": "1465dfcb-80a9-4c13-8ad2-d49990f27559", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-614630284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68041c9c-ff", "ovs_interfaceid": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:d6:0e,bridge_name='br-int',has_traffic_filtering=True,id=68041c9c-ff1f-4f90-b36c-2d68ecc786ce,network=Network(1465dfcb-80a9-4c13-8ad2-d49990f27559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68041c9c-ff') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG os_vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:d6:0e,bridge_name='br-int',has_traffic_filtering=True,id=68041c9c-ff1f-4f90-b36c-2d68ecc786ce,network=Network(1465dfcb-80a9-4c13-8ad2-d49990f27559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68041c9c-ff') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68041c9c-ff, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79cd0116-9f18-4d0a-9193-771f41c77723) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: INFO os_vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:d6:0e,bridge_name='br-int',has_traffic_filtering=True,id=68041c9c-ff1f-4f90-b36c-2d68ecc786ce,network=Network(1465dfcb-80a9-4c13-8ad2-d49990f27559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68041c9c-ff')
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:08:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:08:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a95e799-9076-4024-809f-7de7acb57e68", "address": "fa:16:3e:91:fd:2b", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a95e799-90", "ovs_interfaceid": "5a95e799-9076-4024-809f-7de7acb57e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "5a95e799-9076-4024-809f-7de7acb57e68", "address": "fa:16:3e:91:fd:2b", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a95e799-90", "ovs_interfaceid": "5a95e799-9076-4024-809f-7de7acb57e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:fd:2b,bridge_name='br-int',has_traffic_filtering=True,id=5a95e799-9076-4024-809f-7de7acb57e68,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5a95e799-90') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG os_vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:fd:2b,bridge_name='br-int',has_traffic_filtering=True,id=5a95e799-9076-4024-809f-7de7acb57e68,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5a95e799-90') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a95e799-90, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87ebc16e-bcdb-41bf-a02e-f1789afc89b4) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: INFO os_vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:fd:2b,bridge_name='br-int',has_traffic_filtering=True,id=5a95e799-9076-4024-809f-7de7acb57e68,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5a95e799-90')
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:08:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:08:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74d60359-c0d5-442d-8b95-d97a937d5b98", "address": "fa:16:3e:35:d1:d0", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d60359-c0", "ovs_interfaceid": "74d60359-c0d5-442d-8b95-d97a937d5b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "74d60359-c0d5-442d-8b95-d97a937d5b98", "address": "fa:16:3e:35:d1:d0", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d60359-c0", "ovs_interfaceid": "74d60359-c0d5-442d-8b95-d97a937d5b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:d1:d0,bridge_name='br-int',has_traffic_filtering=True,id=74d60359-c0d5-442d-8b95-d97a937d5b98,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74d60359-c0') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG os_vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:d1:d0,bridge_name='br-int',has_traffic_filtering=True,id=74d60359-c0d5-442d-8b95-d97a937d5b98,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74d60359-c0') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74d60359-c0, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.compute.manager [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-68041c9c-ff1f-4f90-b36c-2d68ecc786ce {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.compute.manager [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-68041c9c-ff1f-4f90-b36c-2d68ecc786ce {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:58 user nova-compute[74611]: WARNING nova.compute.manager [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-68041c9c-ff1f-4f90-b36c-2d68ecc786ce for instance with vm_state active and task_state deleting.
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.compute.manager [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-unplugged-a79c7eee-edeb-42c7-813e-d8888ffdf514 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.compute.manager [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-unplugged-a79c7eee-edeb-42c7-813e-d8888ffdf514 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.compute.manager [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-unplugged-a79c7eee-edeb-42c7-813e-d8888ffdf514 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.compute.manager [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-a79c7eee-edeb-42c7-813e-d8888ffdf514 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.compute.manager [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-a79c7eee-edeb-42c7-813e-d8888ffdf514 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:58 user nova-compute[74611]: WARNING nova.compute.manager [req-e184af77-edc9-4f4c-8d7e-aae6e1733fdb req-13a2d75b-2ab7-4e82-a9f0-c22c58a7b703 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-a79c7eee-edeb-42c7-813e-d8888ffdf514 for instance with vm_state active and task_state deleting.
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.compute.manager [req-b29cb2c5-fb87-46f8-93b7-0b47b1445607 req-50fe1c5a-fc27-4462-b023-d04d07254f02 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-5a95e799-9076-4024-809f-7de7acb57e68 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b29cb2c5-fb87-46f8-93b7-0b47b1445607 req-50fe1c5a-fc27-4462-b023-d04d07254f02 service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b29cb2c5-fb87-46f8-93b7-0b47b1445607 req-50fe1c5a-fc27-4462-b023-d04d07254f02 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b29cb2c5-fb87-46f8-93b7-0b47b1445607 req-50fe1c5a-fc27-4462-b023-d04d07254f02 service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.compute.manager [req-b29cb2c5-fb87-46f8-93b7-0b47b1445607 req-50fe1c5a-fc27-4462-b023-d04d07254f02 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-5a95e799-9076-4024-809f-7de7acb57e68 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:58 user nova-compute[74611]: WARNING nova.compute.manager [req-b29cb2c5-fb87-46f8-93b7-0b47b1445607 req-50fe1c5a-fc27-4462-b023-d04d07254f02 service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-5a95e799-9076-4024-809f-7de7acb57e68 for instance with vm_state active and task_state deleting.
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:58 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:09:58 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=7396MB free_disk=25.10782241821289GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d7dfcd6-7c36-462c-b065-6e0817589d20) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: INFO os_vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:d1:d0,bridge_name='br-int',has_traffic_filtering=True,id=74d60359-c0d5-442d-8b95-d97a937d5b98,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74d60359-c0')
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:08:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:08:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f385fbf1-2c52-42d5-addd-f950be2dac74", "address": "fa:16:3e:92:70:35", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf385fbf1-2c", "ovs_interfaceid": "f385fbf1-2c52-42d5-addd-f950be2dac74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "f385fbf1-2c52-42d5-addd-f950be2dac74", "address": "fa:16:3e:92:70:35", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf385fbf1-2c", "ovs_interfaceid": "f385fbf1-2c52-42d5-addd-f950be2dac74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:35,bridge_name='br-int',has_traffic_filtering=True,id=f385fbf1-2c52-42d5-addd-f950be2dac74,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf385fbf1-2c') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG os_vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:35,bridge_name='br-int',has_traffic_filtering=True,id=f385fbf1-2c52-42d5-addd-f950be2dac74,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf385fbf1-2c') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf385fbf1-2c, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=583b6471-b0f8-48b0-8c46-ee55963f144a) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: INFO os_vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:35,bridge_name='br-int',has_traffic_filtering=True,id=f385fbf1-2c52-42d5-addd-f950be2dac74,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf385fbf1-2c')
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:08:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:08:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "address": "fa:16:3e:b6:48:d4", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1655af-51", "ovs_interfaceid": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "address": "fa:16:3e:b6:48:d4", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1655af-51", "ovs_interfaceid": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:48:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d1655af-51db-4dc6-8250-9e5d2aee112a,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1655af-51') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG os_vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:48:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d1655af-51db-4dc6-8250-9e5d2aee112a,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1655af-51') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d1655af-51, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e698b2cf-6216-4ab3-8706-2600dfee43a0) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:59 user nova-compute[74611]: INFO os_vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:48:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d1655af-51db-4dc6-8250-9e5d2aee112a,network=Network(068d76c0-6033-45be-9226-80f078ac0c7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1655af-51')
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:08:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:08:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "address": "fa:16:3e:e1:e9:f1", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79c7eee-ed", "ovs_interfaceid": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "address": "fa:16:3e:e1:e9:f1", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79c7eee-ed", "ovs_interfaceid": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e9:f1,bridge_name='br-int',has_traffic_filtering=True,id=a79c7eee-edeb-42c7-813e-d8888ffdf514,network=Network(4f8bd835-da02-4926-9114-ffd0f16fea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa79c7eee-ed') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e9:f1,bridge_name='br-int',has_traffic_filtering=True,id=a79c7eee-edeb-42c7-813e-d8888ffdf514,network=Network(4f8bd835-da02-4926-9114-ffd0f16fea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa79c7eee-ed') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa79c7eee-ed, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=569de94a-b1c1-4b3f-90c9-cb0d116a6918) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-74d60359-c0d5-442d-8b95-d97a937d5b98 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-74d60359-c0d5-442d-8b95-d97a937d5b98 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:59 user nova-compute[74611]: WARNING nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-74d60359-c0d5-442d-8b95-d97a937d5b98 for instance with vm_state active and task_state deleting.
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-unplugged-f385fbf1-2c52-42d5-addd-f950be2dac74 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-unplugged-f385fbf1-2c52-42d5-addd-f950be2dac74 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-unplugged-f385fbf1-2c52-42d5-addd-f950be2dac74 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-f385fbf1-2c52-42d5-addd-f950be2dac74 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-f385fbf1-2c52-42d5-addd-f950be2dac74 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:59 user nova-compute[74611]: WARNING nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-f385fbf1-2c52-42d5-addd-f950be2dac74 for instance with vm_state active and task_state deleting.
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-unplugged-3d1655af-51db-4dc6-8250-9e5d2aee112a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-unplugged-3d1655af-51db-4dc6-8250-9e5d2aee112a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-unplugged-3d1655af-51db-4dc6-8250-9e5d2aee112a for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-3d1655af-51db-4dc6-8250-9e5d2aee112a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-3d1655af-51db-4dc6-8250-9e5d2aee112a {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:59 user nova-compute[74611]: WARNING nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-3d1655af-51db-4dc6-8250-9e5d2aee112a for instance with vm_state active and task_state deleting.
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-unplugged-6c6fc688-5b31-41ae-b902-b1271c264078 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-unplugged-6c6fc688-5b31-41ae-b902-b1271c264078 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-unplugged-6c6fc688-5b31-41ae-b902-b1271c264078 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-plugged-6c6fc688-5b31-41ae-b902-b1271c264078 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Acquiring lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] Lock "d0853d6e-1178-4a53-a532-b45656d9e416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] No waiting events found dispatching network-vif-plugged-6c6fc688-5b31-41ae-b902-b1271c264078 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:09:59 user nova-compute[74611]: WARNING nova.compute.manager [req-e1d570b6-fde4-4d5a-919f-bd7a8b65833b req-9cbe8f15-6265-43d8-a28e-57c1d0b5028b service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received unexpected event network-vif-plugged-6c6fc688-5b31-41ae-b902-b1271c264078 for instance with vm_state active and task_state deleting.
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:59 user nova-compute[74611]: INFO os_vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e9:f1,bridge_name='br-int',has_traffic_filtering=True,id=a79c7eee-edeb-42c7-813e-d8888ffdf514,network=Network(4f8bd835-da02-4926-9114-ffd0f16fea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa79c7eee-ed')
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-373293110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-373293110',id=38,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWusq9N0yESqeqLwWyv20yKc4BIjTKh52wbIx1C5daWQvV9HK4S2MU3FoY+WmK0t+vWeoqVr76lkBBU+Ilxg816KptaMCT+pXBgBc2n1XEMrmd9myJRJegVpRMEWKj1lQ==',key_name='tempest-keypair-1435371624',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:08:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73b003c1f30e448a9725379dc78c779d',ramdisk_id='',reservation_id='r-yw4vmbch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-992195744',owner_user_name='tempest-TaggedBootDevicesTest_v242-992195744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:08:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa51d40058b4882ac12075776b36ea4',uuid=d0853d6e-1178-4a53-a532-b45656d9e416,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c6fc688-5b31-41ae-b902-b1271c264078", "address": "fa:16:3e:47:f7:66", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c6fc688-5b", "ovs_interfaceid": "6c6fc688-5b31-41ae-b902-b1271c264078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converting VIF {"id": "6c6fc688-5b31-41ae-b902-b1271c264078", "address": "fa:16:3e:47:f7:66", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c6fc688-5b", "ovs_interfaceid": "6c6fc688-5b31-41ae-b902-b1271c264078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:f7:66,bridge_name='br-int',has_traffic_filtering=True,id=6c6fc688-5b31-41ae-b902-b1271c264078,network=Network(4f8bd835-da02-4926-9114-ffd0f16fea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c6fc688-5b') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:f7:66,bridge_name='br-int',has_traffic_filtering=True,id=6c6fc688-5b31-41ae-b902-b1271c264078,network=Network(4f8bd835-da02-4926-9114-ffd0f16fea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c6fc688-5b') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c6fc688-5b, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84de0d35-0ffe-42be-aff5-999ec985774d) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:09:59 user nova-compute[74611]: INFO os_vif [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:f7:66,bridge_name='br-int',has_traffic_filtering=True,id=6c6fc688-5b31-41ae-b902-b1271c264078,network=Network(4f8bd835-da02-4926-9114-ffd0f16fea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c6fc688-5b')
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f059d809-84b0-40c4-be84-bc89a9dc182e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance d0853d6e-1178-4a53-a532-b45656d9e416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance a05d41b7-4084-4be9-9c56-bcd01478c349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mhcbrUDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:09:59 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing inventories for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[71db1eaf-6b29-429d-b531-9db61c2d8ba0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:09:59 user nova-compute[74611]: No targets found.
Nov 13 10:09:59 user nova-compute[74611]: iSNS:
Nov 13 10:09:59 user nova-compute[74611]: No targets found.
Nov 13 10:09:59 user nova-compute[74611]: STATIC:
Nov 13 10:09:59 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd
Nov 13 10:09:59 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:59 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:59 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc
Nov 13 10:09:59 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:59 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:59 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6
Nov 13 10:09:59 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:59 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:59 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc
Nov 13 10:09:59 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:59 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:59 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd
Nov 13 10:09:59 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:59 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:59 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:09:59 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:59 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:59 user nova-compute[74611]: FIRMWARE:
Nov 13 10:09:59 user nova-compute[74611]: No targets found.
Nov 13 10:09:59 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:09:59 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:09:59 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating ProviderTree inventory for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating inventory in ProviderTree for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[36953c41-9b33-4128-b3a6-1fdd0551c0be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing aggregate associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, aggregates: None {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[194f523f-7fc3-4746-86e7-3786e70ce581]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 (non-flash)
Nov 13 10:09:59 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 (non-flash)
Nov 13 10:09:59 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8424e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6'): ({'sdi'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Removing single pathed devices sdi {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing trait associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c29ded-76b4-43a9-be71-e75c6e44a488]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c62af79-962d-40e1-bd3c-09b67f06d7f0]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Flushing IO for device /dev/sdi {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[027f4fe7-a833-40b8-a1dd-03f2967c83a5]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.034s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7ce432-05b9-4978-9add-667cc083c36d]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] SCSI volumes sdi have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[084613fb-efd8-4ef4-9cf7-10863facd37c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a892baf-7dfc-4c59-8b20-3016ea7e4564]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6, portal: 172.16.0.220,3260]
Nov 13 10:09:59 user nova-compute[74611]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6, portal: 172.16.0.220,3260] successful.
Nov 13 10:09:59 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1128fa-47f2-4d59-9284-47faba1f03c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c0af94-e9f8-431e-b4c9-477cccc5f344]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] <== disconnect_volume: return (328ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlJLhjPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:09:59 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67d1911-1a82-42aa-b6ef-a31b3017bd21]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:09:59 user nova-compute[74611]: No targets found.
Nov 13 10:09:59 user nova-compute[74611]: iSNS:
Nov 13 10:09:59 user nova-compute[74611]: No targets found.
Nov 13 10:09:59 user nova-compute[74611]: STATIC:
Nov 13 10:09:59 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd
Nov 13 10:09:59 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:59 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:59 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc
Nov 13 10:09:59 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:59 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:59 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc
Nov 13 10:09:59 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:59 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:59 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd
Nov 13 10:09:59 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:59 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:59 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:09:59 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:59 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:59 user nova-compute[74611]: FIRMWARE:
Nov 13 10:09:59 user nova-compute[74611]: No targets found.
Nov 13 10:09:59 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:09:59 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:09:59 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3845d654-f3e4-4854-a9b5-d8c259f8edd4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd5052e-1332-4c23-a2c3-af62596890ed]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)
Nov 13 10:09:59 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)
Nov 13 10:09:59 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8424d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba76f33f-758e-42be-b41a-3d269aa4f258]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4970162d-f057-48b7-823f-8b4650bb79c6]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.762s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[36132e91-7f6c-4893-b963-9f52bb013a7a]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2354ee6-fb09-4ac2-ad95-366b48e0f564]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[97548efb-d770-4b56-b580-551d6a2e89ad]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2202c33f-e2ee-44f6-976b-640c1624e68d]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd, portal: 172.16.0.220,3260]
Nov 13 10:09:59 user nova-compute[74611]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd, portal: 172.16.0.220,3260] successful.
Nov 13 10:09:59 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ba88b6-8564-42d7-b805-f1d7c463dadd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b361e2-6486-43dd-b72b-81390a963699]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] <== disconnect_volume: return (340ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLOrMcEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:09:59 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ec42f3-f461-4aa4-bc00-e80f5e37581d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:09:59 user nova-compute[74611]: No targets found.
Nov 13 10:09:59 user nova-compute[74611]: iSNS:
Nov 13 10:09:59 user nova-compute[74611]: No targets found.
Nov 13 10:09:59 user nova-compute[74611]: STATIC:
Nov 13 10:09:59 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc
Nov 13 10:09:59 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:59 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:59 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc
Nov 13 10:09:59 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:59 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:59 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd
Nov 13 10:09:59 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:59 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:59 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:09:59 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:09:59 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:09:59 user nova-compute[74611]: FIRMWARE:
Nov 13 10:09:59 user nova-compute[74611]: No targets found.
Nov 13 10:09:59 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:09:59 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:09:59 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ab8ac4-c727-43c6-8c1c-c2058ba94e21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5eca732-5738-484f-a921-869fc90cf099]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)
Nov 13 10:09:59 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:09:59 user nova-compute[74611]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc (non-flash)
Nov 13 10:09:59 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb84193be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc'): ({'sdh'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Removing single pathed devices sdh {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1edd123-2bb8-41d7-98b3-aecb34034ccb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[260044e4-252a-4a86-83ac-8bf573f73927]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Flushing IO for device /dev/sdh {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dd64c9-b754-40f5-a14f-f2fb34f71172]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:09:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd79891-782a-48a9-a2a1-ad186f3b5e98]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] SCSI volumes sdh have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[159ac0fb-8fcc-434a-bba5-4f54a790daed]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcf7146-b5e3-4878-a107-341e30311ca7]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc, portal: 172.16.0.220,3260]
Nov 13 10:10:00 user nova-compute[74611]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc, portal: 172.16.0.220,3260] successful.
Nov 13 10:10:00 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ca530c-111f-427f-93e0-67eb70f4f0bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[136f2696-27b7-49fa-90d9-5c7d591454b2]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] <== disconnect_volume: return (328ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:10:00 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Deleting instance files /opt/stack/data/nova/instances/d0853d6e-1178-4a53-a532-b45656d9e416_del
Nov 13 10:10:00 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Deletion of /opt/stack/data/nova/instances/d0853d6e-1178-4a53-a532-b45656d9e416_del complete
Nov 13 10:10:00 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74611) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 10:10:00 user nova-compute[74611]: INFO nova.compute.manager [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Took 3.93 seconds to destroy the instance on the hypervisor.
Nov 13 10:10:00 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:10:00 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:10:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-bd9b4fca-e021-4eca-9fc6-f7289c2f8cbd req-9fe38325-4b99-4e1f-9531-3ea04f243eaf service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-deleted-f385fbf1-2c52-42d5-addd-f950be2dac74 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:01 user nova-compute[74611]: INFO nova.compute.manager [req-bd9b4fca-e021-4eca-9fc6-f7289c2f8cbd req-9fe38325-4b99-4e1f-9531-3ea04f243eaf service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Neutron deleted interface f385fbf1-2c52-42d5-addd-f950be2dac74; detaching it from the instance and deleting it from the info cache
Nov 13 10:10:01 user nova-compute[74611]: DEBUG nova.network.neutron [req-bd9b4fca-e021-4eca-9fc6-f7289c2f8cbd req-9fe38325-4b99-4e1f-9531-3ea04f243eaf service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Updating instance_info_cache with network_info: [{"id": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "address": "fa:16:3e:e3:d6:0e", "network": {"id": "1465dfcb-80a9-4c13-8ad2-d49990f27559", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-614630284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68041c9c-ff", "ovs_interfaceid": "68041c9c-ff1f-4f90-b36c-2d68ecc786ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a95e799-9076-4024-809f-7de7acb57e68", "address": "fa:16:3e:91:fd:2b", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a95e799-90", "ovs_interfaceid": "5a95e799-9076-4024-809f-7de7acb57e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74d60359-c0d5-442d-8b95-d97a937d5b98", "address": "fa:16:3e:35:d1:d0", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d60359-c0", "ovs_interfaceid": "74d60359-c0d5-442d-8b95-d97a937d5b98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "address": "fa:16:3e:b6:48:d4", "network": {"id": "068d76c0-6033-45be-9226-80f078ac0c7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-22249361", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1655af-51", "ovs_interfaceid": "3d1655af-51db-4dc6-8250-9e5d2aee112a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "address": "fa:16:3e:e1:e9:f1", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79c7eee-ed", "ovs_interfaceid": "a79c7eee-edeb-42c7-813e-d8888ffdf514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c6fc688-5b31-41ae-b902-b1271c264078", "address": "fa:16:3e:47:f7:66", "network": {"id": "4f8bd835-da02-4926-9114-ffd0f16fea5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1794677735", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "73b003c1f30e448a9725379dc78c779d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c6fc688-5b", "ovs_interfaceid": "6c6fc688-5b31-41ae-b902-b1271c264078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:10:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-bd9b4fca-e021-4eca-9fc6-f7289c2f8cbd req-9fe38325-4b99-4e1f-9531-3ea04f243eaf service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Detach interface failed, port_id=f385fbf1-2c52-42d5-addd-f950be2dac74, reason: Instance d0853d6e-1178-4a53-a532-b45656d9e416 could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 10:10:03 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:10:03 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Took 2.90 seconds to deallocate network for instance.
Nov 13 10:10:03 user nova-compute[74611]: DEBUG nova.compute.manager [req-2b3a687e-4bf9-4e29-9658-892b062cf317 req-36e5858c-6373-4a52-8550-87062676d37d service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-deleted-68041c9c-ff1f-4f90-b36c-2d68ecc786ce {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:03 user nova-compute[74611]: DEBUG nova.compute.manager [req-2b3a687e-4bf9-4e29-9658-892b062cf317 req-36e5858c-6373-4a52-8550-87062676d37d service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-deleted-6c6fc688-5b31-41ae-b902-b1271c264078 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:03 user nova-compute[74611]: DEBUG nova.compute.manager [req-2b3a687e-4bf9-4e29-9658-892b062cf317 req-36e5858c-6373-4a52-8550-87062676d37d service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-deleted-3d1655af-51db-4dc6-8250-9e5d2aee112a {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:03 user nova-compute[74611]: DEBUG nova.compute.manager [req-2b3a687e-4bf9-4e29-9658-892b062cf317 req-36e5858c-6373-4a52-8550-87062676d37d service nova] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Received event network-vif-deleted-a79c7eee-edeb-42c7-813e-d8888ffdf514 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:05 user nova-compute[74611]: INFO nova.compute.manager [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] [instance: d0853d6e-1178-4a53-a532-b45656d9e416] Took 2.18 seconds to detach 3 volumes for instance.
Nov 13 10:10:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:05 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:10:05 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:10:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:05 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Deleted allocations for instance d0853d6e-1178-4a53-a532-b45656d9e416
Nov 13 10:10:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8a92221e-d248-4fc5-83d6-05284bf2f011 tempest-TaggedBootDevicesTest_v242-992195744 tempest-TaggedBootDevicesTest_v242-992195744-project-member] Lock "d0853d6e-1178-4a53-a532-b45656d9e416" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.517s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "ed1dfac0-31b6-4e63-895e-29877e17d178" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:09 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:10:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:10:09 user nova-compute[74611]: INFO nova.compute.claims [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Claim successful on node user
Nov 13 10:10:09 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:10:09 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:10:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:09 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:10:10 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:10:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG nova.policy [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f22322be2dd04410b6cd53c31e639b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a0b0a078bd44908cd7cd4593914eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:10:10 user nova-compute[74611]: INFO nova.virt.block_device [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Booting with volume b211e65b-4e88-4035-8e8b-4cfb44706fbd at /dev/vda
Nov 13 10:10:10 user nova-compute[74611]: DEBUG os_brick.utils [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4b9922-7676-447a-b70c-fdc6b29b16c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01d8caa-c8f8-43e8-856e-ac546700d9a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0effb404-4ff9-4b10-b101-6d5eec337fa8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb38664-1ecd-4ceb-950e-fbb1a14d30b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:10:10 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:10:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fc9a4d-01e1-4048-88bf-fd681e4df6cf]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG os_brick.utils [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Updating existing volume attachment record: b43bfa74-178b-498d-96df-b91b052eb0e1 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:10:10 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Successfully created port: a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:10:11 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Successfully updated port: a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:10:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:10:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquired lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:10:11 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:10:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-c345d067-5893-46f1-b289-ff69b8b8632f req-372bb3f4-5a95-4f37-abb8-a6f42c26185d service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received event network-changed-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:11 user nova-compute[74611]: DEBUG nova.compute.manager [req-c345d067-5893-46f1-b289-ff69b8b8632f req-372bb3f4-5a95-4f37-abb8-a6f42c26185d service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Refreshing instance network info cache due to event network-changed-a53ebdb2-3917-46df-b5a3-af5682496fa8. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:10:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c345d067-5893-46f1-b289-ff69b8b8632f req-372bb3f4-5a95-4f37-abb8-a6f42c26185d service nova] Acquiring lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:10:11 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:10:11 user nova-compute[74611]: DEBUG nova.network.neutron [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Updating instance_info_cache with network_info: [{"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:10:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Releasing lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:10:11 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Instance network_info: |[{"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:10:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c345d067-5893-46f1-b289-ff69b8b8632f req-372bb3f4-5a95-4f37-abb8-a6f42c26185d service nova] Acquired lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:10:11 user nova-compute[74611]: DEBUG nova.network.neutron [req-c345d067-5893-46f1-b289-ff69b8b8632f req-372bb3f4-5a95-4f37-abb8-a6f42c26185d service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Refreshing network info cache for port a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:10:12 user nova-compute[74611]: DEBUG nova.network.neutron [req-c345d067-5893-46f1-b289-ff69b8b8632f req-372bb3f4-5a95-4f37-abb8-a6f42c26185d service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Updated VIF entry in instance network info cache for port a53ebdb2-3917-46df-b5a3-af5682496fa8. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:10:12 user nova-compute[74611]: DEBUG nova.network.neutron [req-c345d067-5893-46f1-b289-ff69b8b8632f req-372bb3f4-5a95-4f37-abb8-a6f42c26185d service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Updating instance_info_cache with network_info: [{"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:10:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c345d067-5893-46f1-b289-ff69b8b8632f req-372bb3f4-5a95-4f37-abb8-a6f42c26185d service nova] Releasing lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:10:14 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Creating image(s)
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Ensure instance console log exists: /opt/stack/data/nova/instances/ed1dfac0-31b6-4e63-895e-29877e17d178/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Start _get_guest_xml network_info=[{"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'b43bfa74-178b-498d-96df-b91b052eb0e1', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZwVaFIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed1dfac0-31b6-4e63-895e-29877e17d178', 'attached_at': '', 'detached_at': '', 'volume_id': 'b211e65b-4e88-4035-8e8b-4cfb44706fbd', 'serial': 'b211e65b-4e88-4035-8e8b-4cfb44706fbd'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:10:14 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:10:14 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZwVaFIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:10:14 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:10:14 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:10:14 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c8198f-889a-40ee-8753-e64bbdb87c02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:10:14 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[95859076-2162-4224-9afb-9e0fba5a783d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd] added
Nov 13 10:10:14 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3194ddcf-475a-4c22-a0b9-b864d6946578]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e128e19b-dbb0-4457-8a56-9fd5e32703b1]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZwVaFIL {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZwVaFIL" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a77cbc-035e-4f46-b426-7ebe34c6edee]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BZwVaFIL'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bde3370-594a-4a5d-bdac-4d77b77ca1a3]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[655dc237-68b1-4b14-ac76-ec548b818ec8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:10:14 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:10:14 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:10:14 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:10:14 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:10:14 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:10:14 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed1c22c-b955-4f00-ba07-e48766cac85b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd, portal: 172.16.0.220,3260]
Nov 13 10:10:14 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd, portal: 172.16.0.220,3260] successful.
Nov 13 10:10:14 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96ff473-daf6-4479-a641-87be0372e61d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c35242a-25c2-4ca8-a344-c4e769ebc4e1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:10:14 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:10:14 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:10:14 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:10:14 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:10:14 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:10:14 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:10:14 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:10:14 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e16a298-30c9-42cd-8d04-91b3119fc5c7]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:14 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZwVaFIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23165343133326231', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165343133326231', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1947219481',display_name='tempest-ServerActionsTestOtherA-server-1947219481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1947219481',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyvkPZ/C5Pk5XOFxP5rMcYJVq0nGL8MEwZ1COcFqCFBcO7G74gr+o/bZOILVW3PDzyd5NY9xtWs0kgCNTm8xNQIJrW9d3YRiHEICGlxrvJ1iCAAc7YEKxcFMW7SpPA0Dw==',key_name='tempest-keypair-2093749558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a0b0a078bd44908cd7cd4593914eef',ramdisk_id='',reservation_id='r-ixwiy3ki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2135577355',owner_user_name='tempest-ServerActionsTestOtherA-2135577355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22322be2dd04410b6cd53c31e639b3b',uuid=ed1dfac0-31b6-4e63-895e-29877e17d178,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converting VIF {"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:42:59,bridge_name='br-int',has_traffic_filtering=True,id=a53ebdb2-3917-46df-b5a3-af5682496fa8,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53ebdb2-39') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG nova.objects.instance [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lazy-loading 'pci_devices' on Instance uuid ed1dfac0-31b6-4e63-895e-29877e17d178 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:10:15 user nova-compute[74611]:   <uuid>ed1dfac0-31b6-4e63-895e-29877e17d178</uuid>
Nov 13 10:10:15 user nova-compute[74611]:   <name>instance-0000002a</name>
Nov 13 10:10:15 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:10:15 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:10:15 user nova-compute[74611]:   <metadata>
Nov 13 10:10:15 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:10:15 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:10:15 user nova-compute[74611]:       <nova:name>tempest-ServerActionsTestOtherA-server-1947219481</nova:name>
Nov 13 10:10:15 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:10:14</nova:creationTime>
Nov 13 10:10:15 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:10:15 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:10:15 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:10:15 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:10:15 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:10:15 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:10:15 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:10:15 user nova-compute[74611]:       <nova:owner>
Nov 13 10:10:15 user nova-compute[74611]:         <nova:user uuid="f22322be2dd04410b6cd53c31e639b3b">tempest-ServerActionsTestOtherA-2135577355-project-member</nova:user>
Nov 13 10:10:15 user nova-compute[74611]:         <nova:project uuid="e6a0b0a078bd44908cd7cd4593914eef">tempest-ServerActionsTestOtherA-2135577355</nova:project>
Nov 13 10:10:15 user nova-compute[74611]:       </nova:owner>
Nov 13 10:10:15 user nova-compute[74611]:       <nova:ports>
Nov 13 10:10:15 user nova-compute[74611]:         <nova:port uuid="a53ebdb2-3917-46df-b5a3-af5682496fa8">
Nov 13 10:10:15 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 10:10:15 user nova-compute[74611]:         </nova:port>
Nov 13 10:10:15 user nova-compute[74611]:       </nova:ports>
Nov 13 10:10:15 user nova-compute[74611]:     </nova:instance>
Nov 13 10:10:15 user nova-compute[74611]:   </metadata>
Nov 13 10:10:15 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:10:15 user nova-compute[74611]:     <system>
Nov 13 10:10:15 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:10:15 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:10:15 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:10:15 user nova-compute[74611]:       <entry name="serial">ed1dfac0-31b6-4e63-895e-29877e17d178</entry>
Nov 13 10:10:15 user nova-compute[74611]:       <entry name="uuid">ed1dfac0-31b6-4e63-895e-29877e17d178</entry>
Nov 13 10:10:15 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:10:15 user nova-compute[74611]:     </system>
Nov 13 10:10:15 user nova-compute[74611]:   </sysinfo>
Nov 13 10:10:15 user nova-compute[74611]:   <os>
Nov 13 10:10:15 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:10:15 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:10:15 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:10:15 user nova-compute[74611]:   </os>
Nov 13 10:10:15 user nova-compute[74611]:   <features>
Nov 13 10:10:15 user nova-compute[74611]:     <acpi/>
Nov 13 10:10:15 user nova-compute[74611]:     <apic/>
Nov 13 10:10:15 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:10:15 user nova-compute[74611]:   </features>
Nov 13 10:10:15 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:10:15 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:10:15 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:10:15 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:10:15 user nova-compute[74611]:   </clock>
Nov 13 10:10:15 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:10:15 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:10:15 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:10:15 user nova-compute[74611]:   </cpu>
Nov 13 10:10:15 user nova-compute[74611]:   <devices>
Nov 13 10:10:15 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:10:15 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:10:15 user nova-compute[74611]:       <source dev="/dev/sdb"/>
Nov 13 10:10:15 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:10:15 user nova-compute[74611]:       <serial>b211e65b-4e88-4035-8e8b-4cfb44706fbd</serial>
Nov 13 10:10:15 user nova-compute[74611]:     </disk>
Nov 13 10:10:15 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:10:15 user nova-compute[74611]:       <mac address="fa:16:3e:d0:42:59"/>
Nov 13 10:10:15 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:10:15 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:10:15 user nova-compute[74611]:       <target dev="tapa53ebdb2-39"/>
Nov 13 10:10:15 user nova-compute[74611]:     </interface>
Nov 13 10:10:15 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:10:15 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/ed1dfac0-31b6-4e63-895e-29877e17d178/console.log" append="off"/>
Nov 13 10:10:15 user nova-compute[74611]:     </serial>
Nov 13 10:10:15 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:10:15 user nova-compute[74611]:     <video>
Nov 13 10:10:15 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:10:15 user nova-compute[74611]:     </video>
Nov 13 10:10:15 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:10:15 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:10:15 user nova-compute[74611]:     </rng>
Nov 13 10:10:15 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:10:15 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:10:15 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:10:15 user nova-compute[74611]:     </memballoon>
Nov 13 10:10:15 user nova-compute[74611]:   </devices>
Nov 13 10:10:15 user nova-compute[74611]: </domain>
Nov 13 10:10:15 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1947219481',display_name='tempest-ServerActionsTestOtherA-server-1947219481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1947219481',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyvkPZ/C5Pk5XOFxP5rMcYJVq0nGL8MEwZ1COcFqCFBcO7G74gr+o/bZOILVW3PDzyd5NY9xtWs0kgCNTm8xNQIJrW9d3YRiHEICGlxrvJ1iCAAc7YEKxcFMW7SpPA0Dw==',key_name='tempest-keypair-2093749558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a0b0a078bd44908cd7cd4593914eef',ramdisk_id='',reservation_id='r-ixwiy3ki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2135577355',owner_user_name='tempest-ServerActionsTestOtherA-2135577355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22322be2dd04410b6cd53c31e639b3b',uuid=ed1dfac0-31b6-4e63-895e-29877e17d178,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converting VIF {"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:42:59,bridge_name='br-int',has_traffic_filtering=True,id=a53ebdb2-3917-46df-b5a3-af5682496fa8,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53ebdb2-39') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG os_vif [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:42:59,bridge_name='br-int',has_traffic_filtering=True,id=a53ebdb2-3917-46df-b5a3-af5682496fa8,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53ebdb2-39') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e20e8b4-4fd7-58cb-8178-bc15aa48e731', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa53ebdb2-39, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa53ebdb2-39, col_values=(('qos', UUID('a3b14938-26fc-4471-8cce-fdc5451fa9c3')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa53ebdb2-39, col_values=(('external_ids', {'iface-id': 'a53ebdb2-3917-46df-b5a3-af5682496fa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:42:59', 'vm-uuid': 'ed1dfac0-31b6-4e63-895e-29877e17d178'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:15 user nova-compute[74611]: INFO os_vif [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:42:59,bridge_name='br-int',has_traffic_filtering=True,id=a53ebdb2-3917-46df-b5a3-af5682496fa8,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53ebdb2-39')
Nov 13 10:10:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:10:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] No VIF found with MAC fa:16:3e:d0:42:59, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:10:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:17 user nova-compute[74611]: DEBUG nova.compute.manager [req-a6e3a378-5ebf-492d-a50b-e0ff2ff6bcc2 req-f9bea5a9-c108-402d-8807-30629d35bbb5 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received event network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a6e3a378-5ebf-492d-a50b-e0ff2ff6bcc2 req-f9bea5a9-c108-402d-8807-30629d35bbb5 service nova] Acquiring lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a6e3a378-5ebf-492d-a50b-e0ff2ff6bcc2 req-f9bea5a9-c108-402d-8807-30629d35bbb5 service nova] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a6e3a378-5ebf-492d-a50b-e0ff2ff6bcc2 req-f9bea5a9-c108-402d-8807-30629d35bbb5 service nova] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:17 user nova-compute[74611]: DEBUG nova.compute.manager [req-a6e3a378-5ebf-492d-a50b-e0ff2ff6bcc2 req-f9bea5a9-c108-402d-8807-30629d35bbb5 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] No waiting events found dispatching network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:10:17 user nova-compute[74611]: WARNING nova.compute.manager [req-a6e3a378-5ebf-492d-a50b-e0ff2ff6bcc2 req-f9bea5a9-c108-402d-8807-30629d35bbb5 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received unexpected event network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 for instance with vm_state building and task_state spawning.
Nov 13 10:10:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:19 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:10:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:10:19 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Instance spawned successfully.
Nov 13 10:10:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:10:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:10:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:10:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:10:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:10:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:10:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:10:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1497f54-7b5a-4dd2-84a0-a12f23489c0c req-26467cbf-3ee1-4a6b-807b-da4a34d8fac8 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received event network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1497f54-7b5a-4dd2-84a0-a12f23489c0c req-26467cbf-3ee1-4a6b-807b-da4a34d8fac8 service nova] Acquiring lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1497f54-7b5a-4dd2-84a0-a12f23489c0c req-26467cbf-3ee1-4a6b-807b-da4a34d8fac8 service nova] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e1497f54-7b5a-4dd2-84a0-a12f23489c0c req-26467cbf-3ee1-4a6b-807b-da4a34d8fac8 service nova] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-e1497f54-7b5a-4dd2-84a0-a12f23489c0c req-26467cbf-3ee1-4a6b-807b-da4a34d8fac8 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] No waiting events found dispatching network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:10:19 user nova-compute[74611]: WARNING nova.compute.manager [req-e1497f54-7b5a-4dd2-84a0-a12f23489c0c req-26467cbf-3ee1-4a6b-807b-da4a34d8fac8 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received unexpected event network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 for instance with vm_state building and task_state spawning.
Nov 13 10:10:19 user nova-compute[74611]: INFO nova.compute.manager [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 13 10:10:19 user nova-compute[74611]: DEBUG nova.compute.manager [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:10:19 user nova-compute[74611]: INFO nova.compute.manager [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Took 9.92 seconds to build instance.
Nov 13 10:10:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5f141f1-b4df-45ad-8640-904792a595ae tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.016s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:24 user nova-compute[74611]: DEBUG nova.compute.manager [req-efc7b701-d2a1-4f37-90e3-912e1f291278 req-b45bf54f-d314-4f2f-9a74-82757da44543 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Received event network-changed-50d7432d-bbe3-4f65-ae8a-6cc8387ba245 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:24 user nova-compute[74611]: DEBUG nova.compute.manager [req-efc7b701-d2a1-4f37-90e3-912e1f291278 req-b45bf54f-d314-4f2f-9a74-82757da44543 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Refreshing instance network info cache due to event network-changed-50d7432d-bbe3-4f65-ae8a-6cc8387ba245. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:10:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-efc7b701-d2a1-4f37-90e3-912e1f291278 req-b45bf54f-d314-4f2f-9a74-82757da44543 service nova] Acquiring lock "refresh_cache-d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:10:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-efc7b701-d2a1-4f37-90e3-912e1f291278 req-b45bf54f-d314-4f2f-9a74-82757da44543 service nova] Acquired lock "refresh_cache-d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:10:24 user nova-compute[74611]: DEBUG nova.network.neutron [req-efc7b701-d2a1-4f37-90e3-912e1f291278 req-b45bf54f-d314-4f2f-9a74-82757da44543 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Refreshing network info cache for port 50d7432d-bbe3-4f65-ae8a-6cc8387ba245 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:10:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:24 user nova-compute[74611]: DEBUG nova.network.neutron [req-efc7b701-d2a1-4f37-90e3-912e1f291278 req-b45bf54f-d314-4f2f-9a74-82757da44543 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Updated VIF entry in instance network info cache for port 50d7432d-bbe3-4f65-ae8a-6cc8387ba245. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:10:24 user nova-compute[74611]: DEBUG nova.network.neutron [req-efc7b701-d2a1-4f37-90e3-912e1f291278 req-b45bf54f-d314-4f2f-9a74-82757da44543 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Updating instance_info_cache with network_info: [{"id": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "address": "fa:16:3e:21:34:4e", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d7432d-bb", "ovs_interfaceid": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:10:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-efc7b701-d2a1-4f37-90e3-912e1f291278 req-b45bf54f-d314-4f2f-9a74-82757da44543 service nova] Releasing lock "refresh_cache-d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:10:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:25 user nova-compute[74611]: DEBUG nova.objects.instance [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'flavor' on Instance uuid d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:26 user nova-compute[74611]: INFO nova.compute.manager [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Attaching volume 7650f1c5-6161-41ca-891d-3c95af6ae1cb to /dev/vdb
Nov 13 10:10:26 user nova-compute[74611]: DEBUG os_brick.utils [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc4c54b-8d7e-44aa-9e08-cc5b9f4a9c99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78ef73d-3f23-46b1-aba1-1398ec7179dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d01c6e8-885f-4aa3-a8c2-7d33a8a9a725]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e2ddb1-bc12-4987-b40e-95d2c9dc2d9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:10:26 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:10:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5a2b18-1c48-4ff8-ab9a-b9d2aaf688e8]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG os_brick.utils [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:10:26 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Updating existing volume attachment record: df1c70b7-9df7-4f44-905e-80cb2bf1b905 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:10:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-02e28326-620a-4222-bbb0-6f94c3258be9 req-9e0e94a6-fdea-44bf-b974-a77ca80328cc service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Received event network-changed-745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-02e28326-620a-4222-bbb0-6f94c3258be9 req-9e0e94a6-fdea-44bf-b974-a77ca80328cc service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Refreshing instance network info cache due to event network-changed-745f6db3-f361-4030-a4cb-03ce5f561662. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:10:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-02e28326-620a-4222-bbb0-6f94c3258be9 req-9e0e94a6-fdea-44bf-b974-a77ca80328cc service nova] Acquiring lock "refresh_cache-0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:10:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-02e28326-620a-4222-bbb0-6f94c3258be9 req-9e0e94a6-fdea-44bf-b974-a77ca80328cc service nova] Acquired lock "refresh_cache-0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:10:27 user nova-compute[74611]: DEBUG nova.network.neutron [req-02e28326-620a-4222-bbb0-6f94c3258be9 req-9e0e94a6-fdea-44bf-b974-a77ca80328cc service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Refreshing network info cache for port 745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:10:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:27 user nova-compute[74611]: INFO nova.compute.manager [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Terminating instance
Nov 13 10:10:27 user nova-compute[74611]: DEBUG nova.compute.manager [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:10:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:28 user nova-compute[74611]: INFO nova.compute.manager [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Terminating instance
Nov 13 10:10:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-4be71ce4-9393-4bce-af8e-7ab39f850d85 req-96ce6fce-4489-4e9c-80e6-f28166d3b499 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Received event network-vif-unplugged-745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4be71ce4-9393-4bce-af8e-7ab39f850d85 req-96ce6fce-4489-4e9c-80e6-f28166d3b499 service nova] Acquiring lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4be71ce4-9393-4bce-af8e-7ab39f850d85 req-96ce6fce-4489-4e9c-80e6-f28166d3b499 service nova] Lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4be71ce4-9393-4bce-af8e-7ab39f850d85 req-96ce6fce-4489-4e9c-80e6-f28166d3b499 service nova] Lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-4be71ce4-9393-4bce-af8e-7ab39f850d85 req-96ce6fce-4489-4e9c-80e6-f28166d3b499 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] No waiting events found dispatching network-vif-unplugged-745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-4be71ce4-9393-4bce-af8e-7ab39f850d85 req-96ce6fce-4489-4e9c-80e6-f28166d3b499 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Received event network-vif-unplugged-745f6db3-f361-4030-a4cb-03ce5f561662 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG nova.network.neutron [req-02e28326-620a-4222-bbb0-6f94c3258be9 req-9e0e94a6-fdea-44bf-b974-a77ca80328cc service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Updated VIF entry in instance network info cache for port 745f6db3-f361-4030-a4cb-03ce5f561662. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG nova.network.neutron [req-02e28326-620a-4222-bbb0-6f94c3258be9 req-9e0e94a6-fdea-44bf-b974-a77ca80328cc service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Updating instance_info_cache with network_info: [{"id": "745f6db3-f361-4030-a4cb-03ce5f561662", "address": "fa:16:3e:8c:c7:a4", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745f6db3-f3", "ovs_interfaceid": "745f6db3-f361-4030-a4cb-03ce5f561662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-02e28326-620a-4222-bbb0-6f94c3258be9 req-9e0e94a6-fdea-44bf-b974-a77ca80328cc service nova] Releasing lock "refresh_cache-0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:10:28 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Instance destroyed successfully.
Nov 13 10:10:28 user nova-compute[74611]: DEBUG nova.objects.instance [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lazy-loading 'resources' on Instance uuid 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1270398425',display_name='tempest-TestVolumeBootPattern-server-1270398425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1270398425',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjRXcM+iAZvLJco7tBubak1kGHq/45jJ2KKO6E3tr61cFQKM/YqE/xURoOe/LdnL01vr4FH+cPhy0FHq1+WQre34a6xvIem5nHqznPEd2v959ht3Wgct9dv/En52XotjA==',key_name='tempest-TestVolumeBootPattern-1763350711',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:05:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f12e0c04622143f2a0c24258ab90e153',ramdisk_id='',reservation_id='r-m1matkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-633061604',owner_user_name='tempest-TestVolumeBootPattern-633061604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:05:55Z,user_data=None,user_id='91e7d88000c1476abfb0df6bfca4e0fb',uuid=0a689a12-e4c3-4ed3-91e9-1fceb09f0c10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "745f6db3-f361-4030-a4cb-03ce5f561662", "address": "fa:16:3e:8c:c7:a4", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745f6db3-f3", "ovs_interfaceid": "745f6db3-f361-4030-a4cb-03ce5f561662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converting VIF {"id": "745f6db3-f361-4030-a4cb-03ce5f561662", "address": "fa:16:3e:8c:c7:a4", "network": {"id": "c94b1136-0ec9-407a-a87d-3411838877fa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1357663878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f12e0c04622143f2a0c24258ab90e153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745f6db3-f3", "ovs_interfaceid": "745f6db3-f361-4030-a4cb-03ce5f561662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:c7:a4,bridge_name='br-int',has_traffic_filtering=True,id=745f6db3-f361-4030-a4cb-03ce5f561662,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745f6db3-f3') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_vif [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:c7:a4,bridge_name='br-int',has_traffic_filtering=True,id=745f6db3-f361-4030-a4cb-03ce5f561662,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745f6db3-f3') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap745f6db3-f3, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7929cad6-d448-480e-8db3-459530f86b60) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:28 user nova-compute[74611]: INFO os_vif [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:c7:a4,bridge_name='br-int',has_traffic_filtering=True,id=745f6db3-f361-4030-a4cb-03ce5f561662,network=Network(c94b1136-0ec9-407a-a87d-3411838877fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745f6db3-f3')
Nov 13 10:10:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbIUounm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:10:28 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6211bc84-aa52-437a-9049-2e581036440c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:10:28 user nova-compute[74611]: No targets found.
Nov 13 10:10:28 user nova-compute[74611]: iSNS:
Nov 13 10:10:28 user nova-compute[74611]: No targets found.
Nov 13 10:10:28 user nova-compute[74611]: STATIC:
Nov 13 10:10:28 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc
Nov 13 10:10:28 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:10:28 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:10:28 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd
Nov 13 10:10:28 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:10:28 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:10:28 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd
Nov 13 10:10:28 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:10:28 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:10:28 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:10:28 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:10:28 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:10:28 user nova-compute[74611]: FIRMWARE:
Nov 13 10:10:28 user nova-compute[74611]: No targets found.
Nov 13 10:10:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:10:28 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:10:28 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[823fa810-37cb-42a5-9cd6-3e8eab5f5db7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f804433-e37c-4bb9-8b7a-ade41ef2e4b6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:10:28 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:10:28 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:10:28 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:10:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:10:28 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:10:28 user nova-compute[74611]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd (non-flash)
Nov 13 10:10:28 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:10:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7c2b4550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd'): ({'sdg'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Removing single pathed devices sdg {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c34a60-2d10-4a26-9e35-31d3e1953475]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[84afe671-55d4-40b7-aa26-97fa74276b06]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Flushing IO for device /dev/sdg {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3da2e8-0ff7-4003-9c49-2840a5577057]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.056s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da82324-0e79-4233-955e-adb98f1d6d49]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] SCSI volumes sdg have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO598514af-34cf93829e5b78d9', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_598514af', '/dev/disk/by-id/scsi-23334636639333832') {{(pid=85776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d00714-392f-43aa-90f9-6fa41abd9e18]: (4, None) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0408b8-174b-4931-86d2-a2595b6758a4]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:29 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Instance destroyed successfully.
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.objects.instance [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lazy-loading 'resources' on Instance uuid ccd219ab-ccdc-4eee-a7d4-484e3cc597c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-263488679',display_name='tempest-ServerRescueNegativeTestJSON-server-263488679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-263488679',id=1,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae9ab18bb67e4db19e6c3366771ad218',ramdisk_id='',reservation_id='r-ldcvdrmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-961432289',owner_user_name='tempest-ServerRescueNegativeTestJSON-961432289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:00:21Z,user_data=None,user_id='863471360be04ab5acb07ef3e99007c4',uuid=ccd219ab-ccdc-4eee-a7d4-484e3cc597c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converting VIF {"id": "18262a82-8847-4594-98ce-2ad50387fbf2", "address": "fa:16:3e:47:7e:57", "network": {"id": "23113158-c507-4f70-8650-961e365d3dc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1006166631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae9ab18bb67e4db19e6c3366771ad218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18262a82-88", "ovs_interfaceid": "18262a82-8847-4594-98ce-2ad50387fbf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:7e:57,bridge_name='br-int',has_traffic_filtering=True,id=18262a82-8847-4594-98ce-2ad50387fbf2,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18262a82-88') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG os_vif [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:7e:57,bridge_name='br-int',has_traffic_filtering=True,id=18262a82-8847-4594-98ce-2ad50387fbf2,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18262a82-88') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18262a82-88, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=030abefa-033f-415f-be20-853fc03372cd) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:29 user nova-compute[74611]: INFO os_vif [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:7e:57,bridge_name='br-int',has_traffic_filtering=True,id=18262a82-8847-4594-98ce-2ad50387fbf2,network=Network(23113158-c507-4f70-8650-961e365d3dc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18262a82-88')
Nov 13 10:10:29 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Deleting instance files /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6_del
Nov 13 10:10:29 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Deletion of /opt/stack/data/nova/instances/ccd219ab-ccdc-4eee-a7d4-484e3cc597c6_del complete
Nov 13 10:10:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[148beaad-2f2c-44d0-aa3f-5d000e6e90cb]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd, portal: 172.16.0.220,3260]
Nov 13 10:10:29 user nova-compute[74611]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd, portal: 172.16.0.220,3260] successful.
Nov 13 10:10:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:187e682d-b203-4996-8b12-6a3d1c4447fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d993ad1-a635-4139-be08-3c1775a20e0c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] <== disconnect_volume: return (380ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:10:29 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Deleting instance files /opt/stack/data/nova/instances/0a689a12-e4c3-4ed3-91e9-1fceb09f0c10_del
Nov 13 10:10:29 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Deletion of /opt/stack/data/nova/instances/0a689a12-e4c3-4ed3-91e9-1fceb09f0c10_del complete
Nov 13 10:10:29 user nova-compute[74611]: INFO nova.compute.manager [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 13 10:10:29 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:10:29 user nova-compute[74611]: INFO nova.compute.manager [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 13 10:10:29 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:10:29 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Took 0.47 seconds to deallocate network for instance.
Nov 13 10:10:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:10:29 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Took 0.49 seconds to deallocate network for instance.
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-8c9a17e9-4916-4f33-a6d2-d9a7be273a05 req-06d1dc8f-8891-45f0-ba67-4a6cbff467a9 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Received event network-vif-deleted-745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:29 user nova-compute[74611]: INFO nova.compute.manager [req-8c9a17e9-4916-4f33-a6d2-d9a7be273a05 req-06d1dc8f-8891-45f0-ba67-4a6cbff467a9 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Neutron deleted interface 745f6db3-f361-4030-a4cb-03ce5f561662; detaching it from the instance and deleting it from the info cache
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.network.neutron [req-8c9a17e9-4916-4f33-a6d2-d9a7be273a05 req-06d1dc8f-8891-45f0-ba67-4a6cbff467a9 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-8c9a17e9-4916-4f33-a6d2-d9a7be273a05 req-06d1dc8f-8891-45f0-ba67-4a6cbff467a9 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Detach interface failed, port_id=745f6db3-f361-4030-a4cb-03ce5f561662, reason: Instance 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10 could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-fa53cc20-397f-4ed0-b170-30edf99826b3 req-7c8ea92d-f95b-4d54-8769-fa75f81fe41a service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received event network-vif-unplugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fa53cc20-397f-4ed0-b170-30edf99826b3 req-7c8ea92d-f95b-4d54-8769-fa75f81fe41a service nova] Acquiring lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fa53cc20-397f-4ed0-b170-30edf99826b3 req-7c8ea92d-f95b-4d54-8769-fa75f81fe41a service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fa53cc20-397f-4ed0-b170-30edf99826b3 req-7c8ea92d-f95b-4d54-8769-fa75f81fe41a service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-fa53cc20-397f-4ed0-b170-30edf99826b3 req-7c8ea92d-f95b-4d54-8769-fa75f81fe41a service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] No waiting events found dispatching network-vif-unplugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:10:29 user nova-compute[74611]: WARNING nova.compute.manager [req-fa53cc20-397f-4ed0-b170-30edf99826b3 req-7c8ea92d-f95b-4d54-8769-fa75f81fe41a service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received unexpected event network-vif-unplugged-18262a82-8847-4594-98ce-2ad50387fbf2 for instance with vm_state deleted and task_state None.
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-fa53cc20-397f-4ed0-b170-30edf99826b3 req-7c8ea92d-f95b-4d54-8769-fa75f81fe41a service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fa53cc20-397f-4ed0-b170-30edf99826b3 req-7c8ea92d-f95b-4d54-8769-fa75f81fe41a service nova] Acquiring lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fa53cc20-397f-4ed0-b170-30edf99826b3 req-7c8ea92d-f95b-4d54-8769-fa75f81fe41a service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-fa53cc20-397f-4ed0-b170-30edf99826b3 req-7c8ea92d-f95b-4d54-8769-fa75f81fe41a service nova] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-fa53cc20-397f-4ed0-b170-30edf99826b3 req-7c8ea92d-f95b-4d54-8769-fa75f81fe41a service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] No waiting events found dispatching network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:10:29 user nova-compute[74611]: WARNING nova.compute.manager [req-fa53cc20-397f-4ed0-b170-30edf99826b3 req-7c8ea92d-f95b-4d54-8769-fa75f81fe41a service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received unexpected event network-vif-plugged-18262a82-8847-4594-98ce-2ad50387fbf2 for instance with vm_state deleted and task_state None.
Nov 13 10:10:29 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:30 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Deleted allocations for instance ccd219ab-ccdc-4eee-a7d4-484e3cc597c6
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cd70053e-7c58-45ec-ad5f-17a09c8ef881 tempest-ServerRescueNegativeTestJSON-961432289 tempest-ServerRescueNegativeTestJSON-961432289-project-member] Lock "ccd219ab-ccdc-4eee-a7d4-484e3cc597c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.979s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-1fc32807-644b-4c45-8144-accde3f2bd91 req-70ef90d6-1b09-4e2d-a2f3-041ccc102c51 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Received event network-vif-plugged-745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1fc32807-644b-4c45-8144-accde3f2bd91 req-70ef90d6-1b09-4e2d-a2f3-041ccc102c51 service nova] Acquiring lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1fc32807-644b-4c45-8144-accde3f2bd91 req-70ef90d6-1b09-4e2d-a2f3-041ccc102c51 service nova] Lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1fc32807-644b-4c45-8144-accde3f2bd91 req-70ef90d6-1b09-4e2d-a2f3-041ccc102c51 service nova] Lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-1fc32807-644b-4c45-8144-accde3f2bd91 req-70ef90d6-1b09-4e2d-a2f3-041ccc102c51 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] No waiting events found dispatching network-vif-plugged-745f6db3-f361-4030-a4cb-03ce5f561662 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:10:30 user nova-compute[74611]: WARNING nova.compute.manager [req-1fc32807-644b-4c45-8144-accde3f2bd91 req-70ef90d6-1b09-4e2d-a2f3-041ccc102c51 service nova] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Received unexpected event network-vif-plugged-745f6db3-f361-4030-a4cb-03ce5f561662 for instance with vm_state active and task_state deleting.
Nov 13 10:10:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-1fc32807-644b-4c45-8144-accde3f2bd91 req-70ef90d6-1b09-4e2d-a2f3-041ccc102c51 service nova] [instance: ccd219ab-ccdc-4eee-a7d4-484e3cc597c6] Received event network-vif-deleted-18262a82-8847-4594-98ce-2ad50387fbf2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:30 user nova-compute[74611]: INFO nova.compute.manager [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] [instance: 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10] Took 0.81 seconds to detach 1 volumes for instance.
Nov 13 10:10:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YKgPWNRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:10:30 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:10:30 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:10:30 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e918ff5-00cb-4c95-ad04-cf4217ac0a1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:10:30 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aef3862-6057-4426-a547-e941473fbc7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb] added
Nov 13 10:10:30 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e02ccd3-685e-41ba-a85a-4280819d0df9]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4411c298-778a-401a-8b4a-de5b124586be]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YKgPWNRH {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YKgPWNRH" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[91803843-7efe-41dd-a38b-61a3c8d67234]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YKgPWNRH'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[46833ee2-edcc-4094-ae11-b44044164ee5]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fe3902-a10c-40a6-a04c-1b14dc2e08c1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:10:30 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:10:30 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:10:30 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:10:30 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:10:30 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:10:30 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8259cc3-042f-4359-89a5-5c6342a96199]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb, portal: 172.16.0.220,3260]
Nov 13 10:10:30 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb, portal: 172.16.0.220,3260] successful.
Nov 13 10:10:30 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ccfb65-274f-4ee0-942a-d812a5f87e92]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[54624e44-0fdf-4f20-9333-1be849d3f17d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:10:30 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:10:30 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:10:30 user nova-compute[74611]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb (non-flash)
Nov 13 10:10:30 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:10:30 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:10:30 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:10:30 user nova-compute[74611]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb (non-flash)
Nov 13 10:10:30 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[06268806-678d-4432-a4a9-e18b0ce911a0]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YKgPWNRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:30 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Deleted allocations for instance 0a689a12-e4c3-4ed3-91e9-1fceb09f0c10
Nov 13 10:10:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-27486c10-26e2-49f0-b81e-fec9b5a59f6a tempest-TestVolumeBootPattern-633061604 tempest-TestVolumeBootPattern-633061604-project-member] Lock "0a689a12-e4c3-4ed3-91e9-1fceb09f0c10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.178s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:10:31 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26534646365616333', 'path': '/dev/sde'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:10:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534646365616333', 'path': '/dev/sde'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:10:31 user nova-compute[74611]: DEBUG nova.objects.instance [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'flavor' on Instance uuid d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:10:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:10:31 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:10:31 user nova-compute[74611]:   <source dev="/dev/sde"/>
Nov 13 10:10:31 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:10:31 user nova-compute[74611]:   <serial>7650f1c5-6161-41ca-891d-3c95af6ae1cb</serial>
Nov 13 10:10:31 user nova-compute[74611]: </disk>
Nov 13 10:10:31 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:10:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:10:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:10:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] No VIF found with MAC fa:16:3e:21:34:4e, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:10:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-67c4e157-3463-44f2-a7b5-edfabb46cefa tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.412s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG nova.objects.instance [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'flavor' on Instance uuid d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.128s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:34 user nova-compute[74611]: INFO nova.compute.manager [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Attaching volume e4ded1d5-6fc7-45f1-8305-420755af9867 to /dev/vdc
Nov 13 10:10:34 user nova-compute[74611]: DEBUG os_brick.utils [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2ef1b4-9d61-44c9-ab4b-d4dbcc7776bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cc27ac-fdc0-419b-b007-3bf8ed68c4ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db1cf9a-23c3-446e-b045-24f6d57ffe3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[17655641-fce8-4b5d-b906-0a911a0168aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:10:34 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:10:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5b5d86-4e83-4fd7-98cb-0e3dcda5f287]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG os_brick.utils [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:10:34 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Updating existing volume attachment record: 9f507289-7e3a-49ce-840f-f34e8ce47a4a {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUvEqhtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:10:38 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:10:38 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:10:38 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[849c53f1-8e32-4abe-9edf-8603dfadd25d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:10:38 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6bcb9c-57d2-4bc2-a284-cd0407d6ad82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867] added
Nov 13 10:10:38 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be5081e-9ac3-40ca-a591-b80f6292b697]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d45977-a655-4749-96fa-4622598f4a79]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dUvEqhtm {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dUvEqhtm" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dab01d-25bf-4cf8-9fe7-1e0fd9ecd7eb]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dUvEqhtm'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdcbc1b-cddd-4fdc-b24e-daf76661f313]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea400c6-f76c-46ef-bb66-7210ca5f190a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:10:38 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:10:38 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:10:38 user nova-compute[74611]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb (non-flash)
Nov 13 10:10:38 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:10:38 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:10:38 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:10:38 user nova-compute[74611]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb (non-flash)
Nov 13 10:10:38 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b180a31-c9d6-4f99-a7a0-2efb44b8f45a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867, portal: 172.16.0.220,3260]
Nov 13 10:10:38 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867, portal: 172.16.0.220,3260] successful.
Nov 13 10:10:38 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9ecb48-c42d-4abf-96c6-11d7452f8e3f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3745de32-25f1-4af2-864a-859ae7f8055a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:10:38 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:10:38 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:10:38 user nova-compute[74611]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb (non-flash)
Nov 13 10:10:38 user nova-compute[74611]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)
Nov 13 10:10:38 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:10:38 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:10:38 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:10:38 user nova-compute[74611]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb (non-flash)
Nov 13 10:10:38 user nova-compute[74611]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)
Nov 13 10:10:38 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] HCTL ('37', '-', '-', 0) found on session 45 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:10:38 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:39 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:39 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9b358d-9508-4ab2-b5a0-534672d76b64]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:39 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:10:39 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUvEqhtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:10:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:10:40 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26137663334326461', 'path': '/dev/sdf'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:10:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137663334326461', 'path': '/dev/sdf'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:10:40 user nova-compute[74611]: DEBUG nova.objects.instance [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'flavor' on Instance uuid d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:10:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:10:40 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:10:40 user nova-compute[74611]:   <source dev="/dev/sdf"/>
Nov 13 10:10:40 user nova-compute[74611]:   <target dev="vdc" bus="virtio"/>
Nov 13 10:10:40 user nova-compute[74611]:   <serial>e4ded1d5-6fc7-45f1-8305-420755af9867</serial>
Nov 13 10:10:40 user nova-compute[74611]: </disk>
Nov 13 10:10:40 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:10:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:10:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:10:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:10:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] No VIF found with MAC fa:16:3e:21:34:4e, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:10:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a3c07e3b-f9c8-44ce-b265-258fdeaf5165 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.111s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:41 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:41 user nova-compute[74611]: INFO nova.compute.manager [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Detaching volume 7650f1c5-6161-41ca-891d-3c95af6ae1cb
Nov 13 10:10:41 user nova-compute[74611]: INFO nova.virt.block_device [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Attempting to driver detach volume 7650f1c5-6161-41ca-891d-3c95af6ae1cb from mountpoint /dev/vdb
Nov 13 10:10:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Attempting to detach device vdb from instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:10:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:10:41 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:10:41 user nova-compute[74611]:   <source dev="/dev/sde"/>
Nov 13 10:10:41 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:10:41 user nova-compute[74611]:   <serial>7650f1c5-6161-41ca-891d-3c95af6ae1cb</serial>
Nov 13 10:10:41 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:10:41 user nova-compute[74611]: </disk>
Nov 13 10:10:41 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:10:41 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Successfully detached device vdb from instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 from the persistent domain config.
Nov 13 10:10:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:10:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:10:41 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:10:41 user nova-compute[74611]:   <source dev="/dev/sde"/>
Nov 13 10:10:41 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:10:41 user nova-compute[74611]:   <serial>7650f1c5-6161-41ca-891d-3c95af6ae1cb</serial>
Nov 13 10:10:41 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:10:41 user nova-compute[74611]: </disk>
Nov 13 10:10:41 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:10:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid 822a3afe-eae1-4960-b347-89c58fb10c4c {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid f059d809-84b0-40c4-be84-bc89a9dc182e {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid a05d41b7-4084-4be9-9c56-bcd01478c349 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid ed1dfac0-31b6-4e63-895e-29877e17d178 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "822a3afe-eae1-4960-b347-89c58fb10c4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "f059d809-84b0-40c4-be84-bc89a9dc182e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "a05d41b7-4084-4be9-9c56-bcd01478c349" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "a05d41b7-4084-4be9-9c56-bcd01478c349" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "ed1dfac0-31b6-4e63-895e-29877e17d178" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "a05d41b7-4084-4be9-9c56-bcd01478c349" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:44 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:10:44 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:10:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:10:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:10:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:10:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Updating instance_info_cache with network_info: [{"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:10:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-7c2479a4-1384-4845-86d8-b5fd26fa6ec4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:10:44 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:10:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "f059d809-84b0-40c4-be84-bc89a9dc182e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:46 user nova-compute[74611]: INFO nova.compute.manager [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Terminating instance
Nov 13 10:10:46 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:10:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:46 user nova-compute[74611]: DEBUG nova.compute.manager [req-8af61016-0156-408b-baa5-78d89b4dbabf req-5f6da820-cd74-4b03-a038-ff8b2d1aec7f service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received event network-vif-unplugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8af61016-0156-408b-baa5-78d89b4dbabf req-5f6da820-cd74-4b03-a038-ff8b2d1aec7f service nova] Acquiring lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8af61016-0156-408b-baa5-78d89b4dbabf req-5f6da820-cd74-4b03-a038-ff8b2d1aec7f service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8af61016-0156-408b-baa5-78d89b4dbabf req-5f6da820-cd74-4b03-a038-ff8b2d1aec7f service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:46 user nova-compute[74611]: DEBUG nova.compute.manager [req-8af61016-0156-408b-baa5-78d89b4dbabf req-5f6da820-cd74-4b03-a038-ff8b2d1aec7f service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] No waiting events found dispatching network-vif-unplugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:10:46 user nova-compute[74611]: DEBUG nova.compute.manager [req-8af61016-0156-408b-baa5-78d89b4dbabf req-5f6da820-cd74-4b03-a038-ff8b2d1aec7f service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received event network-vif-unplugged-0a10fea9-0757-4257-b637-952cffdf0114 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:10:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:47 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Instance destroyed successfully.
Nov 13 10:10:47 user nova-compute[74611]: DEBUG nova.objects.instance [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'resources' on Instance uuid f059d809-84b0-40c4-be84-bc89a9dc182e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:05:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1569409365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1569409365',id=35,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:07:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83e3b3233a5b43d682200d91f29a80b4',ramdisk_id='',reservation_id='r-nt3djo2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-182847603',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:09:01Z,user_data=None,user_id='6bc911a5649643a6a3606d8b80e20eb0',uuid=f059d809-84b0-40c4-be84-bc89a9dc182e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a10fea9-0757-4257-b637-952cffdf0114", "address": "fa:16:3e:21:cf:80", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a10fea9-07", "ovs_interfaceid": "0a10fea9-0757-4257-b637-952cffdf0114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converting VIF {"id": "0a10fea9-0757-4257-b637-952cffdf0114", "address": "fa:16:3e:21:cf:80", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a10fea9-07", "ovs_interfaceid": "0a10fea9-0757-4257-b637-952cffdf0114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:cf:80,bridge_name='br-int',has_traffic_filtering=True,id=0a10fea9-0757-4257-b637-952cffdf0114,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a10fea9-07') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_vif [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:cf:80,bridge_name='br-int',has_traffic_filtering=True,id=0a10fea9-0757-4257-b637-952cffdf0114,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a10fea9-07') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a10fea9-07, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2315d59d-9799-4ddb-8142-499c2bfb1a62) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:47 user nova-compute[74611]: INFO os_vif [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:cf:80,bridge_name='br-int',has_traffic_filtering=True,id=0a10fea9-0757-4257-b637-952cffdf0114,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a10fea9-07')
Nov 13 10:10:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGfSLFTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:10:47 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a134fe5-6ceb-46db-a5f3-44dff75c48b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:10:47 user nova-compute[74611]: No targets found.
Nov 13 10:10:47 user nova-compute[74611]: iSNS:
Nov 13 10:10:47 user nova-compute[74611]: No targets found.
Nov 13 10:10:47 user nova-compute[74611]: STATIC:
Nov 13 10:10:47 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc
Nov 13 10:10:47 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:10:47 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:10:47 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867
Nov 13 10:10:47 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:10:47 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:10:47 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb
Nov 13 10:10:47 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:10:47 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:10:47 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd
Nov 13 10:10:47 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:10:47 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:10:47 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:10:47 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:10:47 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:10:47 user nova-compute[74611]: FIRMWARE:
Nov 13 10:10:47 user nova-compute[74611]: No targets found.
Nov 13 10:10:47 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:10:47 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:10:47 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd1a534-1d01-4d0a-a94d-d243c541a37c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50f5170-d148-4e91-9842-cdb7733459ea]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:10:47 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:10:47 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:10:47 user nova-compute[74611]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb (non-flash)
Nov 13 10:10:47 user nova-compute[74611]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)
Nov 13 10:10:47 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:10:47 user nova-compute[74611]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc (non-flash)
Nov 13 10:10:47 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:10:47 user nova-compute[74611]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb (non-flash)
Nov 13 10:10:47 user nova-compute[74611]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)
Nov 13 10:10:47 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb646848b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc'): ({'sdd'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Removing single pathed devices sdd {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04e3acb-3e12-4559-b25c-7b0d4e5661b9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59f92e9-b5c6-4643-be37-138630a9f31f]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Flushing IO for device /dev/sdd {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c856099f-3266-47b6-bb3c-238f2d73cac5]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99fa422-de60-4005-b8be-0b04716239f0]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] SCSI volumes sdd have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6b6b3a-f64d-40e2-85ed-388c5bb066a2]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be7687a-7ab4-43e9-8373-220f91d5951c]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc, portal: 172.16.0.220,3260]
Nov 13 10:10:47 user nova-compute[74611]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc, portal: 172.16.0.220,3260] successful.
Nov 13 10:10:47 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5f13810-d007-4cd9-ad7f-21f7c3b51dfc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d33c97-fb75-46be-93bb-6b1ec22aab2d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] <== disconnect_volume: return (335ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:10:47 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Deleting instance files /opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e_del
Nov 13 10:10:47 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Deletion of /opt/stack/data/nova/instances/f059d809-84b0-40c4-be84-bc89a9dc182e_del complete
Nov 13 10:10:47 user nova-compute[74611]: INFO nova.compute.manager [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 13 10:10:47 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:10:47 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:10:48 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Took 0.54 seconds to deallocate network for instance.
Nov 13 10:10:48 user nova-compute[74611]: DEBUG nova.compute.manager [req-5f9db648-3e9e-4af0-860d-b4a8d14a1747 req-f648d023-5403-498e-90d3-0e62d343e571 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5f9db648-3e9e-4af0-860d-b4a8d14a1747 req-f648d023-5403-498e-90d3-0e62d343e571 service nova] Acquiring lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5f9db648-3e9e-4af0-860d-b4a8d14a1747 req-f648d023-5403-498e-90d3-0e62d343e571 service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5f9db648-3e9e-4af0-860d-b4a8d14a1747 req-f648d023-5403-498e-90d3-0e62d343e571 service nova] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:48 user nova-compute[74611]: DEBUG nova.compute.manager [req-5f9db648-3e9e-4af0-860d-b4a8d14a1747 req-f648d023-5403-498e-90d3-0e62d343e571 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] No waiting events found dispatching network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:10:48 user nova-compute[74611]: WARNING nova.compute.manager [req-5f9db648-3e9e-4af0-860d-b4a8d14a1747 req-f648d023-5403-498e-90d3-0e62d343e571 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received unexpected event network-vif-plugged-0a10fea9-0757-4257-b637-952cffdf0114 for instance with vm_state active and task_state deleting.
Nov 13 10:10:48 user nova-compute[74611]: DEBUG nova.compute.manager [req-5f9db648-3e9e-4af0-860d-b4a8d14a1747 req-f648d023-5403-498e-90d3-0e62d343e571 service nova] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Received event network-vif-deleted-0a10fea9-0757-4257-b637-952cffdf0114 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:48 user nova-compute[74611]: INFO nova.compute.manager [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f059d809-84b0-40c4-be84-bc89a9dc182e] Took 0.73 seconds to detach 1 volumes for instance.
Nov 13 10:10:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:49 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:10:49 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:10:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:49 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Deleted allocations for instance f059d809-84b0-40c4-be84-bc89a9dc182e
Nov 13 10:10:49 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:10:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7dcd84e7-2189-4c07-a831-be4c5e54fd8b tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f059d809-84b0-40c4-be84-bc89a9dc182e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:50 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:10:50 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:10:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:10:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:10:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:10:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:54 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:10:55 user nova-compute[74611]: DEBUG nova.compute.manager [req-ece12ea2-ca08-4dc0-a7ae-daf4693b352c req-dc121dee-df97-4745-a9ac-568fb932d831 service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Received event network-changed-9fa1d68a-42d8-4e69-9863-ff60ec956664 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:10:55 user nova-compute[74611]: DEBUG nova.compute.manager [req-ece12ea2-ca08-4dc0-a7ae-daf4693b352c req-dc121dee-df97-4745-a9ac-568fb932d831 service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Refreshing instance network info cache due to event network-changed-9fa1d68a-42d8-4e69-9863-ff60ec956664. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:10:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ece12ea2-ca08-4dc0-a7ae-daf4693b352c req-dc121dee-df97-4745-a9ac-568fb932d831 service nova] Acquiring lock "refresh_cache-ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:10:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ece12ea2-ca08-4dc0-a7ae-daf4693b352c req-dc121dee-df97-4745-a9ac-568fb932d831 service nova] Acquired lock "refresh_cache-ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:10:55 user nova-compute[74611]: DEBUG nova.network.neutron [req-ece12ea2-ca08-4dc0-a7ae-daf4693b352c req-dc121dee-df97-4745-a9ac-568fb932d831 service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Refreshing network info cache for port 9fa1d68a-42d8-4e69-9863-ff60ec956664 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:10:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:56 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:10:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:56 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:10:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:56 user nova-compute[74611]: DEBUG nova.network.neutron [req-ece12ea2-ca08-4dc0-a7ae-daf4693b352c req-dc121dee-df97-4745-a9ac-568fb932d831 service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Updated VIF entry in instance network info cache for port 9fa1d68a-42d8-4e69-9863-ff60ec956664. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:10:56 user nova-compute[74611]: DEBUG nova.network.neutron [req-ece12ea2-ca08-4dc0-a7ae-daf4693b352c req-dc121dee-df97-4745-a9ac-568fb932d831 service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Updating instance_info_cache with network_info: [{"id": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "address": "fa:16:3e:8c:f7:c5", "network": {"id": "a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1029865477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "282fac4cc8704e0f985ab149c35aaf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa1d68a-42", "ovs_interfaceid": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:10:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ece12ea2-ca08-4dc0-a7ae-daf4693b352c req-dc121dee-df97-4745-a9ac-568fb932d831 service nova] Releasing lock "refresh_cache-ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:10:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:10:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:56 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:10:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG nova.objects.instance [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lazy-loading 'flavor' on Instance uuid ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.143s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:58 user nova-compute[74611]: INFO nova.compute.manager [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Attaching volume efbf76fd-e81a-4e79-8e38-7e996e08d461 to /dev/vdb
Nov 13 10:10:58 user nova-compute[74611]: DEBUG os_brick.utils [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff84ad58-e609-4412-ace5-d2f6744cd43b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0d3b05-cdc3-4e36-ab04-4b355bd27537]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23e546b-fd34-4c9d-942f-e440ab509654]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd07647e-3eb7-4776-9074-12f15a362d0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:10:58 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54e5c88-1082-4a9d-b526-3446cdbf47ae]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG os_brick.utils [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Updating existing volume attachment record: eeac6e9a-c9ef-4ab6-9be8-7a67acc12a26 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:10:59 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:10:59 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:10:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=7857MB free_disk=25.088314056396484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance a05d41b7-4084-4be9-9c56-bcd01478c349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ed1dfac0-31b6-4e63-895e-29877e17d178 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:10:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:01 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:11:01 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 is timed out.
Nov 13 10:11:01 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Successfully detached device vdb from instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 from the live domain config.
Nov 13 10:11:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:11:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YKgPWNRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:11:01 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:11:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:11:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:11:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e59243a-8621-43d2-90fe-756b5d9a8de0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:11:01 user nova-compute[74611]: No targets found.
Nov 13 10:11:01 user nova-compute[74611]: iSNS:
Nov 13 10:11:01 user nova-compute[74611]: No targets found.
Nov 13 10:11:01 user nova-compute[74611]: STATIC:
Nov 13 10:11:01 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867
Nov 13 10:11:01 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:11:01 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:11:01 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb
Nov 13 10:11:01 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:11:01 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:11:01 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd
Nov 13 10:11:01 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:11:01 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:11:01 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:11:01 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:11:01 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:11:01 user nova-compute[74611]: FIRMWARE:
Nov 13 10:11:01 user nova-compute[74611]: No targets found.
Nov 13 10:11:01 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:11:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:11:01 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:11:01 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:11:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:11:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a10ad56-a0cd-49aa-b5fc-2c15942fa198]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d023d65-8150-41ff-8b6c-5e259e243ac6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:11:02 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:11:02 user nova-compute[74611]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb (non-flash)
Nov 13 10:11:02 user nova-compute[74611]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)
Nov 13 10:11:02 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:11:02 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:11:02 user nova-compute[74611]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb (non-flash)
Nov 13 10:11:02 user nova-compute[74611]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)
Nov 13 10:11:02 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb645cd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb'): ({'sde'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Removing single pathed devices sde {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f85abb4-6d1c-40af-bf4a-bb403ab23152]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc2c324-bba0-461e-8144-51276b40ef1a]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Flushing IO for device /dev/sde {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d63003-0658-4d20-9210-56194d721d96]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3520b9-d363-43e0-b021-68f87de4adee]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] SCSI volumes sde have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f12476-acf6-46d6-9651-857d3f44bc1c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[891bdb87-5087-40f0-b2df-310b78569894]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb, portal: 172.16.0.220,3260]
Nov 13 10:11:02 user nova-compute[74611]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb, portal: 172.16.0.220,3260] successful.
Nov 13 10:11:02 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7650f1c5-6161-41ca-891d-3c95af6ae1cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[69318f12-d91f-4f1b-9de0-ce3f5d34ea90]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] <== disconnect_volume: return (326ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBYqkGsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:11:02 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:11:02 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:11:02 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eeabe8-86ee-4873-a9d2-8bd71811a7c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:11:02 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90f7742-423a-479f-a59f-f4ec25ee9a00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461] added
Nov 13 10:11:02 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d2fb4e-bc42-4100-b7fa-072f5dd23c5e]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[123102c6-61f6-44b2-817c-4b0469044f97]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBYqkGsA {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBYqkGsA" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d626e1-80f5-4a85-b1fa-b71c124b7f9e]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QBYqkGsA'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9941c345-b9ba-4530-87f2-d4ebb97f5b7a]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[be453cd0-8eaf-49e0-87cc-d5810520c28a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:11:02 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:11:02 user nova-compute[74611]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)
Nov 13 10:11:02 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:11:02 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:11:02 user nova-compute[74611]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)
Nov 13 10:11:02 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7627bc17-c749-4b8c-b056-9925bcd2a117]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461, portal: 172.16.0.220,3260]
Nov 13 10:11:02 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461, portal: 172.16.0.220,3260] successful.
Nov 13 10:11:02 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1474c7be-04f7-4b97-9428-1a4a7dc3d6ef]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a6fc03-5288-4462-886e-f437bfd181fb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:11:02 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:11:02 user nova-compute[74611]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)
Nov 13 10:11:02 user nova-compute[74611]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 (non-flash)
Nov 13 10:11:02 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:11:02 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:11:02 user nova-compute[74611]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)
Nov 13 10:11:02 user nova-compute[74611]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 (non-flash)
Nov 13 10:11:02 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[05741fb3-190d-4b3a-a7b1-10a742d6670e]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:02 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:11:03 user nova-compute[74611]: DEBUG nova.objects.instance [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'flavor' on Instance uuid d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:11:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f5dd85d1-20c1-4c7e-8262-5d5d2920640f tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.638s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 20.602s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:03 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:11:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBYqkGsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:11:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:11:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23735633035653134', 'path': '/dev/sdd'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:11:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735633035653134', 'path': '/dev/sdd'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:11:03 user nova-compute[74611]: DEBUG nova.objects.instance [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lazy-loading 'flavor' on Instance uuid ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:11:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:11:03 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:11:03 user nova-compute[74611]:   <source dev="/dev/sdd"/>
Nov 13 10:11:03 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:11:03 user nova-compute[74611]:   <serial>efbf76fd-e81a-4e79-8e38-7e996e08d461</serial>
Nov 13 10:11:03 user nova-compute[74611]: </disk>
Nov 13 10:11:03 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:11:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:04 user nova-compute[74611]: INFO nova.compute.manager [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Detaching volume e4ded1d5-6fc7-45f1-8305-420755af9867
Nov 13 10:11:04 user nova-compute[74611]: INFO nova.virt.block_device [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Attempting to driver detach volume e4ded1d5-6fc7-45f1-8305-420755af9867 from mountpoint /dev/vdc
Nov 13 10:11:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Attempting to detach device vdc from instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:11:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:11:04 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:11:04 user nova-compute[74611]:   <source dev="/dev/sdf"/>
Nov 13 10:11:04 user nova-compute[74611]:   <target dev="vdc" bus="virtio"/>
Nov 13 10:11:04 user nova-compute[74611]:   <serial>e4ded1d5-6fc7-45f1-8305-420755af9867</serial>
Nov 13 10:11:04 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 10:11:04 user nova-compute[74611]: </disk>
Nov 13 10:11:04 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:11:04 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Successfully detached device vdc from instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 from the persistent domain config.
Nov 13 10:11:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:11:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:11:04 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:11:04 user nova-compute[74611]:   <source dev="/dev/sdf"/>
Nov 13 10:11:04 user nova-compute[74611]:   <target dev="vdc" bus="virtio"/>
Nov 13 10:11:04 user nova-compute[74611]:   <serial>e4ded1d5-6fc7-45f1-8305-420755af9867</serial>
Nov 13 10:11:04 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 10:11:04 user nova-compute[74611]: </disk>
Nov 13 10:11:04 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:11:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:11:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:11:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] No VIF found with MAC fa:16:3e:8c:f7:c5, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:11:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-97b5714d-8dde-4bdc-b82d-bb3e71f6b784 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.117s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:11:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:11 user nova-compute[74611]: INFO nova.compute.manager [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Detaching volume efbf76fd-e81a-4e79-8e38-7e996e08d461
Nov 13 10:11:11 user nova-compute[74611]: INFO nova.virt.block_device [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Attempting to driver detach volume efbf76fd-e81a-4e79-8e38-7e996e08d461 from mountpoint /dev/vdb
Nov 13 10:11:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Attempting to detach device vdb from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:11:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:11:11 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:11:11 user nova-compute[74611]:   <source dev="/dev/sdd"/>
Nov 13 10:11:11 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:11:11 user nova-compute[74611]:   <serial>efbf76fd-e81a-4e79-8e38-7e996e08d461</serial>
Nov 13 10:11:11 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:11:11 user nova-compute[74611]: </disk>
Nov 13 10:11:11 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:11:11 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Successfully detached device vdb from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 from the persistent domain config.
Nov 13 10:11:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:11:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:11:11 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:11:11 user nova-compute[74611]:   <source dev="/dev/sdd"/>
Nov 13 10:11:11 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:11:11 user nova-compute[74611]:   <serial>efbf76fd-e81a-4e79-8e38-7e996e08d461</serial>
Nov 13 10:11:11 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:11:11 user nova-compute[74611]: </disk>
Nov 13 10:11:11 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:11:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:11:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:24 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 is timed out.
Nov 13 10:11:24 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Successfully detached device vdc from instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 from the live domain config.
Nov 13 10:11:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUvEqhtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:11:24 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:11:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24fa4e3-f6c1-45fb-bb32-f0fe5850aa47]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:11:24 user nova-compute[74611]: No targets found.
Nov 13 10:11:24 user nova-compute[74611]: iSNS:
Nov 13 10:11:24 user nova-compute[74611]: No targets found.
Nov 13 10:11:24 user nova-compute[74611]: STATIC:
Nov 13 10:11:24 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461
Nov 13 10:11:24 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:11:24 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:11:24 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867
Nov 13 10:11:24 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:11:24 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:11:24 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd
Nov 13 10:11:24 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:11:24 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:11:24 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:11:24 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:11:24 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:11:24 user nova-compute[74611]: FIRMWARE:
Nov 13 10:11:24 user nova-compute[74611]: No targets found.
Nov 13 10:11:24 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:11:24 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:11:24 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac960167-c23a-49f3-ac56-ec6882903d21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc3efd7-25ca-48d8-8411-4ba1f0536839]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:11:24 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:11:24 user nova-compute[74611]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)
Nov 13 10:11:24 user nova-compute[74611]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 (non-flash)
Nov 13 10:11:24 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:11:24 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:11:24 user nova-compute[74611]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 (non-flash)
Nov 13 10:11:24 user nova-compute[74611]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 (non-flash)
Nov 13 10:11:24 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7c31a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867'): ({'sdf'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Removing single pathed devices sdf {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b1f717-8a87-474b-88e2-e5a39dd06d91]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ff16a4-d07e-4f4f-9b0d-caeb6e8a21b0]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Flushing IO for device /dev/sdf {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[03016898-e76a-4813-b930-833a5c246d8f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9d7480-5eb1-4e15-bfdd-940ebb1a4fc7]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] SCSI volumes sdf have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d152a76-a370-4458-bb57-d160fb43e6c5]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:25 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e08742-67ef-460a-8801-468f74d7492d]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867, portal: 172.16.0.220,3260]
Nov 13 10:11:25 user nova-compute[74611]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867, portal: 172.16.0.220,3260] successful.
Nov 13 10:11:25 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:25 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ded1d5-6fc7-45f1-8305-420755af9867 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:25 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[019d7773-aa6c-4247-9d91-6c40474964b0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:11:25 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] <== disconnect_volume: return (319ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:11:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:11:25 user nova-compute[74611]: DEBUG nova.objects.instance [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'flavor' on Instance uuid d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:11:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-f6f033bb-5992-40d4-b4ea-888e55752642 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.676s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:27 user nova-compute[74611]: INFO nova.compute.manager [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Terminating instance
Nov 13 10:11:27 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-6bd99fc9-dcec-498d-b7a5-8b3c0ce15a77 req-d1993100-5ee3-4a18-bb7e-276936bfa239 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Received event network-vif-unplugged-50d7432d-bbe3-4f65-ae8a-6cc8387ba245 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6bd99fc9-dcec-498d-b7a5-8b3c0ce15a77 req-d1993100-5ee3-4a18-bb7e-276936bfa239 service nova] Acquiring lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6bd99fc9-dcec-498d-b7a5-8b3c0ce15a77 req-d1993100-5ee3-4a18-bb7e-276936bfa239 service nova] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6bd99fc9-dcec-498d-b7a5-8b3c0ce15a77 req-d1993100-5ee3-4a18-bb7e-276936bfa239 service nova] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-6bd99fc9-dcec-498d-b7a5-8b3c0ce15a77 req-d1993100-5ee3-4a18-bb7e-276936bfa239 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] No waiting events found dispatching network-vif-unplugged-50d7432d-bbe3-4f65-ae8a-6cc8387ba245 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-6bd99fc9-dcec-498d-b7a5-8b3c0ce15a77 req-d1993100-5ee3-4a18-bb7e-276936bfa239 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Received event network-vif-unplugged-50d7432d-bbe3-4f65-ae8a-6cc8387ba245 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:27 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Instance destroyed successfully.
Nov 13 10:11:27 user nova-compute[74611]: DEBUG nova.objects.instance [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lazy-loading 'resources' on Instance uuid d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:08:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1888160213',display_name='tempest-AttachVolumeTestJSON-server-1888160213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1888160213',id=39,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP07Lia7GULD96z7/7DV5nHnvBOerl/zhC0aJ6VcWlyvIm4qGbKm2i4gw/It4+HQkooCdfDdCBItxzOl0jsjP3JmysLXaq7o2Nx0PWhdpPh0r4VY5ImpCTNWTJyqs/epIw==',key_name='tempest-keypair-509476253',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:08:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce3f0d3282d547249997fdad18cefc9c',ramdisk_id='',reservation_id='r-86fsezns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-658018398',owner_user_name='tempest-AttachVolumeTestJSON-658018398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:08:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0428809075cd41f0a6eb84c21e9abfed',uuid=d055568e-ab74-4fb6-89bf-2dd9f13bc2b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "address": "fa:16:3e:21:34:4e", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d7432d-bb", "ovs_interfaceid": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converting VIF {"id": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "address": "fa:16:3e:21:34:4e", "network": {"id": "3d02e40d-075a-46cd-b79f-d57975c53228", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-620463433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce3f0d3282d547249997fdad18cefc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d7432d-bb", "ovs_interfaceid": "50d7432d-bbe3-4f65-ae8a-6cc8387ba245", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:34:4e,bridge_name='br-int',has_traffic_filtering=True,id=50d7432d-bbe3-4f65-ae8a-6cc8387ba245,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d7432d-bb') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG os_vif [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:34:4e,bridge_name='br-int',has_traffic_filtering=True,id=50d7432d-bbe3-4f65-ae8a-6cc8387ba245,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d7432d-bb') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50d7432d-bb, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:11:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95991c15-601b-4c15-9c59-d93f9f97cae3) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:11:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:28 user nova-compute[74611]: INFO os_vif [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:34:4e,bridge_name='br-int',has_traffic_filtering=True,id=50d7432d-bbe3-4f65-ae8a-6cc8387ba245,network=Network(3d02e40d-075a-46cd-b79f-d57975c53228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d7432d-bb')
Nov 13 10:11:28 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Deleting instance files /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9_del
Nov 13 10:11:28 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Deletion of /opt/stack/data/nova/instances/d055568e-ab74-4fb6-89bf-2dd9f13bc2b9_del complete
Nov 13 10:11:28 user nova-compute[74611]: INFO nova.compute.manager [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 13 10:11:28 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:11:28 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:11:28 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:11:28 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:11:28 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Took 0.80 seconds to deallocate network for instance.
Nov 13 10:11:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-74e2ce99-c1e7-4afb-b206-13bdd54f71d1 req-7305e468-0b5e-4c41-b7fe-0cec4669aed4 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Received event network-vif-deleted-50d7432d-bbe3-4f65-ae8a-6cc8387ba245 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:11:28 user nova-compute[74611]: INFO nova.compute.manager [req-74e2ce99-c1e7-4afb-b206-13bdd54f71d1 req-7305e468-0b5e-4c41-b7fe-0cec4669aed4 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Neutron deleted interface 50d7432d-bbe3-4f65-ae8a-6cc8387ba245; detaching it from the instance and deleting it from the info cache
Nov 13 10:11:28 user nova-compute[74611]: DEBUG nova.network.neutron [req-74e2ce99-c1e7-4afb-b206-13bdd54f71d1 req-7305e468-0b5e-4c41-b7fe-0cec4669aed4 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:11:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-74e2ce99-c1e7-4afb-b206-13bdd54f71d1 req-7305e468-0b5e-4c41-b7fe-0cec4669aed4 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Detach interface failed, port_id=50d7432d-bbe3-4f65-ae8a-6cc8387ba245, reason: Instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9 could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 10:11:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:29 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:11:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:29 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:11:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:29 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Deleted allocations for instance d055568e-ab74-4fb6-89bf-2dd9f13bc2b9
Nov 13 10:11:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b51e6049-d30b-4bd6-b521-7fe1a8871a09 tempest-AttachVolumeTestJSON-658018398 tempest-AttachVolumeTestJSON-658018398-project-member] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.347s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-4d58029d-813f-4c44-a0b0-2aeb675a3bbc req-30d7bfc8-3df3-4ced-873f-9e6a9511ba82 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Received event network-vif-plugged-50d7432d-bbe3-4f65-ae8a-6cc8387ba245 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:11:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4d58029d-813f-4c44-a0b0-2aeb675a3bbc req-30d7bfc8-3df3-4ced-873f-9e6a9511ba82 service nova] Acquiring lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4d58029d-813f-4c44-a0b0-2aeb675a3bbc req-30d7bfc8-3df3-4ced-873f-9e6a9511ba82 service nova] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4d58029d-813f-4c44-a0b0-2aeb675a3bbc req-30d7bfc8-3df3-4ced-873f-9e6a9511ba82 service nova] Lock "d055568e-ab74-4fb6-89bf-2dd9f13bc2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-4d58029d-813f-4c44-a0b0-2aeb675a3bbc req-30d7bfc8-3df3-4ced-873f-9e6a9511ba82 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] No waiting events found dispatching network-vif-plugged-50d7432d-bbe3-4f65-ae8a-6cc8387ba245 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:11:29 user nova-compute[74611]: WARNING nova.compute.manager [req-4d58029d-813f-4c44-a0b0-2aeb675a3bbc req-30d7bfc8-3df3-4ced-873f-9e6a9511ba82 service nova] [instance: d055568e-ab74-4fb6-89bf-2dd9f13bc2b9] Received unexpected event network-vif-plugged-50d7432d-bbe3-4f65-ae8a-6cc8387ba245 for instance with vm_state deleted and task_state None.
Nov 13 10:11:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:32 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 is timed out.
Nov 13 10:11:32 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Successfully detached device vdb from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 from the live domain config.
Nov 13 10:11:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBYqkGsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:11:32 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc3678a-bd14-49dc-8a51-bce0a8e75a80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:11:32 user nova-compute[74611]: No targets found.
Nov 13 10:11:32 user nova-compute[74611]: iSNS:
Nov 13 10:11:32 user nova-compute[74611]: No targets found.
Nov 13 10:11:32 user nova-compute[74611]: STATIC:
Nov 13 10:11:32 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461
Nov 13 10:11:32 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:11:32 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:11:32 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd
Nov 13 10:11:32 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:11:32 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:11:32 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:11:32 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:11:32 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:11:32 user nova-compute[74611]: FIRMWARE:
Nov 13 10:11:32 user nova-compute[74611]: No targets found.
Nov 13 10:11:32 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:11:32 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:11:32 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bbbc7e-a491-4799-8c89-da0159cefecf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a85395-78d4-43e9-ae27-501bfef2f69e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:11:32 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:11:32 user nova-compute[74611]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 (non-flash)
Nov 13 10:11:32 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:11:32 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:11:32 user nova-compute[74611]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 (non-flash)
Nov 13 10:11:32 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb646293f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461'): ({'sdd'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Removing single pathed devices sdd {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd081903-6381-4a1e-bc74-af8c36cf3b0a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efbe061-16d0-4b08-b1a6-0f7735af7d0e]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Flushing IO for device /dev/sdd {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c075533e-8a1e-49da-bfb6-1b4071bdda55]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf750347-a12c-4002-a5cc-a371276f32d3]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] SCSI volumes sdd have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb96c84-e69e-4dc0-b62d-5e78cfffac47]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[276dc69a-caf3-4ed9-8a6f-0ae98917a936]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461, portal: 172.16.0.220,3260]
Nov 13 10:11:32 user nova-compute[74611]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461, portal: 172.16.0.220,3260] successful.
Nov 13 10:11:32 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efbf76fd-e81a-4e79-8e38-7e996e08d461 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc29fe84-868e-4337-a8de-b7b11a6472f4]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] <== disconnect_volume: return (321ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:11:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:11:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:33 user nova-compute[74611]: DEBUG nova.objects.instance [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lazy-loading 'flavor' on Instance uuid ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:11:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-58fcf5cd-20e7-4d75-86aa-c8c0ed4246fc tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.036s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Acquiring lock "a05d41b7-4084-4be9-9c56-bcd01478c349" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lock "a05d41b7-4084-4be9-9c56-bcd01478c349" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Acquiring lock "a05d41b7-4084-4be9-9c56-bcd01478c349-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lock "a05d41b7-4084-4be9-9c56-bcd01478c349-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lock "a05d41b7-4084-4be9-9c56-bcd01478c349-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:34 user nova-compute[74611]: INFO nova.compute.manager [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Terminating instance
Nov 13 10:11:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-70b9804e-2928-404e-9c6d-d98325e62979 req-613d8e18-6622-4ecf-a388-4f3c41a33767 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Received event network-vif-unplugged-6837255f-df3c-458c-9d4b-e6bca6b127a8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-70b9804e-2928-404e-9c6d-d98325e62979 req-613d8e18-6622-4ecf-a388-4f3c41a33767 service nova] Acquiring lock "a05d41b7-4084-4be9-9c56-bcd01478c349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-70b9804e-2928-404e-9c6d-d98325e62979 req-613d8e18-6622-4ecf-a388-4f3c41a33767 service nova] Lock "a05d41b7-4084-4be9-9c56-bcd01478c349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-70b9804e-2928-404e-9c6d-d98325e62979 req-613d8e18-6622-4ecf-a388-4f3c41a33767 service nova] Lock "a05d41b7-4084-4be9-9c56-bcd01478c349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-70b9804e-2928-404e-9c6d-d98325e62979 req-613d8e18-6622-4ecf-a388-4f3c41a33767 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] No waiting events found dispatching network-vif-unplugged-6837255f-df3c-458c-9d4b-e6bca6b127a8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-70b9804e-2928-404e-9c6d-d98325e62979 req-613d8e18-6622-4ecf-a388-4f3c41a33767 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Received event network-vif-unplugged-6837255f-df3c-458c-9d4b-e6bca6b127a8 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Instance destroyed successfully.
Nov 13 10:11:34 user nova-compute[74611]: DEBUG nova.objects.instance [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lazy-loading 'resources' on Instance uuid a05d41b7-4084-4be9-9c56-bcd01478c349 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:09:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-814468898',display_name='tempest-VolumesActionsTest-instance-814468898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-814468898',id=41,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:09:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cdd08ee7e3b4e578ac00f6995287e07',ramdisk_id='',reservation_id='r-yq2eaw50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1393528161',owner_user_name='tempest-VolumesActionsTest-1393528161-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:09:45Z,user_data=None,user_id='9dd6e9f050c44adf82c9c28b82e4d8ca',uuid=a05d41b7-4084-4be9-9c56-bcd01478c349,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "address": "fa:16:3e:f1:d8:f6", "network": {"id": "fe173153-e1c0-4db7-8d4f-f944d05fd95a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385554225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdd08ee7e3b4e578ac00f6995287e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837255f-df", "ovs_interfaceid": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Converting VIF {"id": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "address": "fa:16:3e:f1:d8:f6", "network": {"id": "fe173153-e1c0-4db7-8d4f-f944d05fd95a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385554225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdd08ee7e3b4e578ac00f6995287e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837255f-df", "ovs_interfaceid": "6837255f-df3c-458c-9d4b-e6bca6b127a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d8:f6,bridge_name='br-int',has_traffic_filtering=True,id=6837255f-df3c-458c-9d4b-e6bca6b127a8,network=Network(fe173153-e1c0-4db7-8d4f-f944d05fd95a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6837255f-df') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG os_vif [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d8:f6,bridge_name='br-int',has_traffic_filtering=True,id=6837255f-df3c-458c-9d4b-e6bca6b127a8,network=Network(fe173153-e1c0-4db7-8d4f-f944d05fd95a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6837255f-df') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6837255f-df, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=069013f9-5474-4091-a959-ac5cd6eb4330) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:11:34 user nova-compute[74611]: INFO os_vif [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d8:f6,bridge_name='br-int',has_traffic_filtering=True,id=6837255f-df3c-458c-9d4b-e6bca6b127a8,network=Network(fe173153-e1c0-4db7-8d4f-f944d05fd95a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6837255f-df')
Nov 13 10:11:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Deleting instance files /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349_del
Nov 13 10:11:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Deletion of /opt/stack/data/nova/instances/a05d41b7-4084-4be9-9c56-bcd01478c349_del complete
Nov 13 10:11:34 user nova-compute[74611]: INFO nova.compute.manager [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 13 10:11:34 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:11:34 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:11:35 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:11:35 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Took 0.45 seconds to deallocate network for instance.
Nov 13 10:11:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-b91ec492-a676-4998-9812-57d6a08fcdda req-7bba5e65-92e8-4ea1-b878-2af63a70bdcc service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Received event network-vif-deleted-6837255f-df3c-458c-9d4b-e6bca6b127a8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:11:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:35 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:11:35 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:11:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:35 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Deleted allocations for instance a05d41b7-4084-4be9-9c56-bcd01478c349
Nov 13 10:11:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-02ac8fb4-44d9-405b-b322-41af1a6bd278 tempest-VolumesActionsTest-1393528161 tempest-VolumesActionsTest-1393528161-project-member] Lock "a05d41b7-4084-4be9-9c56-bcd01478c349" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.603s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-81c22137-fd38-4e0e-891e-07e241ab625d req-af9f1b4e-9094-4a8d-bda3-465011569eb3 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Received event network-vif-plugged-6837255f-df3c-458c-9d4b-e6bca6b127a8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:11:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-81c22137-fd38-4e0e-891e-07e241ab625d req-af9f1b4e-9094-4a8d-bda3-465011569eb3 service nova] Acquiring lock "a05d41b7-4084-4be9-9c56-bcd01478c349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-81c22137-fd38-4e0e-891e-07e241ab625d req-af9f1b4e-9094-4a8d-bda3-465011569eb3 service nova] Lock "a05d41b7-4084-4be9-9c56-bcd01478c349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-81c22137-fd38-4e0e-891e-07e241ab625d req-af9f1b4e-9094-4a8d-bda3-465011569eb3 service nova] Lock "a05d41b7-4084-4be9-9c56-bcd01478c349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-81c22137-fd38-4e0e-891e-07e241ab625d req-af9f1b4e-9094-4a8d-bda3-465011569eb3 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] No waiting events found dispatching network-vif-plugged-6837255f-df3c-458c-9d4b-e6bca6b127a8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:11:36 user nova-compute[74611]: WARNING nova.compute.manager [req-81c22137-fd38-4e0e-891e-07e241ab625d req-af9f1b4e-9094-4a8d-bda3-465011569eb3 service nova] [instance: a05d41b7-4084-4be9-9c56-bcd01478c349] Received unexpected event network-vif-plugged-6837255f-df3c-458c-9d4b-e6bca6b127a8 for instance with vm_state deleted and task_state None.
Nov 13 10:11:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:37 user nova-compute[74611]: INFO nova.compute.manager [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Terminating instance
Nov 13 10:11:37 user nova-compute[74611]: DEBUG nova.compute.manager [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:37 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Instance destroyed successfully.
Nov 13 10:11:37 user nova-compute[74611]: DEBUG nova.objects.instance [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'resources' on Instance uuid 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-449883671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-449883671',id=29,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:02:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83e3b3233a5b43d682200d91f29a80b4',ramdisk_id='',reservation_id='r-1mata5dc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-182847603',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:04:12Z,user_data=None,user_id='6bc911a5649643a6a3606d8b80e20eb0',uuid=3eba6d0b-f9b2-4fc4-ba55-2efe67236e36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a42c4f5-af22-43ef-be4b-960f27a17259", "address": "fa:16:3e:b9:b7:60", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a42c4f5-af", "ovs_interfaceid": "1a42c4f5-af22-43ef-be4b-960f27a17259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converting VIF {"id": "1a42c4f5-af22-43ef-be4b-960f27a17259", "address": "fa:16:3e:b9:b7:60", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a42c4f5-af", "ovs_interfaceid": "1a42c4f5-af22-43ef-be4b-960f27a17259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b7:60,bridge_name='br-int',has_traffic_filtering=True,id=1a42c4f5-af22-43ef-be4b-960f27a17259,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a42c4f5-af') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG os_vif [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b7:60,bridge_name='br-int',has_traffic_filtering=True,id=1a42c4f5-af22-43ef-be4b-960f27a17259,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a42c4f5-af') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a42c4f5-af, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8c3328c-5b24-4cb4-8221-3abbbd469ead) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:11:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:11:37 user nova-compute[74611]: INFO os_vif [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b7:60,bridge_name='br-int',has_traffic_filtering=True,id=1a42c4f5-af22-43ef-be4b-960f27a17259,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a42c4f5-af')
Nov 13 10:11:37 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Deleting instance files /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36_del
Nov 13 10:11:37 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Deletion of /opt/stack/data/nova/instances/3eba6d0b-f9b2-4fc4-ba55-2efe67236e36_del complete
Nov 13 10:11:38 user nova-compute[74611]: INFO nova.compute.manager [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 13 10:11:38 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:11:38 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:11:38 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:11:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:38 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:11:38 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Took 0.49 seconds to deallocate network for instance.
Nov 13 10:11:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-26062e6c-63a6-49b9-adeb-730d5d55b44d req-1f958d24-81ca-4fcf-9b25-1366a32bca37 service nova] [instance: 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36] Received event network-vif-deleted-1a42c4f5-af22-43ef-be4b-960f27a17259 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:11:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:38 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:11:38 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:11:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:38 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Deleted allocations for instance 3eba6d0b-f9b2-4fc4-ba55-2efe67236e36
Nov 13 10:11:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-530bb2c1-cb68-49df-b696-9f3f4447c60c tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "3eba6d0b-f9b2-4fc4-ba55-2efe67236e36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.819s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:44 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:11:44 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:11:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:11:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:11:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:11:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Updating instance_info_cache with network_info: [{"id": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "address": "fa:16:3e:b7:e1:19", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ef27e1-e7", "ovs_interfaceid": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:11:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:11:44 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "4704cd02-59cc-4d64-804a-79a38d05b00e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG nova.compute.manager [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:11:45 user nova-compute[74611]: INFO nova.compute.claims [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Claim successful on node user
Nov 13 10:11:45 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG nova.compute.manager [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG nova.compute.manager [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG nova.network.neutron [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:11:45 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:11:45 user nova-compute[74611]: DEBUG nova.compute.manager [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG nova.policy [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35bc3ea05d5b4f9a85ba453446b2bee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5990cb4516a04312b3ccda9c39a44c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG nova.compute.manager [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:11:45 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Creating image(s)
Nov 13 10:11:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "/opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "/opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "/opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d.part --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:46 user nova-compute[74611]: DEBUG nova.network.neutron [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Successfully created port: 457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:11:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d.part --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:46 user nova-compute[74611]: DEBUG nova.virt.images [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] 876d0ea7-601f-4d91-9da8-e815a1c512f1 was qcow2, converting to raw {{(pid=74611) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 10:11:46 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 10:11:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d.part /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d.converted {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d.part /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d.converted" returned: 0 in 0.459s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d.converted --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:46 user nova-compute[74611]: DEBUG nova.network.neutron [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Successfully updated port: 457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.compute.manager [req-6c28d154-ab8e-4333-a247-7ac4d7a23f76 req-647a3a74-8079-46a4-aef4-e56e68e5ce74 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received event network-changed-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.compute.manager [req-6c28d154-ab8e-4333-a247-7ac4d7a23f76 req-647a3a74-8079-46a4-aef4-e56e68e5ce74 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Refreshing instance network info cache due to event network-changed-457c4784-2cc7-4521-8d86-86845bce490e. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6c28d154-ab8e-4333-a247-7ac4d7a23f76 req-647a3a74-8079-46a4-aef4-e56e68e5ce74 service nova] Acquiring lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6c28d154-ab8e-4333-a247-7ac4d7a23f76 req-647a3a74-8079-46a4-aef4-e56e68e5ce74 service nova] Acquired lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.network.neutron [req-6c28d154-ab8e-4333-a247-7ac4d7a23f76 req-647a3a74-8079-46a4-aef4-e56e68e5ce74 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Refreshing network info cache for port 457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.397s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.network.neutron [req-6c28d154-ab8e-4333-a247-7ac4d7a23f76 req-647a3a74-8079-46a4-aef4-e56e68e5ce74 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.network.neutron [req-6c28d154-ab8e-4333-a247-7ac4d7a23f76 req-647a3a74-8079-46a4-aef4-e56e68e5ce74 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6c28d154-ab8e-4333-a247-7ac4d7a23f76 req-647a3a74-8079-46a4-aef4-e56e68e5ce74 service nova] Releasing lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquired lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.network.neutron [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.network.neutron [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d,backing_fmt=raw /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d,backing_fmt=raw /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk 1073741824" returned: 0 in 0.083s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d --force-share --output=json" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.network.neutron [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Updating instance_info_cache with network_info: [{"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Releasing lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Instance network_info: |[{"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Cannot resize image /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Ensure instance console log exists: /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Start _get_guest_xml network_info=[{"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T10:11:42Z,direct_url=<?>,disk_format='qcow2',id=876d0ea7-601f-4d91-9da8-e815a1c512f1,min_disk=0,min_ram=0,name='tempest-scenario-img--1030050733',owner='5990cb4516a04312b3ccda9c39a44c4a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T10:11:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '876d0ea7-601f-4d91-9da8-e815a1c512f1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:11:47 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:11:47 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:11:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T10:11:42Z,direct_url=<?>,disk_format='qcow2',id=876d0ea7-601f-4d91-9da8-e815a1c512f1,min_disk=0,min_ram=0,name='tempest-scenario-img--1030050733',owner='5990cb4516a04312b3ccda9c39a44c4a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T10:11:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1254234458',display_name='tempest-TestMinimumBasicScenario-server-1254234458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1254234458',id=43,image_ref='876d0ea7-601f-4d91-9da8-e815a1c512f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI92Z30Xq53Ktv+Nq8eUC6I8etuxy1sEESnYSIHfkfvgq/zsYzW7tWZ5Wp6GnOGv5ALJIAbwu1T1e4B/Y7w/27W0CDeF3iHGB5ehXLN0ga5fVz0HbSyDO2CMLaOL8EyxA==',key_name='tempest-TestMinimumBasicScenario-1202250230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5990cb4516a04312b3ccda9c39a44c4a',ramdisk_id='',reservation_id='r-mkiy3udd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='876d0ea7-601f-4d91-9da8-e815a1c512f1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-163886892',owner_user_name='tempest-TestMinimumBasicScenario-163886892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:11:46Z,user_data=None,user_id='35bc3ea05d5b4f9a85ba453446b2bee9',uuid=4704cd02-59cc-4d64-804a-79a38d05b00e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converting VIF {"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=457c4784-2cc7-4521-8d86-86845bce490e,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457c4784-2c') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.objects.instance [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lazy-loading 'pci_devices' on Instance uuid 4704cd02-59cc-4d64-804a-79a38d05b00e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:11:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:11:47 user nova-compute[74611]:   <uuid>4704cd02-59cc-4d64-804a-79a38d05b00e</uuid>
Nov 13 10:11:47 user nova-compute[74611]:   <name>instance-0000002b</name>
Nov 13 10:11:47 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:11:47 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:11:47 user nova-compute[74611]:   <metadata>
Nov 13 10:11:47 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:11:47 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:11:47 user nova-compute[74611]:       <nova:name>tempest-TestMinimumBasicScenario-server-1254234458</nova:name>
Nov 13 10:11:47 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:11:47</nova:creationTime>
Nov 13 10:11:47 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:11:47 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:11:47 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:11:47 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:11:47 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:11:47 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:11:47 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:11:47 user nova-compute[74611]:       <nova:owner>
Nov 13 10:11:47 user nova-compute[74611]:         <nova:user uuid="35bc3ea05d5b4f9a85ba453446b2bee9">tempest-TestMinimumBasicScenario-163886892-project-member</nova:user>
Nov 13 10:11:47 user nova-compute[74611]:         <nova:project uuid="5990cb4516a04312b3ccda9c39a44c4a">tempest-TestMinimumBasicScenario-163886892</nova:project>
Nov 13 10:11:47 user nova-compute[74611]:       </nova:owner>
Nov 13 10:11:47 user nova-compute[74611]:       <nova:root type="image" uuid="876d0ea7-601f-4d91-9da8-e815a1c512f1"/>
Nov 13 10:11:47 user nova-compute[74611]:       <nova:ports>
Nov 13 10:11:47 user nova-compute[74611]:         <nova:port uuid="457c4784-2cc7-4521-8d86-86845bce490e">
Nov 13 10:11:47 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 10:11:47 user nova-compute[74611]:         </nova:port>
Nov 13 10:11:47 user nova-compute[74611]:       </nova:ports>
Nov 13 10:11:47 user nova-compute[74611]:     </nova:instance>
Nov 13 10:11:47 user nova-compute[74611]:   </metadata>
Nov 13 10:11:47 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:11:47 user nova-compute[74611]:     <system>
Nov 13 10:11:47 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:11:47 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:11:47 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:11:47 user nova-compute[74611]:       <entry name="serial">4704cd02-59cc-4d64-804a-79a38d05b00e</entry>
Nov 13 10:11:47 user nova-compute[74611]:       <entry name="uuid">4704cd02-59cc-4d64-804a-79a38d05b00e</entry>
Nov 13 10:11:47 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:11:47 user nova-compute[74611]:     </system>
Nov 13 10:11:47 user nova-compute[74611]:   </sysinfo>
Nov 13 10:11:47 user nova-compute[74611]:   <os>
Nov 13 10:11:47 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:11:47 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:11:47 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:11:47 user nova-compute[74611]:   </os>
Nov 13 10:11:47 user nova-compute[74611]:   <features>
Nov 13 10:11:47 user nova-compute[74611]:     <acpi/>
Nov 13 10:11:47 user nova-compute[74611]:     <apic/>
Nov 13 10:11:47 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:11:47 user nova-compute[74611]:   </features>
Nov 13 10:11:47 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:11:47 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:11:47 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:11:47 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:11:47 user nova-compute[74611]:   </clock>
Nov 13 10:11:47 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:11:47 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:11:47 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:11:47 user nova-compute[74611]:   </cpu>
Nov 13 10:11:47 user nova-compute[74611]:   <devices>
Nov 13 10:11:47 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:11:47 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:11:47 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk"/>
Nov 13 10:11:47 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:11:47 user nova-compute[74611]:     </disk>
Nov 13 10:11:47 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:11:47 user nova-compute[74611]:       <mac address="fa:16:3e:13:6c:f6"/>
Nov 13 10:11:47 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:11:47 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:11:47 user nova-compute[74611]:       <target dev="tap457c4784-2c"/>
Nov 13 10:11:47 user nova-compute[74611]:     </interface>
Nov 13 10:11:47 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:11:47 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/console.log" append="off"/>
Nov 13 10:11:47 user nova-compute[74611]:     </serial>
Nov 13 10:11:47 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:11:47 user nova-compute[74611]:     <video>
Nov 13 10:11:47 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:11:47 user nova-compute[74611]:     </video>
Nov 13 10:11:47 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:11:47 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:11:47 user nova-compute[74611]:     </rng>
Nov 13 10:11:47 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:11:47 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:11:47 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:11:47 user nova-compute[74611]:     </memballoon>
Nov 13 10:11:47 user nova-compute[74611]:   </devices>
Nov 13 10:11:47 user nova-compute[74611]: </domain>
Nov 13 10:11:47 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1254234458',display_name='tempest-TestMinimumBasicScenario-server-1254234458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1254234458',id=43,image_ref='876d0ea7-601f-4d91-9da8-e815a1c512f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI92Z30Xq53Ktv+Nq8eUC6I8etuxy1sEESnYSIHfkfvgq/zsYzW7tWZ5Wp6GnOGv5ALJIAbwu1T1e4B/Y7w/27W0CDeF3iHGB5ehXLN0ga5fVz0HbSyDO2CMLaOL8EyxA==',key_name='tempest-TestMinimumBasicScenario-1202250230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5990cb4516a04312b3ccda9c39a44c4a',ramdisk_id='',reservation_id='r-mkiy3udd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='876d0ea7-601f-4d91-9da8-e815a1c512f1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-163886892',owner_user_name='tempest-TestMinimumBasicScenario-163886892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:11:46Z,user_data=None,user_id='35bc3ea05d5b4f9a85ba453446b2bee9',uuid=4704cd02-59cc-4d64-804a-79a38d05b00e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converting VIF {"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=457c4784-2cc7-4521-8d86-86845bce490e,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457c4784-2c') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG os_vif [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=457c4784-2cc7-4521-8d86-86845bce490e,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457c4784-2c') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1623c275-ddec-5988-b4ba-e282f96b932e', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap457c4784-2c, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap457c4784-2c, col_values=(('qos', UUID('86f83044-e37b-405f-9025-e91fbeecac22')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap457c4784-2c, col_values=(('external_ids', {'iface-id': '457c4784-2cc7-4521-8d86-86845bce490e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:6c:f6', 'vm-uuid': '4704cd02-59cc-4d64-804a-79a38d05b00e'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:48 user nova-compute[74611]: INFO os_vif [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=457c4784-2cc7-4521-8d86-86845bce490e,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457c4784-2c')
Nov 13 10:11:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:11:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] No VIF found with MAC fa:16:3e:13:6c:f6, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:11:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:49 user nova-compute[74611]: DEBUG nova.compute.manager [req-02dd84d1-cb4a-4d38-9124-c0c1c4ca5fd8 req-47d116b9-5233-4ec6-81b3-846cdd43db7f service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received event network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:11:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-02dd84d1-cb4a-4d38-9124-c0c1c4ca5fd8 req-47d116b9-5233-4ec6-81b3-846cdd43db7f service nova] Acquiring lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-02dd84d1-cb4a-4d38-9124-c0c1c4ca5fd8 req-47d116b9-5233-4ec6-81b3-846cdd43db7f service nova] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-02dd84d1-cb4a-4d38-9124-c0c1c4ca5fd8 req-47d116b9-5233-4ec6-81b3-846cdd43db7f service nova] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:49 user nova-compute[74611]: DEBUG nova.compute.manager [req-02dd84d1-cb4a-4d38-9124-c0c1c4ca5fd8 req-47d116b9-5233-4ec6-81b3-846cdd43db7f service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] No waiting events found dispatching network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:11:49 user nova-compute[74611]: WARNING nova.compute.manager [req-02dd84d1-cb4a-4d38-9124-c0c1c4ca5fd8 req-47d116b9-5233-4ec6-81b3-846cdd43db7f service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received unexpected event network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e for instance with vm_state building and task_state spawning.
Nov 13 10:11:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:50 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:11:50 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:11:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:11:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:11:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:11:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:11:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:11:51 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Instance spawned successfully.
Nov 13 10:11:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:11:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:11:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:11:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:11:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:11:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:11:51 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:11:51 user nova-compute[74611]: DEBUG nova.compute.manager [req-a72c0dc2-f004-431f-9582-19ee02bb5b1d req-9c673ff9-0b44-48c3-800a-5fe021212954 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received event network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:11:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a72c0dc2-f004-431f-9582-19ee02bb5b1d req-9c673ff9-0b44-48c3-800a-5fe021212954 service nova] Acquiring lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a72c0dc2-f004-431f-9582-19ee02bb5b1d req-9c673ff9-0b44-48c3-800a-5fe021212954 service nova] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a72c0dc2-f004-431f-9582-19ee02bb5b1d req-9c673ff9-0b44-48c3-800a-5fe021212954 service nova] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:51 user nova-compute[74611]: DEBUG nova.compute.manager [req-a72c0dc2-f004-431f-9582-19ee02bb5b1d req-9c673ff9-0b44-48c3-800a-5fe021212954 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] No waiting events found dispatching network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:11:51 user nova-compute[74611]: WARNING nova.compute.manager [req-a72c0dc2-f004-431f-9582-19ee02bb5b1d req-9c673ff9-0b44-48c3-800a-5fe021212954 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received unexpected event network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e for instance with vm_state building and task_state spawning.
Nov 13 10:11:51 user nova-compute[74611]: INFO nova.compute.manager [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 13 10:11:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:11:51 user nova-compute[74611]: INFO nova.compute.manager [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Took 6.62 seconds to build instance.
Nov 13 10:11:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-358e19cb-b914-4bc9-93b7-ea34ddbba2cc tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.730s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:53 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:11:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:55 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:11:56 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:11:57 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:11:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:11:57 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:11:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:11:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:11:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:11:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:11:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:11:59 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:11:59 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:11:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8302MB free_disk=25.184329986572266GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:11:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:11:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:11:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:11:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:11:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:11:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:11:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ed1dfac0-31b6-4e63-895e-29877e17d178 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:11:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4704cd02-59cc-4d64-804a-79a38d05b00e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:11:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:11:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:11:59 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:11:59 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:11:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:11:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:00 user nova-compute[74611]: DEBUG nova.compute.manager [req-8d4e3a4f-94b2-424d-8afb-aa279aa86d07 req-4ae56b46-00ac-46e5-a0d6-250392fe52e3 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Received event network-changed-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:12:00 user nova-compute[74611]: DEBUG nova.compute.manager [req-8d4e3a4f-94b2-424d-8afb-aa279aa86d07 req-4ae56b46-00ac-46e5-a0d6-250392fe52e3 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Refreshing instance network info cache due to event network-changed-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:12:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8d4e3a4f-94b2-424d-8afb-aa279aa86d07 req-4ae56b46-00ac-46e5-a0d6-250392fe52e3 service nova] Acquiring lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:12:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8d4e3a4f-94b2-424d-8afb-aa279aa86d07 req-4ae56b46-00ac-46e5-a0d6-250392fe52e3 service nova] Acquired lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:12:00 user nova-compute[74611]: DEBUG nova.network.neutron [req-8d4e3a4f-94b2-424d-8afb-aa279aa86d07 req-4ae56b46-00ac-46e5-a0d6-250392fe52e3 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Refreshing network info cache for port a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:12:00 user nova-compute[74611]: DEBUG nova.network.neutron [req-8d4e3a4f-94b2-424d-8afb-aa279aa86d07 req-4ae56b46-00ac-46e5-a0d6-250392fe52e3 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Updated VIF entry in instance network info cache for port a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:12:00 user nova-compute[74611]: DEBUG nova.network.neutron [req-8d4e3a4f-94b2-424d-8afb-aa279aa86d07 req-4ae56b46-00ac-46e5-a0d6-250392fe52e3 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Updating instance_info_cache with network_info: [{"id": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "address": "fa:16:3e:b7:e1:19", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ef27e1-e7", "ovs_interfaceid": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:12:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8d4e3a4f-94b2-424d-8afb-aa279aa86d07 req-4ae56b46-00ac-46e5-a0d6-250392fe52e3 service nova] Releasing lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:12:01 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:12:02 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Stashing vm_state: active {{(pid=74611) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 13 10:12:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:02 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:12:02 user nova-compute[74611]: INFO nova.compute.claims [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Claim successful on node user
Nov 13 10:12:02 user nova-compute[74611]: INFO nova.compute.resource_tracker [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Updating resource usage from migration f8cefb2f-0d41-4528-aca2-0a3d4a07f922
Nov 13 10:12:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-ab8d0034-99b5-4b83-9867-2017e13bc752 req-2540f727-53c6-4494-b422-7e04935d42a1 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received event network-changed-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:12:02 user nova-compute[74611]: DEBUG nova.compute.manager [req-ab8d0034-99b5-4b83-9867-2017e13bc752 req-2540f727-53c6-4494-b422-7e04935d42a1 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Refreshing instance network info cache due to event network-changed-a53ebdb2-3917-46df-b5a3-af5682496fa8. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:12:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ab8d0034-99b5-4b83-9867-2017e13bc752 req-2540f727-53c6-4494-b422-7e04935d42a1 service nova] Acquiring lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:12:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ab8d0034-99b5-4b83-9867-2017e13bc752 req-2540f727-53c6-4494-b422-7e04935d42a1 service nova] Acquired lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:12:02 user nova-compute[74611]: DEBUG nova.network.neutron [req-ab8d0034-99b5-4b83-9867-2017e13bc752 req-2540f727-53c6-4494-b422-7e04935d42a1 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Refreshing network info cache for port a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:12:02 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:12:02 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:12:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.339s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:02 user nova-compute[74611]: INFO nova.compute.manager [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Migrating
Nov 13 10:12:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG nova.network.neutron [req-ab8d0034-99b5-4b83-9867-2017e13bc752 req-2540f727-53c6-4494-b422-7e04935d42a1 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Updated VIF entry in instance network info cache for port a53ebdb2-3917-46df-b5a3-af5682496fa8. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG nova.network.neutron [req-ab8d0034-99b5-4b83-9867-2017e13bc752 req-2540f727-53c6-4494-b422-7e04935d42a1 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Updating instance_info_cache with network_info: [{"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-ab8d0034-99b5-4b83-9867-2017e13bc752 req-2540f727-53c6-4494-b422-7e04935d42a1 service nova] Releasing lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquired lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Updating instance_info_cache with network_info: [{"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Releasing lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG nova.objects.instance [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lazy-loading 'flavor' on Instance uuid ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Starting migrate_disk_and_power_off {{(pid=74611) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:04 user nova-compute[74611]: INFO nova.compute.manager [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Attaching volume 1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 to /dev/vdb
Nov 13 10:12:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-e4caa338-711c-4362-888d-037107142cdd req-0076b083-c41a-4d37-860e-0474c392668e service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received event network-vif-unplugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e4caa338-711c-4362-888d-037107142cdd req-0076b083-c41a-4d37-860e-0474c392668e service nova] Acquiring lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e4caa338-711c-4362-888d-037107142cdd req-0076b083-c41a-4d37-860e-0474c392668e service nova] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e4caa338-711c-4362-888d-037107142cdd req-0076b083-c41a-4d37-860e-0474c392668e service nova] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-e4caa338-711c-4362-888d-037107142cdd req-0076b083-c41a-4d37-860e-0474c392668e service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] No waiting events found dispatching network-vif-unplugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:12:04 user nova-compute[74611]: WARNING nova.compute.manager [req-e4caa338-711c-4362-888d-037107142cdd req-0076b083-c41a-4d37-860e-0474c392668e service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received unexpected event network-vif-unplugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 for instance with vm_state active and task_state resize_migrating.
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.utils [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2566a376-8669-411b-b173-5b6272259190]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb66963-d5b7-4558-9392-7957495f5398]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c1195e-c729-41b3-9d9e-5966486148b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2570c7-0aa5-4d3f-9102-3094d3dd9172]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:12:04 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18cd9fd-0c6c-4411-aee4-84594593cd03]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.utils [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Updating existing volume attachment record: c531454d-71d4-44b1-b485-a7ea4abc9298 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:04 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Instance destroyed successfully.
Nov 13 10:12:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1947219481',display_name='tempest-ServerActionsTestOtherA-server-1947219481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1947219481',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyvkPZ/C5Pk5XOFxP5rMcYJVq0nGL8MEwZ1COcFqCFBcO7G74gr+o/bZOILVW3PDzyd5NY9xtWs0kgCNTm8xNQIJrW9d3YRiHEICGlxrvJ1iCAAc7YEKxcFMW7SpPA0Dw==',key_name='tempest-keypair-2093749558',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:10:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e6a0b0a078bd44908cd7cd4593914eef',ramdisk_id='',reservation_id='r-ixwiy3ki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2135577355',owner_user_name='tempest-ServerActionsTestOtherA-2135577355-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22322be2dd04410b6cd53c31e639b3b',uuid=ed1dfac0-31b6-4e63-895e-29877e17d178,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-21995796-network", "vif_mac": "fa:16:3e:d0:42:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converting VIF {"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-21995796-network", "vif_mac": "fa:16:3e:d0:42:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:42:59,bridge_name='br-int',has_traffic_filtering=True,id=a53ebdb2-3917-46df-b5a3-af5682496fa8,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53ebdb2-39') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_vif [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:42:59,bridge_name='br-int',has_traffic_filtering=True,id=a53ebdb2-3917-46df-b5a3-af5682496fa8,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53ebdb2-39') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa53ebdb2-39, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3b14938-26fc-4471-8cce-fdc5451fa9c3) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:12:04 user nova-compute[74611]: INFO os_vif [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:42:59,bridge_name='br-int',has_traffic_filtering=True,id=a53ebdb2-3917-46df-b5a3-af5682496fa8,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53ebdb2-39')
Nov 13 10:12:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZwVaFIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:12:04 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a34759d-f495-4ddd-bd72-a2de2fb846da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:12:04 user nova-compute[74611]: No targets found.
Nov 13 10:12:04 user nova-compute[74611]: iSNS:
Nov 13 10:12:04 user nova-compute[74611]: No targets found.
Nov 13 10:12:04 user nova-compute[74611]: STATIC:
Nov 13 10:12:04 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd
Nov 13 10:12:04 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:12:04 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:12:04 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:12:04 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:12:04 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:12:04 user nova-compute[74611]: FIRMWARE:
Nov 13 10:12:04 user nova-compute[74611]: No targets found.
Nov 13 10:12:04 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:12:04 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:12:04 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[91229a7d-b5d0-43c1-a84a-6baf0dbb94ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[939746a2-c9b4-4383-a8a2-1ddb6d33fbea]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:12:04 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:12:04 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:12:04 user nova-compute[74611]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:12:04 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64426830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c28cf88-557c-4e61-b215-fadafd7f3833]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac925be-9a38-4b46-8f84-c2dbd2b3b83f]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e277b6-73db-480b-9c9c-faec9ad23411]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.107s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eb904f-0a50-4906-a85f-3bbace8e3778]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18cbaa8-8c1e-4081-ad0e-1a32d6446526]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d930894-99b2-4afe-9093-a19206269221]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd, portal: 172.16.0.220,3260]
Nov 13 10:12:04 user nova-compute[74611]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd, portal: 172.16.0.220,3260] successful.
Nov 13 10:12:04 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:05 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce392f4-c701-4249-b232-b6b90ba262b3]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:12:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] <== disconnect_volume: return (432ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:12:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:12:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:12:06 user nova-compute[74611]: DEBUG nova.compute.manager [req-e463af4b-2e02-4b05-b443-11f5ae4aadf5 req-9ee83c79-df60-4c1c-bc5e-571264ce045c service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received event network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:12:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e463af4b-2e02-4b05-b443-11f5ae4aadf5 req-9ee83c79-df60-4c1c-bc5e-571264ce045c service nova] Acquiring lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e463af4b-2e02-4b05-b443-11f5ae4aadf5 req-9ee83c79-df60-4c1c-bc5e-571264ce045c service nova] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e463af4b-2e02-4b05-b443-11f5ae4aadf5 req-9ee83c79-df60-4c1c-bc5e-571264ce045c service nova] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:06 user nova-compute[74611]: DEBUG nova.compute.manager [req-e463af4b-2e02-4b05-b443-11f5ae4aadf5 req-9ee83c79-df60-4c1c-bc5e-571264ce045c service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] No waiting events found dispatching network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:12:06 user nova-compute[74611]: WARNING nova.compute.manager [req-e463af4b-2e02-4b05-b443-11f5ae4aadf5 req-9ee83c79-df60-4c1c-bc5e-571264ce045c service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received unexpected event network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 for instance with vm_state active and task_state resize_migrating.
Nov 13 10:12:08 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Port a53ebdb2-3917-46df-b5a3-af5682496fa8 binding to destination host user is already ACTIVE {{(pid=74611) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YAONwChI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:12:08 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:12:08 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:12:08 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38f7b53-e846-4489-a239-91d2e5890d68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:12:08 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquired lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[991fa597-c36f-47b6-b408-f08ff2aa45fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90] added
Nov 13 10:12:08 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[da546cb6-ea1f-43aa-bb3b-f3badba72db4]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[29097038-2b0b-48a7-8061-93f6af666210]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YAONwChI {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YAONwChI" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea96574e-0ea2-49ce-9d3a-c791ea887b18]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YAONwChI'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7bdd74-2a05-4611-8749-2bd57c4c9888]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f21949e-051e-42fb-86ef-aac7f381afd9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aeae0f4-5ef4-4816-aea8-f96e18ef41d0 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:12:08 user nova-compute[74611]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aeae0f4-5ef4-4816-aea8-f96e18ef41d0 (non-flash)
Nov 13 10:12:08 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:12:08 user nova-compute[74611]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aeae0f4-5ef4-4816-aea8-f96e18ef41d0 (non-flash)
Nov 13 10:12:08 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[748f82fc-35e8-4acc-9219-b25e9568889b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90, portal: 172.16.0.220,3260]
Nov 13 10:12:08 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90, portal: 172.16.0.220,3260] successful.
Nov 13 10:12:08 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f664bd-606a-4d78-9c35-0b30e156dfc6]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[093a4736-96a1-410d-8d37-126eb4d3dd87]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aeae0f4-5ef4-4816-aea8-f96e18ef41d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:12:08 user nova-compute[74611]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aeae0f4-5ef4-4816-aea8-f96e18ef41d0 (non-flash)
Nov 13 10:12:08 user nova-compute[74611]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 (non-flash)
Nov 13 10:12:08 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:12:08 user nova-compute[74611]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aeae0f4-5ef4-4816-aea8-f96e18ef41d0 (non-flash)
Nov 13 10:12:08 user nova-compute[74611]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 (non-flash)
Nov 13 10:12:08 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce63de68-3c03-4618-a7b6-aeb27f1b2375]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YAONwChI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Updating instance_info_cache with network_info: [{"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:12:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Releasing lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG os_brick.utils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd7eafe-c8e0-4cbc-969f-68ca0d5d5cd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31b2e50-9531-46bc-b084-348c9f0cef0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[565e2315-625b-4f1a-b762-60d638ecb0a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb339dcd-735e-4075-97bd-2243e9f14a7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:12:09 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:12:09 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da348ad-690e-4e0a-a441-f1e1114af71b]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG os_brick.utils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23436303433643431', 'path': '/dev/sdd'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436303433643431', 'path': '/dev/sdd'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG nova.objects.instance [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lazy-loading 'flavor' on Instance uuid ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:12:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:12:09 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:12:09 user nova-compute[74611]:   <source dev="/dev/sdd"/>
Nov 13 10:12:09 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:12:09 user nova-compute[74611]:   <serial>1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90</serial>
Nov 13 10:12:09 user nova-compute[74611]: </disk>
Nov 13 10:12:09 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:12:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:12:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:12:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] No VIF found with MAC fa:16:3e:8c:f7:c5, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:12:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7b3c6125-884f-448d-87cf-517ad0261f83 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.312s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:11 user nova-compute[74611]: INFO nova.compute.manager [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Detaching volume 1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90
Nov 13 10:12:12 user nova-compute[74611]: INFO nova.virt.block_device [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Attempting to driver detach volume 1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 from mountpoint /dev/vdb
Nov 13 10:12:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Attempting to detach device vdb from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:12:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:12:12 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:12:12 user nova-compute[74611]:   <source dev="/dev/sdd"/>
Nov 13 10:12:12 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:12:12 user nova-compute[74611]:   <serial>1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90</serial>
Nov 13 10:12:12 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:12:12 user nova-compute[74611]: </disk>
Nov 13 10:12:12 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:12:12 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Successfully detached device vdb from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 from the persistent domain config.
Nov 13 10:12:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:12:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:12:12 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:12:12 user nova-compute[74611]:   <source dev="/dev/sdd"/>
Nov 13 10:12:12 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:12:12 user nova-compute[74611]:   <serial>1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90</serial>
Nov 13 10:12:12 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:12:12 user nova-compute[74611]: </disk>
Nov 13 10:12:12 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:12:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Starting finish_migration {{(pid=74611) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Instance directory exists: not creating {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 10:12:13 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Creating image(s)
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Ensure instance console log exists: /opt/stack/data/nova/instances/ed1dfac0-31b6-4e63-895e-29877e17d178/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Start _get_guest_xml network_info=[{"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-21995796-network", "vif_mac": "fa:16:3e:d0:42:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '36864ff4-8612-4ae1-90ea-4e1883908928', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZwVaFIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ed1dfac0-31b6-4e63-895e-29877e17d178', 'attached_at': '2023-11-13T10:12:13.000000', 'detached_at': '', 'volume_id': 'b211e65b-4e88-4035-8e8b-4cfb44706fbd', 'serial': 'b211e65b-4e88-4035-8e8b-4cfb44706fbd'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:12:13 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:12:13 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZwVaFIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:12:13 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:12:13 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:12:13 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d6def5-6eeb-499d-a917-35f1c81c3682]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:12:13 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59414a7-ecd3-4b0a-a50b-43017776ad79]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd] added
Nov 13 10:12:13 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e2b403-4499-49b7-93ae-97d916406cc8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f13f97-c1af-42e0-a89b-d4563dc2a608]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZwVaFIL {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZwVaFIL" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c991e5bd-95be-40f9-ba52-b34f20570d8a]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BZwVaFIL'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fe6d3e-af86-4f98-9c22-84aff0ff2941]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bc5ad4-2412-4db0-a6a6-90b7e89110be]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aeae0f4-5ef4-4816-aea8-f96e18ef41d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:12:13 user nova-compute[74611]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aeae0f4-5ef4-4816-aea8-f96e18ef41d0 (non-flash)
Nov 13 10:12:13 user nova-compute[74611]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 (non-flash)
Nov 13 10:12:13 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:12:13 user nova-compute[74611]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aeae0f4-5ef4-4816-aea8-f96e18ef41d0 (non-flash)
Nov 13 10:12:13 user nova-compute[74611]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 (non-flash)
Nov 13 10:12:13 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e195b0-c492-4f22-a545-d24df1928d6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd, portal: 172.16.0.220,3260]
Nov 13 10:12:13 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd, portal: 172.16.0.220,3260] successful.
Nov 13 10:12:13 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb711b91-3435-4a07-9df1-106e1de98da4]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[206283f4-cad2-4146-b515-b51e8db66f00]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aeae0f4-5ef4-4816-aea8-f96e18ef41d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:12:13 user nova-compute[74611]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aeae0f4-5ef4-4816-aea8-f96e18ef41d0 (non-flash)
Nov 13 10:12:13 user nova-compute[74611]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 (non-flash)
Nov 13 10:12:13 user nova-compute[74611]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:12:13 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:12:13 user nova-compute[74611]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aeae0f4-5ef4-4816-aea8-f96e18ef41d0 (non-flash)
Nov 13 10:12:13 user nova-compute[74611]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 (non-flash)
Nov 13 10:12:13 user nova-compute[74611]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:12:13 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ba27c9-93cc-4589-a813-ad5578dccd0f]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:12:13 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZwVaFIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23165343133326231', 'path': '/dev/sde'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165343133326231', 'path': '/dev/sde'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1947219481',display_name='tempest-ServerActionsTestOtherA-server-1947219481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1947219481',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyvkPZ/C5Pk5XOFxP5rMcYJVq0nGL8MEwZ1COcFqCFBcO7G74gr+o/bZOILVW3PDzyd5NY9xtWs0kgCNTm8xNQIJrW9d3YRiHEICGlxrvJ1iCAAc7YEKxcFMW7SpPA0Dw==',key_name='tempest-keypair-2093749558',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:10:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e6a0b0a078bd44908cd7cd4593914eef',ramdisk_id='',reservation_id='r-ixwiy3ki',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2135577355',owner_user_name='tempest-ServerActionsTestOtherA-2135577355-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22322be2dd04410b6cd53c31e639b3b',uuid=ed1dfac0-31b6-4e63-895e-29877e17d178,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-21995796-network", "vif_mac": "fa:16:3e:d0:42:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converting VIF {"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-21995796-network", "vif_mac": "fa:16:3e:d0:42:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:42:59,bridge_name='br-int',has_traffic_filtering=True,id=a53ebdb2-3917-46df-b5a3-af5682496fa8,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53ebdb2-39') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:12:14 user nova-compute[74611]:   <uuid>ed1dfac0-31b6-4e63-895e-29877e17d178</uuid>
Nov 13 10:12:14 user nova-compute[74611]:   <name>instance-0000002a</name>
Nov 13 10:12:14 user nova-compute[74611]:   <memory>2097152</memory>
Nov 13 10:12:14 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:12:14 user nova-compute[74611]:   <metadata>
Nov 13 10:12:14 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:12:14 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:12:14 user nova-compute[74611]:       <nova:name>tempest-ServerActionsTestOtherA-server-1947219481</nova:name>
Nov 13 10:12:14 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:12:13</nova:creationTime>
Nov 13 10:12:14 user nova-compute[74611]:       <nova:flavor name="m1.small">
Nov 13 10:12:14 user nova-compute[74611]:         <nova:memory>2048</nova:memory>
Nov 13 10:12:14 user nova-compute[74611]:         <nova:disk>20</nova:disk>
Nov 13 10:12:14 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:12:14 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:12:14 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:12:14 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:12:14 user nova-compute[74611]:       <nova:owner>
Nov 13 10:12:14 user nova-compute[74611]:         <nova:user uuid="f22322be2dd04410b6cd53c31e639b3b">tempest-ServerActionsTestOtherA-2135577355-project-member</nova:user>
Nov 13 10:12:14 user nova-compute[74611]:         <nova:project uuid="e6a0b0a078bd44908cd7cd4593914eef">tempest-ServerActionsTestOtherA-2135577355</nova:project>
Nov 13 10:12:14 user nova-compute[74611]:       </nova:owner>
Nov 13 10:12:14 user nova-compute[74611]:       <nova:ports>
Nov 13 10:12:14 user nova-compute[74611]:         <nova:port uuid="a53ebdb2-3917-46df-b5a3-af5682496fa8">
Nov 13 10:12:14 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 10:12:14 user nova-compute[74611]:         </nova:port>
Nov 13 10:12:14 user nova-compute[74611]:       </nova:ports>
Nov 13 10:12:14 user nova-compute[74611]:     </nova:instance>
Nov 13 10:12:14 user nova-compute[74611]:   </metadata>
Nov 13 10:12:14 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:12:14 user nova-compute[74611]:     <system>
Nov 13 10:12:14 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:12:14 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:12:14 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:12:14 user nova-compute[74611]:       <entry name="serial">ed1dfac0-31b6-4e63-895e-29877e17d178</entry>
Nov 13 10:12:14 user nova-compute[74611]:       <entry name="uuid">ed1dfac0-31b6-4e63-895e-29877e17d178</entry>
Nov 13 10:12:14 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:12:14 user nova-compute[74611]:     </system>
Nov 13 10:12:14 user nova-compute[74611]:   </sysinfo>
Nov 13 10:12:14 user nova-compute[74611]:   <os>
Nov 13 10:12:14 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:12:14 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:12:14 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:12:14 user nova-compute[74611]:   </os>
Nov 13 10:12:14 user nova-compute[74611]:   <features>
Nov 13 10:12:14 user nova-compute[74611]:     <acpi/>
Nov 13 10:12:14 user nova-compute[74611]:     <apic/>
Nov 13 10:12:14 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:12:14 user nova-compute[74611]:   </features>
Nov 13 10:12:14 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:12:14 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:12:14 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:12:14 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:12:14 user nova-compute[74611]:   </clock>
Nov 13 10:12:14 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:12:14 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:12:14 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:12:14 user nova-compute[74611]:   </cpu>
Nov 13 10:12:14 user nova-compute[74611]:   <devices>
Nov 13 10:12:14 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:12:14 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:12:14 user nova-compute[74611]:       <source dev="/dev/sde"/>
Nov 13 10:12:14 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:12:14 user nova-compute[74611]:       <serial>b211e65b-4e88-4035-8e8b-4cfb44706fbd</serial>
Nov 13 10:12:14 user nova-compute[74611]:     </disk>
Nov 13 10:12:14 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:12:14 user nova-compute[74611]:       <mac address="fa:16:3e:d0:42:59"/>
Nov 13 10:12:14 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:12:14 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:12:14 user nova-compute[74611]:       <target dev="tapa53ebdb2-39"/>
Nov 13 10:12:14 user nova-compute[74611]:     </interface>
Nov 13 10:12:14 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:12:14 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/ed1dfac0-31b6-4e63-895e-29877e17d178/console.log" append="off"/>
Nov 13 10:12:14 user nova-compute[74611]:     </serial>
Nov 13 10:12:14 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:12:14 user nova-compute[74611]:     <video>
Nov 13 10:12:14 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:12:14 user nova-compute[74611]:     </video>
Nov 13 10:12:14 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:12:14 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:12:14 user nova-compute[74611]:     </rng>
Nov 13 10:12:14 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:12:14 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:12:14 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:12:14 user nova-compute[74611]:     </memballoon>
Nov 13 10:12:14 user nova-compute[74611]:   </devices>
Nov 13 10:12:14 user nova-compute[74611]: </domain>
Nov 13 10:12:14 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1947219481',display_name='tempest-ServerActionsTestOtherA-server-1947219481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1947219481',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyvkPZ/C5Pk5XOFxP5rMcYJVq0nGL8MEwZ1COcFqCFBcO7G74gr+o/bZOILVW3PDzyd5NY9xtWs0kgCNTm8xNQIJrW9d3YRiHEICGlxrvJ1iCAAc7YEKxcFMW7SpPA0Dw==',key_name='tempest-keypair-2093749558',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:10:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e6a0b0a078bd44908cd7cd4593914eef',ramdisk_id='',reservation_id='r-ixwiy3ki',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2135577355',owner_user_name='tempest-ServerActionsTestOtherA-2135577355-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22322be2dd04410b6cd53c31e639b3b',uuid=ed1dfac0-31b6-4e63-895e-29877e17d178,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-21995796-network", "vif_mac": "fa:16:3e:d0:42:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converting VIF {"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-21995796-network", "vif_mac": "fa:16:3e:d0:42:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:42:59,bridge_name='br-int',has_traffic_filtering=True,id=a53ebdb2-3917-46df-b5a3-af5682496fa8,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53ebdb2-39') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG os_vif [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:42:59,bridge_name='br-int',has_traffic_filtering=True,id=a53ebdb2-3917-46df-b5a3-af5682496fa8,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53ebdb2-39') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e20e8b4-4fd7-58cb-8178-bc15aa48e731', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa53ebdb2-39, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa53ebdb2-39, col_values=(('qos', UUID('0bac5533-6708-466f-bc68-91f0196f5ace')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa53ebdb2-39, col_values=(('external_ids', {'iface-id': 'a53ebdb2-3917-46df-b5a3-af5682496fa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:42:59', 'vm-uuid': 'ed1dfac0-31b6-4e63-895e-29877e17d178'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:14 user nova-compute[74611]: INFO os_vif [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:42:59,bridge_name='br-int',has_traffic_filtering=True,id=a53ebdb2-3917-46df-b5a3-af5682496fa8,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53ebdb2-39')
Nov 13 10:12:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:12:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] No VIF found with MAC fa:16:3e:d0:42:59, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:12:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:16 user nova-compute[74611]: DEBUG nova.compute.manager [req-14441e0a-0c69-40b9-b15b-acf1ab55decf req-3ad5d12f-6fb4-4073-a680-c8e854f781f3 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received event network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:12:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-14441e0a-0c69-40b9-b15b-acf1ab55decf req-3ad5d12f-6fb4-4073-a680-c8e854f781f3 service nova] Acquiring lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-14441e0a-0c69-40b9-b15b-acf1ab55decf req-3ad5d12f-6fb4-4073-a680-c8e854f781f3 service nova] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-14441e0a-0c69-40b9-b15b-acf1ab55decf req-3ad5d12f-6fb4-4073-a680-c8e854f781f3 service nova] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:16 user nova-compute[74611]: DEBUG nova.compute.manager [req-14441e0a-0c69-40b9-b15b-acf1ab55decf req-3ad5d12f-6fb4-4073-a680-c8e854f781f3 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] No waiting events found dispatching network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:12:16 user nova-compute[74611]: WARNING nova.compute.manager [req-14441e0a-0c69-40b9-b15b-acf1ab55decf req-3ad5d12f-6fb4-4073-a680-c8e854f781f3 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received unexpected event network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 for instance with vm_state active and task_state resize_finish.
Nov 13 10:12:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:18 user nova-compute[74611]: DEBUG nova.compute.manager [req-56b968a2-d8d6-4252-9d59-5dcd918ed037 req-4de8180e-7036-4125-b530-1e50b1894cac service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received event network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:12:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-56b968a2-d8d6-4252-9d59-5dcd918ed037 req-4de8180e-7036-4125-b530-1e50b1894cac service nova] Acquiring lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-56b968a2-d8d6-4252-9d59-5dcd918ed037 req-4de8180e-7036-4125-b530-1e50b1894cac service nova] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-56b968a2-d8d6-4252-9d59-5dcd918ed037 req-4de8180e-7036-4125-b530-1e50b1894cac service nova] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:18 user nova-compute[74611]: DEBUG nova.compute.manager [req-56b968a2-d8d6-4252-9d59-5dcd918ed037 req-4de8180e-7036-4125-b530-1e50b1894cac service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] No waiting events found dispatching network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:12:18 user nova-compute[74611]: WARNING nova.compute.manager [req-56b968a2-d8d6-4252-9d59-5dcd918ed037 req-4de8180e-7036-4125-b530-1e50b1894cac service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received unexpected event network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 for instance with vm_state active and task_state resize_finish.
Nov 13 10:12:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:18 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:12:18 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Instance running successfully.
Nov 13 10:12:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Failed to set time: agent not configured {{(pid=74611) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 13 10:12:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e2870a40-4701-4742-be1e-46d317338b4e tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] finish_migration finished successfully. {{(pid=74611) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 13 10:12:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:27 user nova-compute[74611]: INFO nova.compute.manager [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Terminating instance
Nov 13 10:12:27 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-6de05e50-f1fd-4f7c-907c-aa1f048d3d3a req-76c66ba3-5717-4a90-abce-1c5a639d7de0 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received event network-vif-unplugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6de05e50-f1fd-4f7c-907c-aa1f048d3d3a req-76c66ba3-5717-4a90-abce-1c5a639d7de0 service nova] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6de05e50-f1fd-4f7c-907c-aa1f048d3d3a req-76c66ba3-5717-4a90-abce-1c5a639d7de0 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6de05e50-f1fd-4f7c-907c-aa1f048d3d3a req-76c66ba3-5717-4a90-abce-1c5a639d7de0 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-6de05e50-f1fd-4f7c-907c-aa1f048d3d3a req-76c66ba3-5717-4a90-abce-1c5a639d7de0 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] No waiting events found dispatching network-vif-unplugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-6de05e50-f1fd-4f7c-907c-aa1f048d3d3a req-76c66ba3-5717-4a90-abce-1c5a639d7de0 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received event network-vif-unplugged-37c25482-a620-4013-9e9d-e14c53d87bc4 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:28 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Instance destroyed successfully.
Nov 13 10:12:28 user nova-compute[74611]: DEBUG nova.objects.instance [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'resources' on Instance uuid 7c2479a4-1384-4845-86d8-b5fd26fa6ec4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:56:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-937478887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-937478887',id=16,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:58:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83e3b3233a5b43d682200d91f29a80b4',ramdisk_id='',reservation_id='r-qh3r9bur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-182847603',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:00:28Z,user_data=None,user_id='6bc911a5649643a6a3606d8b80e20eb0',uuid=7c2479a4-1384-4845-86d8-b5fd26fa6ec4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converting VIF {"id": "37c25482-a620-4013-9e9d-e14c53d87bc4", "address": "fa:16:3e:6e:fe:e6", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37c25482-a6", "ovs_interfaceid": "37c25482-a620-4013-9e9d-e14c53d87bc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:fe:e6,bridge_name='br-int',has_traffic_filtering=True,id=37c25482-a620-4013-9e9d-e14c53d87bc4,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37c25482-a6') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG os_vif [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:fe:e6,bridge_name='br-int',has_traffic_filtering=True,id=37c25482-a620-4013-9e9d-e14c53d87bc4,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37c25482-a6') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37c25482-a6, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01be56ec-91df-4ea2-9044-4175d59da97e) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:28 user nova-compute[74611]: INFO os_vif [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:fe:e6,bridge_name='br-int',has_traffic_filtering=True,id=37c25482-a620-4013-9e9d-e14c53d87bc4,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37c25482-a6')
Nov 13 10:12:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItvJYDgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:12:28 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:12:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d20602-0556-42e9-95fc-44d4d5103f2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:12:28 user nova-compute[74611]: No targets found.
Nov 13 10:12:28 user nova-compute[74611]: iSNS:
Nov 13 10:12:28 user nova-compute[74611]: No targets found.
Nov 13 10:12:28 user nova-compute[74611]: STATIC:
Nov 13 10:12:28 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd
Nov 13 10:12:28 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:12:28 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:12:28 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90
Nov 13 10:12:28 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:12:28 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:12:28 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a
Nov 13 10:12:28 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:12:28 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:12:28 user nova-compute[74611]: FIRMWARE:
Nov 13 10:12:28 user nova-compute[74611]: No targets found.
Nov 13 10:12:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:12:28 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:12:28 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82e1d72-5f6e-426d-a712-9bba32ad686e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30c18df-99c0-4157-bdee-469189ef6f29]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:12:28 user nova-compute[74611]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 (non-flash)
Nov 13 10:12:28 user nova-compute[74611]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:12:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a (non-flash)
Nov 13 10:12:28 user nova-compute[74611]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 (non-flash)
Nov 13 10:12:28 user nova-compute[74611]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:12:28 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8424e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a'): ({'sdc'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Removing single pathed devices sdc {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79226f0-158e-490b-b95e-8ec3bd3cc78a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[931904d4-d21b-4560-aab2-1ce3d05daddc]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Flushing IO for device /dev/sdc {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16d4631-8585-4024-bc05-3baaea4f72d1]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbadbc58-f808-49c0-9814-a35f4ed095fe]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] SCSI volumes sdc have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:12:28 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bfef6d-7841-4efe-82fa-b5d71bf11852]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4317a1a0-5bba-4cae-9d31-791d2b585879]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a, portal: 172.16.0.220,3260]
Nov 13 10:12:29 user nova-compute[74611]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a, portal: 172.16.0.220,3260] successful.
Nov 13 10:12:29 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef0ea4ff-01b2-4aad-aaa5-a33ff10cad8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a065a383-db1f-4082-b4e6-92263993bb66]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] <== disconnect_volume: return (371ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:12:29 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Deleting instance files /opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4_del
Nov 13 10:12:29 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Deletion of /opt/stack/data/nova/instances/7c2479a4-1384-4845-86d8-b5fd26fa6ec4_del complete
Nov 13 10:12:29 user nova-compute[74611]: INFO nova.compute.manager [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 13 10:12:29 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:12:29 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:12:29 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Took 0.51 seconds to deallocate network for instance.
Nov 13 10:12:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-be7e0151-63c3-4edb-b999-c4d2ec729c23 req-faf3fb34-b5e7-4a2b-bf47-0f94686c3a30 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received event network-vif-deleted-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:12:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-f7879fac-e1dd-41df-a22e-b9dab350821d req-2fde3f16-3a8e-4404-8f1b-3417300f0391 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:12:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f7879fac-e1dd-41df-a22e-b9dab350821d req-2fde3f16-3a8e-4404-8f1b-3417300f0391 service nova] Acquiring lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f7879fac-e1dd-41df-a22e-b9dab350821d req-2fde3f16-3a8e-4404-8f1b-3417300f0391 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f7879fac-e1dd-41df-a22e-b9dab350821d req-2fde3f16-3a8e-4404-8f1b-3417300f0391 service nova] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-f7879fac-e1dd-41df-a22e-b9dab350821d req-2fde3f16-3a8e-4404-8f1b-3417300f0391 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] No waiting events found dispatching network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:12:30 user nova-compute[74611]: WARNING nova.compute.manager [req-f7879fac-e1dd-41df-a22e-b9dab350821d req-2fde3f16-3a8e-4404-8f1b-3417300f0391 service nova] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Received unexpected event network-vif-plugged-37c25482-a620-4013-9e9d-e14c53d87bc4 for instance with vm_state active and task_state deleting.
Nov 13 10:12:30 user nova-compute[74611]: INFO nova.compute.manager [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: 7c2479a4-1384-4845-86d8-b5fd26fa6ec4] Took 0.83 seconds to detach 1 volumes for instance.
Nov 13 10:12:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:30 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:12:30 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:12:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:30 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Deleted allocations for instance 7c2479a4-1384-4845-86d8-b5fd26fa6ec4
Nov 13 10:12:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c3fb09c-7243-445b-aa68-6e65b219c127 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "7c2479a4-1384-4845-86d8-b5fd26fa6ec4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.194s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:32 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 is timed out.
Nov 13 10:12:32 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Successfully detached device vdb from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 from the live domain config.
Nov 13 10:12:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YAONwChI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:12:32 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1024afd-7883-4c6c-aa45-bf54d34cee2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:12:32 user nova-compute[74611]: No targets found.
Nov 13 10:12:32 user nova-compute[74611]: iSNS:
Nov 13 10:12:32 user nova-compute[74611]: No targets found.
Nov 13 10:12:32 user nova-compute[74611]: STATIC:
Nov 13 10:12:32 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd
Nov 13 10:12:32 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:12:32 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:12:32 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90
Nov 13 10:12:32 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:12:32 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:12:32 user nova-compute[74611]: FIRMWARE:
Nov 13 10:12:32 user nova-compute[74611]: No targets found.
Nov 13 10:12:32 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:12:32 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:12:32 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5867bd7a-dc1c-453b-b8cd-de988cf9875e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[814d027d-abca-42ad-b7fb-9b79f1d46105]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 (non-flash)
Nov 13 10:12:32 user nova-compute[74611]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:12:32 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 (non-flash)
Nov 13 10:12:32 user nova-compute[74611]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:12:32 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64426f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90'): ({'sdd'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Removing single pathed devices sdd {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2d3de0-d54f-45b2-85b4-e262da49d1d6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a1c824-9094-4f8d-92f3-c13534e56eeb]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Flushing IO for device /dev/sdd {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[98db2d55-1db1-4c18-8c12-6c4bfdc64948]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b334b2-c83b-48a3-a131-f0c4c34688b9]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] SCSI volumes sdd have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc82fbb-e865-4469-9830-d669ddb5c9c6]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b969a6e2-aaa7-4f49-9d47-967f32fa6fa0]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90, portal: 172.16.0.220,3260]
Nov 13 10:12:32 user nova-compute[74611]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90, portal: 172.16.0.220,3260] successful.
Nov 13 10:12:32 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f43e6b4-3e4d-4fb8-a7a3-99bfc7478c90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[25eda317-8869-43df-981c-88e31afd9081]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] <== disconnect_volume: return (306ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:12:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:12:33 user nova-compute[74611]: DEBUG nova.objects.instance [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lazy-loading 'flavor' on Instance uuid ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:12:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-4471073b-d741-4cf4-8997-df5aaf2194bf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.725s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:45 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:12:45 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:12:45 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Didn't find any instances for network info cache update. {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 10:12:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:46 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:12:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:46 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:12:46 user nova-compute[74611]: INFO nova.compute.claims [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Claim successful on node user
Nov 13 10:12:46 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:12:46 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:12:47 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:12:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG nova.policy [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a643b3a9df3483a83d820a5a50470bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0786686c4b784fd5a1506dcf5c008787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:12:47 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Creating image(s)
Nov 13 10:12:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "/opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "/opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.225s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Successfully created port: 807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk 1073741824" returned: 0 in 0.057s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:12:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Cannot resize image /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Ensure instance console log exists: /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Successfully updated port: 807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "refresh_cache-0c8cec16-35fd-4ea1-b512-fbc3bb202419" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquired lock "refresh_cache-0c8cec16-35fd-4ea1-b512-fbc3bb202419" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.compute.manager [req-238d3493-f08c-4d68-b502-5a587f61486d req-f86a3449-5be4-4994-b3b7-705abf7f4c58 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received event network-changed-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.compute.manager [req-238d3493-f08c-4d68-b502-5a587f61486d req-f86a3449-5be4-4994-b3b7-705abf7f4c58 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Refreshing instance network info cache due to event network-changed-807d0dcb-b698-4b63-a67d-af5ddced6f09. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-238d3493-f08c-4d68-b502-5a587f61486d req-f86a3449-5be4-4994-b3b7-705abf7f4c58 service nova] Acquiring lock "refresh_cache-0c8cec16-35fd-4ea1-b512-fbc3bb202419" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Updating instance_info_cache with network_info: [{"id": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "address": "fa:16:3e:90:fa:3c", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d0dcb-b6", "ovs_interfaceid": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Releasing lock "refresh_cache-0c8cec16-35fd-4ea1-b512-fbc3bb202419" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Instance network_info: |[{"id": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "address": "fa:16:3e:90:fa:3c", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d0dcb-b6", "ovs_interfaceid": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-238d3493-f08c-4d68-b502-5a587f61486d req-f86a3449-5be4-4994-b3b7-705abf7f4c58 service nova] Acquired lock "refresh_cache-0c8cec16-35fd-4ea1-b512-fbc3bb202419" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.network.neutron [req-238d3493-f08c-4d68-b502-5a587f61486d req-f86a3449-5be4-4994-b3b7-705abf7f4c58 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Refreshing network info cache for port 807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Start _get_guest_xml network_info=[{"id": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "address": "fa:16:3e:90:fa:3c", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d0dcb-b6", "ovs_interfaceid": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:48 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:12:48 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:12:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-599850191',display_name='tempest-VolumesActionsTest-instance-599850191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-599850191',id=44,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0786686c4b784fd5a1506dcf5c008787',ramdisk_id='',reservation_id='r-1151db9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2131906562',owner_user_name='tempest-VolumesActionsTest-2131906562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:12:47Z,user_data=None,user_id='9a643b3a9df3483a83d820a5a50470bc',uuid=0c8cec16-35fd-4ea1-b512-fbc3bb202419,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "address": "fa:16:3e:90:fa:3c", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d0dcb-b6", "ovs_interfaceid": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Converting VIF {"id": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "address": "fa:16:3e:90:fa:3c", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d0dcb-b6", "ovs_interfaceid": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:fa:3c,bridge_name='br-int',has_traffic_filtering=True,id=807d0dcb-b698-4b63-a67d-af5ddced6f09,network=Network(3450369c-e903-4091-a496-1ce7fecf7d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807d0dcb-b6') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c8cec16-35fd-4ea1-b512-fbc3bb202419 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:12:48 user nova-compute[74611]:   <uuid>0c8cec16-35fd-4ea1-b512-fbc3bb202419</uuid>
Nov 13 10:12:48 user nova-compute[74611]:   <name>instance-0000002c</name>
Nov 13 10:12:48 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:12:48 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:12:48 user nova-compute[74611]:   <metadata>
Nov 13 10:12:48 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:12:48 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:12:48 user nova-compute[74611]:       <nova:name>tempest-VolumesActionsTest-instance-599850191</nova:name>
Nov 13 10:12:48 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:12:48</nova:creationTime>
Nov 13 10:12:48 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:12:48 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:12:48 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:12:48 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:12:48 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:12:48 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:12:48 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:12:48 user nova-compute[74611]:       <nova:owner>
Nov 13 10:12:48 user nova-compute[74611]:         <nova:user uuid="9a643b3a9df3483a83d820a5a50470bc">tempest-VolumesActionsTest-2131906562-project-member</nova:user>
Nov 13 10:12:48 user nova-compute[74611]:         <nova:project uuid="0786686c4b784fd5a1506dcf5c008787">tempest-VolumesActionsTest-2131906562</nova:project>
Nov 13 10:12:48 user nova-compute[74611]:       </nova:owner>
Nov 13 10:12:48 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:12:48 user nova-compute[74611]:       <nova:ports>
Nov 13 10:12:48 user nova-compute[74611]:         <nova:port uuid="807d0dcb-b698-4b63-a67d-af5ddced6f09">
Nov 13 10:12:48 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 10:12:48 user nova-compute[74611]:         </nova:port>
Nov 13 10:12:48 user nova-compute[74611]:       </nova:ports>
Nov 13 10:12:48 user nova-compute[74611]:     </nova:instance>
Nov 13 10:12:48 user nova-compute[74611]:   </metadata>
Nov 13 10:12:48 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:12:48 user nova-compute[74611]:     <system>
Nov 13 10:12:48 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:12:48 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:12:48 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:12:48 user nova-compute[74611]:       <entry name="serial">0c8cec16-35fd-4ea1-b512-fbc3bb202419</entry>
Nov 13 10:12:48 user nova-compute[74611]:       <entry name="uuid">0c8cec16-35fd-4ea1-b512-fbc3bb202419</entry>
Nov 13 10:12:48 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:12:48 user nova-compute[74611]:     </system>
Nov 13 10:12:48 user nova-compute[74611]:   </sysinfo>
Nov 13 10:12:48 user nova-compute[74611]:   <os>
Nov 13 10:12:48 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:12:48 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:12:48 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:12:48 user nova-compute[74611]:   </os>
Nov 13 10:12:48 user nova-compute[74611]:   <features>
Nov 13 10:12:48 user nova-compute[74611]:     <acpi/>
Nov 13 10:12:48 user nova-compute[74611]:     <apic/>
Nov 13 10:12:48 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:12:48 user nova-compute[74611]:   </features>
Nov 13 10:12:48 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:12:48 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:12:48 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:12:48 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:12:48 user nova-compute[74611]:   </clock>
Nov 13 10:12:48 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:12:48 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:12:48 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:12:48 user nova-compute[74611]:   </cpu>
Nov 13 10:12:48 user nova-compute[74611]:   <devices>
Nov 13 10:12:48 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:12:48 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:12:48 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk"/>
Nov 13 10:12:48 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:12:48 user nova-compute[74611]:     </disk>
Nov 13 10:12:48 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:12:48 user nova-compute[74611]:       <mac address="fa:16:3e:90:fa:3c"/>
Nov 13 10:12:48 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:12:48 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:12:48 user nova-compute[74611]:       <target dev="tap807d0dcb-b6"/>
Nov 13 10:12:48 user nova-compute[74611]:     </interface>
Nov 13 10:12:48 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:12:48 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/console.log" append="off"/>
Nov 13 10:12:48 user nova-compute[74611]:     </serial>
Nov 13 10:12:48 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:12:48 user nova-compute[74611]:     <video>
Nov 13 10:12:48 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:12:48 user nova-compute[74611]:     </video>
Nov 13 10:12:48 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:12:48 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:12:48 user nova-compute[74611]:     </rng>
Nov 13 10:12:48 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:12:48 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:12:48 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:12:48 user nova-compute[74611]:     </memballoon>
Nov 13 10:12:48 user nova-compute[74611]:   </devices>
Nov 13 10:12:48 user nova-compute[74611]: </domain>
Nov 13 10:12:48 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:12:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-599850191',display_name='tempest-VolumesActionsTest-instance-599850191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-599850191',id=44,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0786686c4b784fd5a1506dcf5c008787',ramdisk_id='',reservation_id='r-1151db9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2131906562',owner_user_name='tempest-VolumesActionsTest-2131906562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:12:47Z,user_data=None,user_id='9a643b3a9df3483a83d820a5a50470bc',uuid=0c8cec16-35fd-4ea1-b512-fbc3bb202419,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "address": "fa:16:3e:90:fa:3c", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d0dcb-b6", "ovs_interfaceid": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Converting VIF {"id": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "address": "fa:16:3e:90:fa:3c", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d0dcb-b6", "ovs_interfaceid": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:fa:3c,bridge_name='br-int',has_traffic_filtering=True,id=807d0dcb-b698-4b63-a67d-af5ddced6f09,network=Network(3450369c-e903-4091-a496-1ce7fecf7d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807d0dcb-b6') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG os_vif [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:fa:3c,bridge_name='br-int',has_traffic_filtering=True,id=807d0dcb-b698-4b63-a67d-af5ddced6f09,network=Network(3450369c-e903-4091-a496-1ce7fecf7d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807d0dcb-b6') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f96fabbc-0bdc-5d89-b8ab-23ecbac719d8', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap807d0dcb-b6, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap807d0dcb-b6, col_values=(('qos', UUID('b175bad6-acd4-4932-b096-036441ca818f')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap807d0dcb-b6, col_values=(('external_ids', {'iface-id': '807d0dcb-b698-4b63-a67d-af5ddced6f09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:fa:3c', 'vm-uuid': '0c8cec16-35fd-4ea1-b512-fbc3bb202419'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:48 user nova-compute[74611]: INFO os_vif [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:fa:3c,bridge_name='br-int',has_traffic_filtering=True,id=807d0dcb-b698-4b63-a67d-af5ddced6f09,network=Network(3450369c-e903-4091-a496-1ce7fecf7d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807d0dcb-b6')
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:12:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] No VIF found with MAC fa:16:3e:90:fa:3c, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:12:49 user nova-compute[74611]: DEBUG nova.network.neutron [req-238d3493-f08c-4d68-b502-5a587f61486d req-f86a3449-5be4-4994-b3b7-705abf7f4c58 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Updated VIF entry in instance network info cache for port 807d0dcb-b698-4b63-a67d-af5ddced6f09. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:12:49 user nova-compute[74611]: DEBUG nova.network.neutron [req-238d3493-f08c-4d68-b502-5a587f61486d req-f86a3449-5be4-4994-b3b7-705abf7f4c58 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Updating instance_info_cache with network_info: [{"id": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "address": "fa:16:3e:90:fa:3c", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d0dcb-b6", "ovs_interfaceid": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:12:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-238d3493-f08c-4d68-b502-5a587f61486d req-f86a3449-5be4-4994-b3b7-705abf7f4c58 service nova] Releasing lock "refresh_cache-0c8cec16-35fd-4ea1-b512-fbc3bb202419" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:12:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-4d0ac582-fe9c-4d84-8340-b1b14877e679 req-6545a30a-e13a-4279-b587-1d6620f3cbaa service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received event network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:12:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4d0ac582-fe9c-4d84-8340-b1b14877e679 req-6545a30a-e13a-4279-b587-1d6620f3cbaa service nova] Acquiring lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4d0ac582-fe9c-4d84-8340-b1b14877e679 req-6545a30a-e13a-4279-b587-1d6620f3cbaa service nova] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4d0ac582-fe9c-4d84-8340-b1b14877e679 req-6545a30a-e13a-4279-b587-1d6620f3cbaa service nova] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-4d0ac582-fe9c-4d84-8340-b1b14877e679 req-6545a30a-e13a-4279-b587-1d6620f3cbaa service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] No waiting events found dispatching network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:12:50 user nova-compute[74611]: WARNING nova.compute.manager [req-4d0ac582-fe9c-4d84-8340-b1b14877e679 req-6545a30a-e13a-4279-b587-1d6620f3cbaa service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received unexpected event network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 for instance with vm_state building and task_state spawning.
Nov 13 10:12:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:12:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:12:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:12:52 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:12:52 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:12:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:12:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:12:52 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Instance spawned successfully.
Nov 13 10:12:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:12:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:12:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:12:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:12:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:12:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:12:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:12:52 user nova-compute[74611]: INFO nova.compute.manager [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 13 10:12:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:12:52 user nova-compute[74611]: INFO nova.compute.manager [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Took 5.91 seconds to build instance.
Nov 13 10:12:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2c37bc8f-b17e-4442-aaf3-22e3a6d36ac2 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.999s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-18164211-7771-4cab-a59a-d080b068b749 req-3297d6f4-1876-4956-8bb7-0956314fe735 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received event network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:12:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18164211-7771-4cab-a59a-d080b068b749 req-3297d6f4-1876-4956-8bb7-0956314fe735 service nova] Acquiring lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18164211-7771-4cab-a59a-d080b068b749 req-3297d6f4-1876-4956-8bb7-0956314fe735 service nova] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-18164211-7771-4cab-a59a-d080b068b749 req-3297d6f4-1876-4956-8bb7-0956314fe735 service nova] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-18164211-7771-4cab-a59a-d080b068b749 req-3297d6f4-1876-4956-8bb7-0956314fe735 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] No waiting events found dispatching network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:12:52 user nova-compute[74611]: WARNING nova.compute.manager [req-18164211-7771-4cab-a59a-d080b068b749 req-3297d6f4-1876-4956-8bb7-0956314fe735 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received unexpected event network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 for instance with vm_state active and task_state None.
Nov 13 10:12:53 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:12:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:57 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:12:58 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:12:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:12:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:12:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:12:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:12:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:12:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:12:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:12:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:12:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:13:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:13:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8147MB free_disk=25.140605926513672GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:13:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Applying migration context for instance ed1dfac0-31b6-4e63-895e-29877e17d178 as it has an incoming, in-progress migration f8cefb2f-0d41-4528-aca2-0a3d4a07f922. Migration status is finished {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 10:13:00 user nova-compute[74611]: INFO nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Updating resource usage from migration f8cefb2f-0d41-4528-aca2-0a3d4a07f922
Nov 13 10:13:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:13:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:13:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:13:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4704cd02-59cc-4d64-804a-79a38d05b00e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:13:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Migration f8cefb2f-0d41-4528-aca2-0a3d4a07f922 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 10:13:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ed1dfac0-31b6-4e63-895e-29877e17d178 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:13:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 0c8cec16-35fd-4ea1-b512-fbc3bb202419 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:13:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:13:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:13:00 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:13:00 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:13:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:13:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:02 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:13:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:03 user nova-compute[74611]: DEBUG nova.objects.instance [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lazy-loading 'flavor' on Instance uuid ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:13:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:04 user nova-compute[74611]: INFO nova.compute.manager [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Attaching volume b641ca2f-4d06-4e50-b69f-cbd50b43079c to /dev/vdb
Nov 13 10:13:04 user nova-compute[74611]: DEBUG os_brick.utils [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3bb0ee-1e16-415f-a10a-628de34d6f3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c94c77c-3702-4f1d-bc80-cee4b7566841]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38d08ac-b2b3-423f-b056-955f3a98d0ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[14836e7b-1051-429c-9e35-96ec2cddc25f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:13:04 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:13:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc04a56-b830-4854-b3e3-4cee252e08bb]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG os_brick.utils [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Updating existing volume attachment record: bfd30406-a23d-4db7-88aa-e9faa51149be {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:13:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKxhEdWB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:13:08 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:13:08 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:13:08 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39ea24d-e041-45a3-afa1-34d721d086ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:13:08 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[46df3b54-bf00-4eed-841b-e04c46ee5e47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c] added
Nov 13 10:13:08 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6908855-8850-4664-9fbe-ec0636d203de]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bf3a2a-3643-4761-b3d5-bd20ccc174f8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKxhEdWB {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKxhEdWB" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f31c29-9a6d-4b95-9df4-2933d33cd6c2]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XKxhEdWB'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bb14b6-3a95-4098-9b86-c2e0dcbdcfb9]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc218155-3398-4531-9895-0e7c86108d0e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:13:08 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:13:08 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bcc7fd-c12e-42b6-bd4c-51835a4b16f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c, portal: 172.16.0.220,3260]
Nov 13 10:13:08 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c, portal: 172.16.0.220,3260] successful.
Nov 13 10:13:08 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c2c958-aad6-4e4a-80de-64605effdff2]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcedb33-bcf7-45c7-824a-0cfbaac70ace]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:13:08 user nova-compute[74611]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c (non-flash)
Nov 13 10:13:08 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:13:08 user nova-compute[74611]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c (non-flash)
Nov 13 10:13:08 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0479abe-1bbc-41ba-878e-fa0e20e8b347]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKxhEdWB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:13:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:09 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:13:09 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23535373431356431', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:13:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535373431356431', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:13:09 user nova-compute[74611]: DEBUG nova.objects.instance [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lazy-loading 'flavor' on Instance uuid ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:13:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:13:09 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:13:09 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:13:09 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:13:09 user nova-compute[74611]:   <serial>b641ca2f-4d06-4e50-b69f-cbd50b43079c</serial>
Nov 13 10:13:09 user nova-compute[74611]: </disk>
Nov 13 10:13:09 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:13:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:13:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:13:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] No VIF found with MAC fa:16:3e:8c:f7:c5, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:13:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-89d7de04-43c5-419f-acd3-3fbca8d3db0b tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.324s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:12 user nova-compute[74611]: INFO nova.compute.manager [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Detaching volume b641ca2f-4d06-4e50-b69f-cbd50b43079c
Nov 13 10:13:12 user nova-compute[74611]: INFO nova.virt.block_device [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Attempting to driver detach volume b641ca2f-4d06-4e50-b69f-cbd50b43079c from mountpoint /dev/vdb
Nov 13 10:13:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Attempting to detach device vdb from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:13:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:13:12 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:13:12 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:13:12 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:13:12 user nova-compute[74611]:   <serial>b641ca2f-4d06-4e50-b69f-cbd50b43079c</serial>
Nov 13 10:13:12 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:13:12 user nova-compute[74611]: </disk>
Nov 13 10:13:12 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:13:12 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Successfully detached device vdb from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 from the persistent domain config.
Nov 13 10:13:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:13:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:13:12 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:13:12 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:13:12 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:13:12 user nova-compute[74611]:   <serial>b641ca2f-4d06-4e50-b69f-cbd50b43079c</serial>
Nov 13 10:13:12 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:13:12 user nova-compute[74611]: </disk>
Nov 13 10:13:12 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:13:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:13:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:18 user nova-compute[74611]: INFO nova.compute.manager [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Terminating instance
Nov 13 10:13:18 user nova-compute[74611]: DEBUG nova.compute.manager [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:13:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-97b8e27b-e048-422d-8122-c557da727f57 req-418a033e-7c5b-4dc7-91e0-a89bdf72d5b0 service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Received event network-vif-unplugged-e5967c05-de89-4853-b421-516eb483271e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-97b8e27b-e048-422d-8122-c557da727f57 req-418a033e-7c5b-4dc7-91e0-a89bdf72d5b0 service nova] Acquiring lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-97b8e27b-e048-422d-8122-c557da727f57 req-418a033e-7c5b-4dc7-91e0-a89bdf72d5b0 service nova] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-97b8e27b-e048-422d-8122-c557da727f57 req-418a033e-7c5b-4dc7-91e0-a89bdf72d5b0 service nova] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-97b8e27b-e048-422d-8122-c557da727f57 req-418a033e-7c5b-4dc7-91e0-a89bdf72d5b0 service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] No waiting events found dispatching network-vif-unplugged-e5967c05-de89-4853-b421-516eb483271e {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-97b8e27b-e048-422d-8122-c557da727f57 req-418a033e-7c5b-4dc7-91e0-a89bdf72d5b0 service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Received event network-vif-unplugged-e5967c05-de89-4853-b421-516eb483271e for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:19 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Instance destroyed successfully.
Nov 13 10:13:19 user nova-compute[74611]: DEBUG nova.objects.instance [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lazy-loading 'resources' on Instance uuid f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-806042334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-806042334',id=2,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83e3b3233a5b43d682200d91f29a80b4',ramdisk_id='',reservation_id='r-ouqg89w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-182847603',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:55:37Z,user_data=None,user_id='6bc911a5649643a6a3606d8b80e20eb0',uuid=f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5967c05-de89-4853-b421-516eb483271e", "address": "fa:16:3e:c6:32:07", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5967c05-de", "ovs_interfaceid": "e5967c05-de89-4853-b421-516eb483271e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converting VIF {"id": "e5967c05-de89-4853-b421-516eb483271e", "address": "fa:16:3e:c6:32:07", "network": {"id": "e717266b-de93-4986-bcbc-9d45655b44c8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-309556444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e3b3233a5b43d682200d91f29a80b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5967c05-de", "ovs_interfaceid": "e5967c05-de89-4853-b421-516eb483271e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:32:07,bridge_name='br-int',has_traffic_filtering=True,id=e5967c05-de89-4853-b421-516eb483271e,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5967c05-de') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG os_vif [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:32:07,bridge_name='br-int',has_traffic_filtering=True,id=e5967c05-de89-4853-b421-516eb483271e,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5967c05-de') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5967c05-de, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80670a0e-2cf0-4180-927f-8cf24cb9fba3) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:13:19 user nova-compute[74611]: INFO os_vif [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:32:07,bridge_name='br-int',has_traffic_filtering=True,id=e5967c05-de89-4853-b421-516eb483271e,network=Network(e717266b-de93-4986-bcbc-9d45655b44c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5967c05-de')
Nov 13 10:13:19 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Deleting instance files /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28_del
Nov 13 10:13:19 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Deletion of /opt/stack/data/nova/instances/f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28_del complete
Nov 13 10:13:19 user nova-compute[74611]: INFO nova.compute.manager [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 13 10:13:19 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:13:19 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:13:20 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:13:20 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Took 0.44 seconds to deallocate network for instance.
Nov 13 10:13:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:20 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:13:20 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:13:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:20 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Deleted allocations for instance f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28
Nov 13 10:13:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-a383e39d-a218-44c7-9e39-83e2a7260801 tempest-ServerBootFromVolumeStableRescueTest-182847603 tempest-ServerBootFromVolumeStableRescueTest-182847603-project-member] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.819s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:21 user nova-compute[74611]: DEBUG nova.compute.manager [req-bd8e5070-fc04-4fa7-9d6b-1c746718ea05 req-d4ae45d6-ae47-4a60-8502-ec2401387d6f service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Received event network-vif-plugged-e5967c05-de89-4853-b421-516eb483271e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:13:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bd8e5070-fc04-4fa7-9d6b-1c746718ea05 req-d4ae45d6-ae47-4a60-8502-ec2401387d6f service nova] Acquiring lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bd8e5070-fc04-4fa7-9d6b-1c746718ea05 req-d4ae45d6-ae47-4a60-8502-ec2401387d6f service nova] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bd8e5070-fc04-4fa7-9d6b-1c746718ea05 req-d4ae45d6-ae47-4a60-8502-ec2401387d6f service nova] Lock "f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:21 user nova-compute[74611]: DEBUG nova.compute.manager [req-bd8e5070-fc04-4fa7-9d6b-1c746718ea05 req-d4ae45d6-ae47-4a60-8502-ec2401387d6f service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] No waiting events found dispatching network-vif-plugged-e5967c05-de89-4853-b421-516eb483271e {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:13:21 user nova-compute[74611]: WARNING nova.compute.manager [req-bd8e5070-fc04-4fa7-9d6b-1c746718ea05 req-d4ae45d6-ae47-4a60-8502-ec2401387d6f service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Received unexpected event network-vif-plugged-e5967c05-de89-4853-b421-516eb483271e for instance with vm_state deleted and task_state None.
Nov 13 10:13:21 user nova-compute[74611]: DEBUG nova.compute.manager [req-bd8e5070-fc04-4fa7-9d6b-1c746718ea05 req-d4ae45d6-ae47-4a60-8502-ec2401387d6f service nova] [instance: f3716991-d8b9-47d3-bf7d-cfe1c6d0cd28] Received event network-vif-deleted-e5967c05-de89-4853-b421-516eb483271e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:13:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:32 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 is timed out.
Nov 13 10:13:32 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Successfully detached device vdb from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 from the live domain config.
Nov 13 10:13:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKxhEdWB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:13:32 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:13:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbfac20-38a1-47f0-bb15-a5c46de657db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:13:32 user nova-compute[74611]: No targets found.
Nov 13 10:13:32 user nova-compute[74611]: iSNS:
Nov 13 10:13:32 user nova-compute[74611]: No targets found.
Nov 13 10:13:32 user nova-compute[74611]: STATIC:
Nov 13 10:13:32 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd
Nov 13 10:13:32 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:13:32 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:13:32 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c
Nov 13 10:13:32 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:13:32 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:13:32 user nova-compute[74611]: FIRMWARE:
Nov 13 10:13:32 user nova-compute[74611]: No targets found.
Nov 13 10:13:32 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:13:32 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:13:32 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6eb5606-cf20-46f3-b5c7-e82de7fdf9f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f476220a-1cec-4145-94a5-2d30dd8a63f1]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:13:32 user nova-compute[74611]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c (non-flash)
Nov 13 10:13:32 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:13:32 user nova-compute[74611]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c (non-flash)
Nov 13 10:13:32 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb645ceef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e839096c-eeee-4444-8d27-bd2306e0bcce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1735c57a-d42b-4f21-b96b-150f45bd7a35]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[54851d5f-face-442e-99f9-2dfdcf8c4a4f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b7d4a5-4ccf-4f9a-8176-de5235f6da7d]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50caed4-a43b-4e92-aaa2-2dac5c3fd582]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0934e6e-29ca-4871-99b3-81f0095c498f]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c, portal: 172.16.0.220,3260]
Nov 13 10:13:33 user nova-compute[74611]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c, portal: 172.16.0.220,3260] successful.
Nov 13 10:13:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b641ca2f-4d06-4e50-b69f-cbd50b43079c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb02e02-440e-43ad-a607-a9527bf602ea]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:13:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] <== disconnect_volume: return (312ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:13:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:13:33 user nova-compute[74611]: DEBUG nova.objects.instance [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lazy-loading 'flavor' on Instance uuid ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:13:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d34020a1-52a9-439c-9ddd-e2579c7762a2 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.601s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "4704cd02-59cc-4d64-804a-79a38d05b00e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG nova.objects.instance [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lazy-loading 'flavor' on Instance uuid 4704cd02-59cc-4d64-804a-79a38d05b00e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "4704cd02-59cc-4d64-804a-79a38d05b00e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:37 user nova-compute[74611]: INFO nova.compute.manager [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Attaching volume 89921eed-fd6a-4b41-af43-eec15a47fe73 to /dev/vdb
Nov 13 10:13:37 user nova-compute[74611]: DEBUG os_brick.utils [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[697ab1ff-2124-4a93-9069-91caab632c76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acb862e-1d84-413a-a3b3-ddda9da5845c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c11ae0-c7c7-4bdd-8251-5820af936ffc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c973073b-c077-4df0-a2cb-1bcd517fbd58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:13:37 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:13:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93261bf-890f-4d1a-a8e6-6939f5ec421e]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG os_brick.utils [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:13:37 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Updating existing volume attachment record: a82e35e4-99ae-423d-a33a-baa03a76bd5b {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:13:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPANsqny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:13:41 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:13:41 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:13:41 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1510ad4e-b819-4794-807c-f51a686da17c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:13:41 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d43176c-0c5c-4c8a-9fac-e940593ae310]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73] added
Nov 13 10:13:41 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcebe37-276c-4e60-bc1e-8f57de9be197]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2cf42e-28ae-4890-896a-467931ebd7b0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EPANsqny {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EPANsqny" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd16f9b7-3614-4f3f-84d6-b780529b2f1a]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EPANsqny'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a562fa8f-950a-4e79-82b1-7724764cc6a3]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3005f08d-ffe4-4f72-90be-d60e6c70f0de]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:13:41 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:13:41 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77b81ae-3df9-4eff-a048-5045607cde42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73, portal: 172.16.0.220,3260]
Nov 13 10:13:41 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73, portal: 172.16.0.220,3260] successful.
Nov 13 10:13:41 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[15605241-9794-406e-91d6-7773305d3ffe]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a050e7-6816-433d-b467-5a31c0c3ade9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:13:41 user nova-compute[74611]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)
Nov 13 10:13:41 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:13:41 user nova-compute[74611]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)
Nov 13 10:13:41 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[690ad361-f02b-46a9-94a7-a0a6e3cc18ba]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:13:41 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPANsqny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:13:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:13:42 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23239633635343564', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:13:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239633635343564', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:13:42 user nova-compute[74611]: DEBUG nova.objects.instance [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lazy-loading 'flavor' on Instance uuid 4704cd02-59cc-4d64-804a-79a38d05b00e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:13:42 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:13:42 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:13:42 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:13:42 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:13:42 user nova-compute[74611]:   <serial>89921eed-fd6a-4b41-af43-eec15a47fe73</serial>
Nov 13 10:13:42 user nova-compute[74611]: </disk>
Nov 13 10:13:42 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:13:43 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:13:43 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:13:43 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] No VIF found with MAC fa:16:3e:13:6c:f6, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:13:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ed6ac56-71ed-43b3-93d6-8bfac862ca2a tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.884s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:13:46 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:13:46 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:13:46 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:13:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:13:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:13:46 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:13:46 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid 822a3afe-eae1-4960-b347-89c58fb10c4c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:13:46 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Updating instance_info_cache with network_info: [{"id": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "address": "fa:16:3e:b7:e1:19", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ef27e1-e7", "ovs_interfaceid": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:13:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-822a3afe-eae1-4960-b347-89c58fb10c4c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:13:46 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:13:47 user nova-compute[74611]: DEBUG nova.compute.manager [req-78984f14-8364-418c-8a0e-f3719d6490de req-47274bf6-95ad-48f2-a332-0bec439a64f8 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received event network-changed-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:13:47 user nova-compute[74611]: DEBUG nova.compute.manager [req-78984f14-8364-418c-8a0e-f3719d6490de req-47274bf6-95ad-48f2-a332-0bec439a64f8 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Refreshing instance network info cache due to event network-changed-457c4784-2cc7-4521-8d86-86845bce490e. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:13:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-78984f14-8364-418c-8a0e-f3719d6490de req-47274bf6-95ad-48f2-a332-0bec439a64f8 service nova] Acquiring lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:13:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-78984f14-8364-418c-8a0e-f3719d6490de req-47274bf6-95ad-48f2-a332-0bec439a64f8 service nova] Acquired lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:13:47 user nova-compute[74611]: DEBUG nova.network.neutron [req-78984f14-8364-418c-8a0e-f3719d6490de req-47274bf6-95ad-48f2-a332-0bec439a64f8 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Refreshing network info cache for port 457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:13:47 user nova-compute[74611]: DEBUG nova.network.neutron [req-78984f14-8364-418c-8a0e-f3719d6490de req-47274bf6-95ad-48f2-a332-0bec439a64f8 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Updated VIF entry in instance network info cache for port 457c4784-2cc7-4521-8d86-86845bce490e. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:13:47 user nova-compute[74611]: DEBUG nova.network.neutron [req-78984f14-8364-418c-8a0e-f3719d6490de req-47274bf6-95ad-48f2-a332-0bec439a64f8 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Updating instance_info_cache with network_info: [{"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:13:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-78984f14-8364-418c-8a0e-f3719d6490de req-47274bf6-95ad-48f2-a332-0bec439a64f8 service nova] Releasing lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:13:49 user nova-compute[74611]: DEBUG nova.compute.manager [req-bf1c9467-9cd6-422d-885a-2a741a2e7ff4 req-d16a570c-c070-41d2-86ab-4ca2aa3f7bb3 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received event network-changed-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:13:49 user nova-compute[74611]: DEBUG nova.compute.manager [req-bf1c9467-9cd6-422d-885a-2a741a2e7ff4 req-d16a570c-c070-41d2-86ab-4ca2aa3f7bb3 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Refreshing instance network info cache due to event network-changed-457c4784-2cc7-4521-8d86-86845bce490e. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:13:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bf1c9467-9cd6-422d-885a-2a741a2e7ff4 req-d16a570c-c070-41d2-86ab-4ca2aa3f7bb3 service nova] Acquiring lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:13:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bf1c9467-9cd6-422d-885a-2a741a2e7ff4 req-d16a570c-c070-41d2-86ab-4ca2aa3f7bb3 service nova] Acquired lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:13:49 user nova-compute[74611]: DEBUG nova.network.neutron [req-bf1c9467-9cd6-422d-885a-2a741a2e7ff4 req-d16a570c-c070-41d2-86ab-4ca2aa3f7bb3 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Refreshing network info cache for port 457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:13:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:49 user nova-compute[74611]: DEBUG nova.network.neutron [req-bf1c9467-9cd6-422d-885a-2a741a2e7ff4 req-d16a570c-c070-41d2-86ab-4ca2aa3f7bb3 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Updated VIF entry in instance network info cache for port 457c4784-2cc7-4521-8d86-86845bce490e. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:13:49 user nova-compute[74611]: DEBUG nova.network.neutron [req-bf1c9467-9cd6-422d-885a-2a741a2e7ff4 req-d16a570c-c070-41d2-86ab-4ca2aa3f7bb3 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Updating instance_info_cache with network_info: [{"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:13:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bf1c9467-9cd6-422d-885a-2a741a2e7ff4 req-d16a570c-c070-41d2-86ab-4ca2aa3f7bb3 service nova] Releasing lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "4704cd02-59cc-4d64-804a-79a38d05b00e" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:51 user nova-compute[74611]: INFO nova.compute.manager [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Rebooting instance
Nov 13 10:13:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquired lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG nova.network.neutron [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "ed1dfac0-31b6-4e63-895e-29877e17d178" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Going to confirm migration 2 {{(pid=74611) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG nova.network.neutron [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Updating instance_info_cache with network_info: [{"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquired lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG nova.network.neutron [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG nova.objects.instance [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lazy-loading 'info_cache' on Instance uuid ed1dfac0-31b6-4e63-895e-29877e17d178 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Releasing lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:13:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-503f0749-6bd6-48a2-adf1-bcf27199d4fd req-30e75c68-4b5d-49d2-b256-18030cc884d2 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received event network-vif-unplugged-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-503f0749-6bd6-48a2-adf1-bcf27199d4fd req-30e75c68-4b5d-49d2-b256-18030cc884d2 service nova] Acquiring lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-503f0749-6bd6-48a2-adf1-bcf27199d4fd req-30e75c68-4b5d-49d2-b256-18030cc884d2 service nova] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-503f0749-6bd6-48a2-adf1-bcf27199d4fd req-30e75c68-4b5d-49d2-b256-18030cc884d2 service nova] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-503f0749-6bd6-48a2-adf1-bcf27199d4fd req-30e75c68-4b5d-49d2-b256-18030cc884d2 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] No waiting events found dispatching network-vif-unplugged-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:13:52 user nova-compute[74611]: WARNING nova.compute.manager [req-503f0749-6bd6-48a2-adf1-bcf27199d4fd req-30e75c68-4b5d-49d2-b256-18030cc884d2 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received unexpected event network-vif-unplugged-457c4784-2cc7-4521-8d86-86845bce490e for instance with vm_state active and task_state reboot_started_hard.
Nov 13 10:13:52 user nova-compute[74611]: DEBUG nova.network.neutron [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Updating instance_info_cache with network_info: [{"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Releasing lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG nova.objects.instance [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lazy-loading 'migration_context' on Instance uuid ed1dfac0-31b6-4e63-895e-29877e17d178 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG nova.objects.base [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Object Instance<ed1dfac0-31b6-4e63-895e-29877e17d178> lazy-loaded attributes: info_cache,migration_context {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.275s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:52 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Instance destroyed successfully.
Nov 13 10:13:52 user nova-compute[74611]: DEBUG nova.objects.instance [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lazy-loading 'resources' on Instance uuid 4704cd02-59cc-4d64-804a-79a38d05b00e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1254234458',display_name='tempest-TestMinimumBasicScenario-server-1254234458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1254234458',id=43,image_ref='876d0ea7-601f-4d91-9da8-e815a1c512f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI92Z30Xq53Ktv+Nq8eUC6I8etuxy1sEESnYSIHfkfvgq/zsYzW7tWZ5Wp6GnOGv5ALJIAbwu1T1e4B/Y7w/27W0CDeF3iHGB5ehXLN0ga5fVz0HbSyDO2CMLaOL8EyxA==',key_name='tempest-TestMinimumBasicScenario-1202250230',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:11:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5990cb4516a04312b3ccda9c39a44c4a',ramdisk_id='',reservation_id='r-mkiy3udd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='876d0ea7-601f-4d91-9da8-e815a1c512f1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-163886892',owner_user_name='tempest-TestMinimumBasicScenario-163886892-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:13:52Z,user_data=None,user_id='35bc3ea05d5b4f9a85ba453446b2bee9',uuid=4704cd02-59cc-4d64-804a-79a38d05b00e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converting VIF {"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=457c4784-2cc7-4521-8d86-86845bce490e,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457c4784-2c') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_vif [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=457c4784-2cc7-4521-8d86-86845bce490e,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457c4784-2c') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap457c4784-2c, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86f83044-e37b-405f-9025-e91fbeecac22) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:13:52 user nova-compute[74611]: INFO os_vif [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=457c4784-2cc7-4521-8d86-86845bce490e,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457c4784-2c')
Nov 13 10:13:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPANsqny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:13:52 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cbb1c0-88fc-438f-a476-fa15951a27db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:13:52 user nova-compute[74611]: No targets found.
Nov 13 10:13:52 user nova-compute[74611]: iSNS:
Nov 13 10:13:52 user nova-compute[74611]: No targets found.
Nov 13 10:13:52 user nova-compute[74611]: STATIC:
Nov 13 10:13:52 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73
Nov 13 10:13:52 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:13:52 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:13:52 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd
Nov 13 10:13:52 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:13:52 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:13:52 user nova-compute[74611]: FIRMWARE:
Nov 13 10:13:52 user nova-compute[74611]: No targets found.
Nov 13 10:13:52 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:13:52 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:13:52 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:52 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Deleted allocation for migration f8cefb2f-0d41-4528-aca2-0a3d4a07f922
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac2471f-c3be-4ac9-a234-d86e3d7b08ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b376db3-71d5-4dd2-93dc-b26f3b7202b2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:13:52 user nova-compute[74611]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)
Nov 13 10:13:52 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:13:52 user nova-compute[74611]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)
Nov 13 10:13:52 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb645ce950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3a7a6d15-e672-4162-9164-d1bf6e2ecf9a tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.274s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2870217b-05b1-4add-b664-d711feb05cb2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[96049390-4d9a-47da-b977-85309f0922cc]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dec053-e7a4-4358-81bc-2bed2f37388e]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ea8642-3a38-4207-b66d-8bf26151f8ec]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ee08a9-f13c-48d4-8d4a-a1bc7badb3c5]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[69978903-52c0-474e-b448-4e36c011aed3]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73, portal: 172.16.0.220,3260]
Nov 13 10:13:53 user nova-compute[74611]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73, portal: 172.16.0.220,3260] successful.
Nov 13 10:13:53 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cf8143-450b-4f65-86c7-c7fa961aba1d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] <== disconnect_volume: return (305ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Start _get_guest_xml network_info=[{"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=876d0ea7-601f-4d91-9da8-e815a1c512f1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '876d0ea7-601f-4d91-9da8-e815a1c512f1'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'a82e35e4-99ae-423d-a33a-baa03a76bd5b', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPANsqny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '4704cd02-59cc-4d64-804a-79a38d05b00e', 'attached_at': '', 'detached_at': '', 'volume_id': '89921eed-fd6a-4b41-af43-eec15a47fe73', 'serial': '89921eed-fd6a-4b41-af43-eec15a47fe73'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:13:53 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:13:53 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=876d0ea7-601f-4d91-9da8-e815a1c512f1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.objects.instance [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4704cd02-59cc-4d64-804a-79a38d05b00e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.objects.base [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Object Instance<4704cd02-59cc-4d64-804a-79a38d05b00e> lazy-loaded attributes: resources,vcpu_model {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPANsqny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:13:53 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:13:53 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:13:53 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[73478ab8-794b-4258-a5d5-3efa023353d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:13:53 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5106110-2cca-472a-92b8-f565d44b8607]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73] added
Nov 13 10:13:53 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb8cb29-1ec4-4464-990e-70e7266604b8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb219be4-e688-43b7-acb0-5589700ed0d2]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EPANsqny {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EPANsqny" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e57df6-0167-49ef-99b9-96352bab3f31]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EPANsqny'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4495c9e8-f7e0-42ee-b3a9-671614e13b06]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbb8aec-0c33-4d86-bc05-3a6d72f70552]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:13:53 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:13:53 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3dd098-b886-4092-b41d-e2cb4faec9ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73, portal: 172.16.0.220,3260]
Nov 13 10:13:53 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73, portal: 172.16.0.220,3260] successful.
Nov 13 10:13:53 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f68817e-0c32-4eba-a240-e9cc89df0f20]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[31646c7e-0c0a-42fb-b8b7-3228818487f0]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:13:53 user nova-compute[74611]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)
Nov 13 10:13:53 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:13:53 user nova-compute[74611]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)
Nov 13 10:13:53 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b809d57-71a2-4236-a29a-7d16a1a715d5]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:13:53 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-adb6df71-b31e-4a57-b02f-907c8d6e6c22 req-413fc629-a20e-4170-bfc5-ff803739c865 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received event network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-adb6df71-b31e-4a57-b02f-907c8d6e6c22 req-413fc629-a20e-4170-bfc5-ff803739c865 service nova] Acquiring lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-adb6df71-b31e-4a57-b02f-907c8d6e6c22 req-413fc629-a20e-4170-bfc5-ff803739c865 service nova] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-adb6df71-b31e-4a57-b02f-907c8d6e6c22 req-413fc629-a20e-4170-bfc5-ff803739c865 service nova] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG nova.compute.manager [req-adb6df71-b31e-4a57-b02f-907c8d6e6c22 req-413fc629-a20e-4170-bfc5-ff803739c865 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] No waiting events found dispatching network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:13:54 user nova-compute[74611]: WARNING nova.compute.manager [req-adb6df71-b31e-4a57-b02f-907c8d6e6c22 req-413fc629-a20e-4170-bfc5-ff803739c865 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received unexpected event network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e for instance with vm_state active and task_state reboot_started_hard.
Nov 13 10:13:54 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPANsqny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23239633635343564', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239633635343564', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1254234458',display_name='tempest-TestMinimumBasicScenario-server-1254234458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1254234458',id=43,image_ref='876d0ea7-601f-4d91-9da8-e815a1c512f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI92Z30Xq53Ktv+Nq8eUC6I8etuxy1sEESnYSIHfkfvgq/zsYzW7tWZ5Wp6GnOGv5ALJIAbwu1T1e4B/Y7w/27W0CDeF3iHGB5ehXLN0ga5fVz0HbSyDO2CMLaOL8EyxA==',key_name='tempest-TestMinimumBasicScenario-1202250230',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:11:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5990cb4516a04312b3ccda9c39a44c4a',ramdisk_id='',reservation_id='r-mkiy3udd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='876d0ea7-601f-4d91-9da8-e815a1c512f1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-163886892',owner_user_name='tempest-TestMinimumBasicScenario-163886892-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:13:52Z,user_data=None,user_id='35bc3ea05d5b4f9a85ba453446b2bee9',uuid=4704cd02-59cc-4d64-804a-79a38d05b00e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converting VIF {"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=457c4784-2cc7-4521-8d86-86845bce490e,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457c4784-2c') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG nova.objects.instance [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lazy-loading 'pci_devices' on Instance uuid 4704cd02-59cc-4d64-804a-79a38d05b00e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG nova.objects.base [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Object Instance<4704cd02-59cc-4d64-804a-79a38d05b00e> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:13:54 user nova-compute[74611]:   <uuid>4704cd02-59cc-4d64-804a-79a38d05b00e</uuid>
Nov 13 10:13:54 user nova-compute[74611]:   <name>instance-0000002b</name>
Nov 13 10:13:54 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:13:54 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:13:54 user nova-compute[74611]:   <metadata>
Nov 13 10:13:54 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:13:54 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:13:54 user nova-compute[74611]:       <nova:name>tempest-TestMinimumBasicScenario-server-1254234458</nova:name>
Nov 13 10:13:54 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:13:53</nova:creationTime>
Nov 13 10:13:54 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:13:54 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:13:54 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:13:54 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:13:54 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:13:54 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:13:54 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:13:54 user nova-compute[74611]:       <nova:owner>
Nov 13 10:13:54 user nova-compute[74611]:         <nova:user uuid="35bc3ea05d5b4f9a85ba453446b2bee9">tempest-TestMinimumBasicScenario-163886892-project-member</nova:user>
Nov 13 10:13:54 user nova-compute[74611]:         <nova:project uuid="5990cb4516a04312b3ccda9c39a44c4a">tempest-TestMinimumBasicScenario-163886892</nova:project>
Nov 13 10:13:54 user nova-compute[74611]:       </nova:owner>
Nov 13 10:13:54 user nova-compute[74611]:       <nova:root type="image" uuid="876d0ea7-601f-4d91-9da8-e815a1c512f1"/>
Nov 13 10:13:54 user nova-compute[74611]:       <nova:ports>
Nov 13 10:13:54 user nova-compute[74611]:         <nova:port uuid="457c4784-2cc7-4521-8d86-86845bce490e">
Nov 13 10:13:54 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 10:13:54 user nova-compute[74611]:         </nova:port>
Nov 13 10:13:54 user nova-compute[74611]:       </nova:ports>
Nov 13 10:13:54 user nova-compute[74611]:     </nova:instance>
Nov 13 10:13:54 user nova-compute[74611]:   </metadata>
Nov 13 10:13:54 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:13:54 user nova-compute[74611]:     <system>
Nov 13 10:13:54 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:13:54 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:13:54 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:13:54 user nova-compute[74611]:       <entry name="serial">4704cd02-59cc-4d64-804a-79a38d05b00e</entry>
Nov 13 10:13:54 user nova-compute[74611]:       <entry name="uuid">4704cd02-59cc-4d64-804a-79a38d05b00e</entry>
Nov 13 10:13:54 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:13:54 user nova-compute[74611]:     </system>
Nov 13 10:13:54 user nova-compute[74611]:   </sysinfo>
Nov 13 10:13:54 user nova-compute[74611]:   <os>
Nov 13 10:13:54 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:13:54 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:13:54 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:13:54 user nova-compute[74611]:   </os>
Nov 13 10:13:54 user nova-compute[74611]:   <features>
Nov 13 10:13:54 user nova-compute[74611]:     <acpi/>
Nov 13 10:13:54 user nova-compute[74611]:     <apic/>
Nov 13 10:13:54 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:13:54 user nova-compute[74611]:   </features>
Nov 13 10:13:54 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:13:54 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:13:54 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:13:54 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:13:54 user nova-compute[74611]:   </clock>
Nov 13 10:13:54 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:13:54 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:13:54 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:13:54 user nova-compute[74611]:   </cpu>
Nov 13 10:13:54 user nova-compute[74611]:   <devices>
Nov 13 10:13:54 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:13:54 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:13:54 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk"/>
Nov 13 10:13:54 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:13:54 user nova-compute[74611]:     </disk>
Nov 13 10:13:54 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:13:54 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:13:54 user nova-compute[74611]:       <source dev="/dev/sdb"/>
Nov 13 10:13:54 user nova-compute[74611]:       <target dev="vdb" bus="virtio"/>
Nov 13 10:13:54 user nova-compute[74611]:       <serial>89921eed-fd6a-4b41-af43-eec15a47fe73</serial>
Nov 13 10:13:54 user nova-compute[74611]:     </disk>
Nov 13 10:13:54 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:13:54 user nova-compute[74611]:       <mac address="fa:16:3e:13:6c:f6"/>
Nov 13 10:13:54 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:13:54 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:13:54 user nova-compute[74611]:       <target dev="tap457c4784-2c"/>
Nov 13 10:13:54 user nova-compute[74611]:     </interface>
Nov 13 10:13:54 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:13:54 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/console.log" append="off"/>
Nov 13 10:13:54 user nova-compute[74611]:     </serial>
Nov 13 10:13:54 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:13:54 user nova-compute[74611]:     <video>
Nov 13 10:13:54 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:13:54 user nova-compute[74611]:     </video>
Nov 13 10:13:54 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:13:54 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:13:54 user nova-compute[74611]:     </rng>
Nov 13 10:13:54 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:13:54 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:13:54 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:13:54 user nova-compute[74611]:     </memballoon>
Nov 13 10:13:54 user nova-compute[74611]:   </devices>
Nov 13 10:13:54 user nova-compute[74611]: </domain>
Nov 13 10:13:54 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG nova.objects.instance [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4704cd02-59cc-4d64-804a-79a38d05b00e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG nova.objects.base [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Object Instance<4704cd02-59cc-4d64-804a-79a38d05b00e> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:13:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Cannot resize image /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG nova.objects.instance [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lazy-loading 'migration_context' on Instance uuid 4704cd02-59cc-4d64-804a-79a38d05b00e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG nova.objects.base [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Object Instance<4704cd02-59cc-4d64-804a-79a38d05b00e> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1254234458',display_name='tempest-TestMinimumBasicScenario-server-1254234458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1254234458',id=43,image_ref='876d0ea7-601f-4d91-9da8-e815a1c512f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI92Z30Xq53Ktv+Nq8eUC6I8etuxy1sEESnYSIHfkfvgq/zsYzW7tWZ5Wp6GnOGv5ALJIAbwu1T1e4B/Y7w/27W0CDeF3iHGB5ehXLN0ga5fVz0HbSyDO2CMLaOL8EyxA==',key_name='tempest-TestMinimumBasicScenario-1202250230',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:11:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='5990cb4516a04312b3ccda9c39a44c4a',ramdisk_id='',reservation_id='r-mkiy3udd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='876d0ea7-601f-4d91-9da8-e815a1c512f1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-163886892',owner_user_name='tempest-TestMinimumBasicScenario-163886892-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:13:52Z,user_data=None,user_id='35bc3ea05d5b4f9a85ba453446b2bee9',uuid=4704cd02-59cc-4d64-804a-79a38d05b00e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converting VIF {"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=457c4784-2cc7-4521-8d86-86845bce490e,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457c4784-2c') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG os_vif [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=457c4784-2cc7-4521-8d86-86845bce490e,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457c4784-2c') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1623c275-ddec-5988-b4ba-e282f96b932e', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap457c4784-2c, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap457c4784-2c, col_values=(('qos', UUID('fa74f3cc-1dd9-486e-8f27-69f616746b79')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap457c4784-2c, col_values=(('external_ids', {'iface-id': '457c4784-2cc7-4521-8d86-86845bce490e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:6c:f6', 'vm-uuid': '4704cd02-59cc-4d64-804a-79a38d05b00e'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:13:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:55 user nova-compute[74611]: INFO os_vif [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=457c4784-2cc7-4521-8d86-86845bce490e,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457c4784-2c')
Nov 13 10:13:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-acf18411-bff0-462a-9ff5-e6cdc2d61026 req-2d65a440-fbd7-4c78-a4d3-2561ee0cec1b service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received event network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:13:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-acf18411-bff0-462a-9ff5-e6cdc2d61026 req-2d65a440-fbd7-4c78-a4d3-2561ee0cec1b service nova] Acquiring lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-acf18411-bff0-462a-9ff5-e6cdc2d61026 req-2d65a440-fbd7-4c78-a4d3-2561ee0cec1b service nova] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-acf18411-bff0-462a-9ff5-e6cdc2d61026 req-2d65a440-fbd7-4c78-a4d3-2561ee0cec1b service nova] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-acf18411-bff0-462a-9ff5-e6cdc2d61026 req-2d65a440-fbd7-4c78-a4d3-2561ee0cec1b service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] No waiting events found dispatching network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:13:56 user nova-compute[74611]: WARNING nova.compute.manager [req-acf18411-bff0-462a-9ff5-e6cdc2d61026 req-2d65a440-fbd7-4c78-a4d3-2561ee0cec1b service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received unexpected event network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e for instance with vm_state active and task_state reboot_started_hard.
Nov 13 10:13:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:57 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:13:57 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:13:58 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:13:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:13:58 user nova-compute[74611]: DEBUG nova.compute.manager [req-3be6cfd1-e06f-41f4-8cec-a8a51e107738 req-db6a3e99-6ce3-455b-8796-3eb2e8e42b97 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received event network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:13:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3be6cfd1-e06f-41f4-8cec-a8a51e107738 req-db6a3e99-6ce3-455b-8796-3eb2e8e42b97 service nova] Acquiring lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:13:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3be6cfd1-e06f-41f4-8cec-a8a51e107738 req-db6a3e99-6ce3-455b-8796-3eb2e8e42b97 service nova] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:13:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3be6cfd1-e06f-41f4-8cec-a8a51e107738 req-db6a3e99-6ce3-455b-8796-3eb2e8e42b97 service nova] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:58 user nova-compute[74611]: DEBUG nova.compute.manager [req-3be6cfd1-e06f-41f4-8cec-a8a51e107738 req-db6a3e99-6ce3-455b-8796-3eb2e8e42b97 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] No waiting events found dispatching network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:13:58 user nova-compute[74611]: WARNING nova.compute.manager [req-3be6cfd1-e06f-41f4-8cec-a8a51e107738 req-db6a3e99-6ce3-455b-8796-3eb2e8e42b97 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received unexpected event network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e for instance with vm_state active and task_state reboot_started_hard.
Nov 13 10:13:58 user nova-compute[74611]: DEBUG nova.compute.manager [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:13:58 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Instance rebooted successfully.
Nov 13 10:13:58 user nova-compute[74611]: DEBUG nova.compute.manager [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:13:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-fa7ddc0b-dfa4-4ac0-b0dc-4bce69924be4 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.716s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:13:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:13:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:13:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:13:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:13:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:00 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:14:01 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:14:01 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:14:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8414MB free_disk=25.235027313232422GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:14:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:14:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:14:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4704cd02-59cc-4d64-804a-79a38d05b00e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:14:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ed1dfac0-31b6-4e63-895e-29877e17d178 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:14:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 0c8cec16-35fd-4ea1-b512-fbc3bb202419 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:14:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:14:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:14:01 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:14:01 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:14:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:14:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG nova.objects.instance [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lazy-loading 'flavor' on Instance uuid ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:04 user nova-compute[74611]: INFO nova.compute.manager [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Attaching volume 816efd81-264a-45c9-b24f-90a336ce2736 to /dev/vdb
Nov 13 10:14:04 user nova-compute[74611]: DEBUG os_brick.utils [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3172edd8-dd91-43c6-9a20-3d92cf029fd9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ff1c3d-80ae-4ecc-bfad-79a983c352d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c6aeba-2a11-4e37-bb0d-a6338316f893]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[064d4145-4868-4871-8e72-996c375ff652]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:14:04 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:14:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[762c1bd6-a8d6-4c13-8c88-a3ee234344cb]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG os_brick.utils [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:14:04 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Updating existing volume attachment record: ba28db9c-e124-46aa-8b95-17cbc2e4b0a8 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:14:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYqWKdPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:14:08 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:14:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:14:08 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:14:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:14:08 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60a3aad-add3-4a48-9657-f436884203ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:14:08 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a2a909-f865-4cba-b59f-dee853c13a0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736] added
Nov 13 10:14:08 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccf1fff-e20d-48d1-9b04-bbfb6c948a8e]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[49592b7d-c5e1-47dd-a776-b8b9739cb34a]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYqWKdPe {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYqWKdPe" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0761101-2ec2-4a87-8280-99b02dca1059]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nYqWKdPe'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd2936a-d7a6-4883-8906-d35dd41e68d9]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab37732d-b870-4b2c-ac98-c0f666213526]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:14:08 user nova-compute[74611]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)
Nov 13 10:14:08 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:14:08 user nova-compute[74611]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)
Nov 13 10:14:08 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd014d6-abc2-4187-a6d9-84ee591c4c06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736, portal: 172.16.0.220,3260]
Nov 13 10:14:08 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736, portal: 172.16.0.220,3260] successful.
Nov 13 10:14:08 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[906f9afb-5624-4286-8537-a91e8acef3a7]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:14:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:09 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b971cdc3-c44c-4ac9-ae87-cb42dd45feca]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:09 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:14:09 user nova-compute[74611]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)
Nov 13 10:14:09 user nova-compute[74611]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 (non-flash)
Nov 13 10:14:09 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:14:09 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:14:09 user nova-compute[74611]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)
Nov 13 10:14:09 user nova-compute[74611]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 (non-flash)
Nov 13 10:14:09 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:14:09 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:14:09 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:14:09 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:14:09 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:14:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:09 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b33fc67-b818-4bb0-87c8-350c98d2d58e]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:09 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:14:09 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYqWKdPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:14:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:14:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26632633336363361', 'path': '/dev/sdc'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:14:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632633336363361', 'path': '/dev/sdc'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:14:10 user nova-compute[74611]: DEBUG nova.objects.instance [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lazy-loading 'flavor' on Instance uuid ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:14:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:14:10 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:14:10 user nova-compute[74611]:   <source dev="/dev/sdc"/>
Nov 13 10:14:10 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:14:10 user nova-compute[74611]:   <serial>816efd81-264a-45c9-b24f-90a336ce2736</serial>
Nov 13 10:14:10 user nova-compute[74611]: </disk>
Nov 13 10:14:10 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:14:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:14:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:14:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] No VIF found with MAC fa:16:3e:8c:f7:c5, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:14:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-524281f9-199a-47f2-a0ee-8c8a0be1e8aa tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.105s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:12 user nova-compute[74611]: INFO nova.compute.manager [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Detaching volume 816efd81-264a-45c9-b24f-90a336ce2736
Nov 13 10:14:12 user nova-compute[74611]: INFO nova.virt.block_device [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Attempting to driver detach volume 816efd81-264a-45c9-b24f-90a336ce2736 from mountpoint /dev/vdb
Nov 13 10:14:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Attempting to detach device vdb from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:14:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:14:12 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:14:12 user nova-compute[74611]:   <source dev="/dev/sdc"/>
Nov 13 10:14:12 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:14:12 user nova-compute[74611]:   <serial>816efd81-264a-45c9-b24f-90a336ce2736</serial>
Nov 13 10:14:12 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:14:12 user nova-compute[74611]: </disk>
Nov 13 10:14:12 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:14:12 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Successfully detached device vdb from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 from the persistent domain config.
Nov 13 10:14:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:14:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:14:12 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:14:12 user nova-compute[74611]:   <source dev="/dev/sdc"/>
Nov 13 10:14:12 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:14:12 user nova-compute[74611]:   <serial>816efd81-264a-45c9-b24f-90a336ce2736</serial>
Nov 13 10:14:12 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:14:12 user nova-compute[74611]: </disk>
Nov 13 10:14:12 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:14:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:14:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "770d57de-444b-42d1-824b-85e881fe76dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:22 user nova-compute[74611]: DEBUG nova.compute.manager [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:14:23 user nova-compute[74611]: INFO nova.compute.claims [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Claim successful on node user
Nov 13 10:14:23 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG nova.compute.manager [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG nova.compute.manager [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG nova.network.neutron [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:14:23 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:14:23 user nova-compute[74611]: DEBUG nova.compute.manager [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG nova.policy [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53f6b2b1ceae486a9be5af84dc08de7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9dc437b4d074101a113b7bca634ed0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG nova.compute.manager [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:14:23 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Creating image(s)
Nov 13 10:14:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "/opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "/opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "/opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.190s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk 1073741824" returned: 0 in 0.052s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG nova.network.neutron [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Successfully created port: a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Cannot resize image /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Ensure instance console log exists: /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG nova.network.neutron [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Successfully updated port: a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquired lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG nova.network.neutron [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG nova.network.neutron [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG nova.compute.manager [req-dfccbf84-ac49-4878-9eb8-aa3c7291b707 req-ee94378e-5bbd-4f62-92de-f21aeffbd262 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-changed-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG nova.compute.manager [req-dfccbf84-ac49-4878-9eb8-aa3c7291b707 req-ee94378e-5bbd-4f62-92de-f21aeffbd262 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Refreshing instance network info cache due to event network-changed-a3a02b77-480a-4ffe-a8da-f0bda6e70f57. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:14:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dfccbf84-ac49-4878-9eb8-aa3c7291b707 req-ee94378e-5bbd-4f62-92de-f21aeffbd262 service nova] Acquiring lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.network.neutron [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updating instance_info_cache with network_info: [{"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Releasing lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.compute.manager [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Instance network_info: |[{"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dfccbf84-ac49-4878-9eb8-aa3c7291b707 req-ee94378e-5bbd-4f62-92de-f21aeffbd262 service nova] Acquired lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.network.neutron [req-dfccbf84-ac49-4878-9eb8-aa3c7291b707 req-ee94378e-5bbd-4f62-92de-f21aeffbd262 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Refreshing network info cache for port a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Start _get_guest_xml network_info=[{"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:14:25 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:14:25 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1693136491',display_name='tempest-ServerStableDeviceRescueTest-server-1693136491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1693136491',id=45,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxx5CqNADL2t5RNQuLp8M/DypFH1AecFisERGdt7rpr81WdBBxeANwcGv/OvZt5GFrbAkWwQpH9EmJNr3Nou07IZ02A/lxpyNtIglcJGILVDfJMeKuRnbD27Oo2AmLnBg==',key_name='tempest-keypair-2131338815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9dc437b4d074101a113b7bca634ed0e',ramdisk_id='',reservation_id='r-pekagm9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1937011099',owner_user_name='tempest-ServerStableDeviceRescueTest-1937011099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:14:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f6b2b1ceae486a9be5af84dc08de7c',uuid=770d57de-444b-42d1-824b-85e881fe76dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Converting VIF {"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:45:a6,bridge_name='br-int',has_traffic_filtering=True,id=a3a02b77-480a-4ffe-a8da-f0bda6e70f57,network=Network(72f44b48-dbe8-4430-93ac-6b4c67c195ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3a02b77-48') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.objects.instance [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lazy-loading 'pci_devices' on Instance uuid 770d57de-444b-42d1-824b-85e881fe76dd {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:14:25 user nova-compute[74611]:   <uuid>770d57de-444b-42d1-824b-85e881fe76dd</uuid>
Nov 13 10:14:25 user nova-compute[74611]:   <name>instance-0000002d</name>
Nov 13 10:14:25 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:14:25 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:14:25 user nova-compute[74611]:   <metadata>
Nov 13 10:14:25 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:14:25 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:14:25 user nova-compute[74611]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1693136491</nova:name>
Nov 13 10:14:25 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:14:25</nova:creationTime>
Nov 13 10:14:25 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:14:25 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:14:25 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:14:25 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:14:25 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:14:25 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:14:25 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:14:25 user nova-compute[74611]:       <nova:owner>
Nov 13 10:14:25 user nova-compute[74611]:         <nova:user uuid="53f6b2b1ceae486a9be5af84dc08de7c">tempest-ServerStableDeviceRescueTest-1937011099-project-member</nova:user>
Nov 13 10:14:25 user nova-compute[74611]:         <nova:project uuid="a9dc437b4d074101a113b7bca634ed0e">tempest-ServerStableDeviceRescueTest-1937011099</nova:project>
Nov 13 10:14:25 user nova-compute[74611]:       </nova:owner>
Nov 13 10:14:25 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:14:25 user nova-compute[74611]:       <nova:ports>
Nov 13 10:14:25 user nova-compute[74611]:         <nova:port uuid="a3a02b77-480a-4ffe-a8da-f0bda6e70f57">
Nov 13 10:14:25 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 10:14:25 user nova-compute[74611]:         </nova:port>
Nov 13 10:14:25 user nova-compute[74611]:       </nova:ports>
Nov 13 10:14:25 user nova-compute[74611]:     </nova:instance>
Nov 13 10:14:25 user nova-compute[74611]:   </metadata>
Nov 13 10:14:25 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:14:25 user nova-compute[74611]:     <system>
Nov 13 10:14:25 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:14:25 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:14:25 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:14:25 user nova-compute[74611]:       <entry name="serial">770d57de-444b-42d1-824b-85e881fe76dd</entry>
Nov 13 10:14:25 user nova-compute[74611]:       <entry name="uuid">770d57de-444b-42d1-824b-85e881fe76dd</entry>
Nov 13 10:14:25 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:14:25 user nova-compute[74611]:     </system>
Nov 13 10:14:25 user nova-compute[74611]:   </sysinfo>
Nov 13 10:14:25 user nova-compute[74611]:   <os>
Nov 13 10:14:25 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:14:25 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:14:25 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:14:25 user nova-compute[74611]:   </os>
Nov 13 10:14:25 user nova-compute[74611]:   <features>
Nov 13 10:14:25 user nova-compute[74611]:     <acpi/>
Nov 13 10:14:25 user nova-compute[74611]:     <apic/>
Nov 13 10:14:25 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:14:25 user nova-compute[74611]:   </features>
Nov 13 10:14:25 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:14:25 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:14:25 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:14:25 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:14:25 user nova-compute[74611]:   </clock>
Nov 13 10:14:25 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:14:25 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:14:25 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:14:25 user nova-compute[74611]:   </cpu>
Nov 13 10:14:25 user nova-compute[74611]:   <devices>
Nov 13 10:14:25 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:14:25 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:14:25 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk"/>
Nov 13 10:14:25 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:14:25 user nova-compute[74611]:     </disk>
Nov 13 10:14:25 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:14:25 user nova-compute[74611]:       <mac address="fa:16:3e:7f:45:a6"/>
Nov 13 10:14:25 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:14:25 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:14:25 user nova-compute[74611]:       <target dev="tapa3a02b77-48"/>
Nov 13 10:14:25 user nova-compute[74611]:     </interface>
Nov 13 10:14:25 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:14:25 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/console.log" append="off"/>
Nov 13 10:14:25 user nova-compute[74611]:     </serial>
Nov 13 10:14:25 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:14:25 user nova-compute[74611]:     <video>
Nov 13 10:14:25 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:14:25 user nova-compute[74611]:     </video>
Nov 13 10:14:25 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:14:25 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:14:25 user nova-compute[74611]:     </rng>
Nov 13 10:14:25 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:14:25 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:14:25 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:14:25 user nova-compute[74611]:     </memballoon>
Nov 13 10:14:25 user nova-compute[74611]:   </devices>
Nov 13 10:14:25 user nova-compute[74611]: </domain>
Nov 13 10:14:25 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1693136491',display_name='tempest-ServerStableDeviceRescueTest-server-1693136491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1693136491',id=45,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxx5CqNADL2t5RNQuLp8M/DypFH1AecFisERGdt7rpr81WdBBxeANwcGv/OvZt5GFrbAkWwQpH9EmJNr3Nou07IZ02A/lxpyNtIglcJGILVDfJMeKuRnbD27Oo2AmLnBg==',key_name='tempest-keypair-2131338815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9dc437b4d074101a113b7bca634ed0e',ramdisk_id='',reservation_id='r-pekagm9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1937011099',owner_user_name='tempest-ServerStableDeviceRescueTest-1937011099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:14:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f6b2b1ceae486a9be5af84dc08de7c',uuid=770d57de-444b-42d1-824b-85e881fe76dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Converting VIF {"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:45:a6,bridge_name='br-int',has_traffic_filtering=True,id=a3a02b77-480a-4ffe-a8da-f0bda6e70f57,network=Network(72f44b48-dbe8-4430-93ac-6b4c67c195ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3a02b77-48') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG os_vif [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:45:a6,bridge_name='br-int',has_traffic_filtering=True,id=a3a02b77-480a-4ffe-a8da-f0bda6e70f57,network=Network(72f44b48-dbe8-4430-93ac-6b4c67c195ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3a02b77-48') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62909027-bf54-502b-9558-64636d5167bc', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3a02b77-48, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3a02b77-48, col_values=(('qos', UUID('876b34cb-151a-42a6-a78b-6d1f5d5b7e5f')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3a02b77-48, col_values=(('external_ids', {'iface-id': 'a3a02b77-480a-4ffe-a8da-f0bda6e70f57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:45:a6', 'vm-uuid': '770d57de-444b-42d1-824b-85e881fe76dd'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:25 user nova-compute[74611]: INFO os_vif [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:45:a6,bridge_name='br-int',has_traffic_filtering=True,id=a3a02b77-480a-4ffe-a8da-f0bda6e70f57,network=Network(72f44b48-dbe8-4430-93ac-6b4c67c195ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3a02b77-48')
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] No VIF found with MAC fa:16:3e:7f:45:a6, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.network.neutron [req-dfccbf84-ac49-4878-9eb8-aa3c7291b707 req-ee94378e-5bbd-4f62-92de-f21aeffbd262 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updated VIF entry in instance network info cache for port a3a02b77-480a-4ffe-a8da-f0bda6e70f57. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG nova.network.neutron [req-dfccbf84-ac49-4878-9eb8-aa3c7291b707 req-ee94378e-5bbd-4f62-92de-f21aeffbd262 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updating instance_info_cache with network_info: [{"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:14:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dfccbf84-ac49-4878-9eb8-aa3c7291b707 req-ee94378e-5bbd-4f62-92de-f21aeffbd262 service nova] Releasing lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:14:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-63130379-bbdb-446d-b043-65b3ac7be201 req-2210bbaa-1078-4c5a-9552-d3e9554e691a service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:14:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-63130379-bbdb-446d-b043-65b3ac7be201 req-2210bbaa-1078-4c5a-9552-d3e9554e691a service nova] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-63130379-bbdb-446d-b043-65b3ac7be201 req-2210bbaa-1078-4c5a-9552-d3e9554e691a service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-63130379-bbdb-446d-b043-65b3ac7be201 req-2210bbaa-1078-4c5a-9552-d3e9554e691a service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:26 user nova-compute[74611]: DEBUG nova.compute.manager [req-63130379-bbdb-446d-b043-65b3ac7be201 req-2210bbaa-1078-4c5a-9552-d3e9554e691a service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] No waiting events found dispatching network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:14:26 user nova-compute[74611]: WARNING nova.compute.manager [req-63130379-bbdb-446d-b043-65b3ac7be201 req-2210bbaa-1078-4c5a-9552-d3e9554e691a service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received unexpected event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 for instance with vm_state building and task_state spawning.
Nov 13 10:14:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:14:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:14:28 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Instance spawned successfully.
Nov 13 10:14:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:14:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:14:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:14:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:14:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:14:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:14:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:14:28 user nova-compute[74611]: INFO nova.compute.manager [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 13 10:14:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:14:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-15353c3e-2109-4de6-8c00-6069a75af37d req-b7b98d7f-b303-4268-9a4d-400c4816afd7 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:14:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-15353c3e-2109-4de6-8c00-6069a75af37d req-b7b98d7f-b303-4268-9a4d-400c4816afd7 service nova] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-15353c3e-2109-4de6-8c00-6069a75af37d req-b7b98d7f-b303-4268-9a4d-400c4816afd7 service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-15353c3e-2109-4de6-8c00-6069a75af37d req-b7b98d7f-b303-4268-9a4d-400c4816afd7 service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:28 user nova-compute[74611]: DEBUG nova.compute.manager [req-15353c3e-2109-4de6-8c00-6069a75af37d req-b7b98d7f-b303-4268-9a4d-400c4816afd7 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] No waiting events found dispatching network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:14:28 user nova-compute[74611]: WARNING nova.compute.manager [req-15353c3e-2109-4de6-8c00-6069a75af37d req-b7b98d7f-b303-4268-9a4d-400c4816afd7 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received unexpected event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 for instance with vm_state building and task_state spawning.
Nov 13 10:14:28 user nova-compute[74611]: INFO nova.compute.manager [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Took 5.81 seconds to build instance.
Nov 13 10:14:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-286cb9a0-b439-46ae-a9cb-fd9c087e86b6 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "770d57de-444b-42d1-824b-85e881fe76dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.109s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:33 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 is timed out.
Nov 13 10:14:33 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Successfully detached device vdb from instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 from the live domain config.
Nov 13 10:14:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYqWKdPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:14:33 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c3a139-776f-4e1f-b37e-5f77b05e773d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:14:33 user nova-compute[74611]: No targets found.
Nov 13 10:14:33 user nova-compute[74611]: iSNS:
Nov 13 10:14:33 user nova-compute[74611]: No targets found.
Nov 13 10:14:33 user nova-compute[74611]: STATIC:
Nov 13 10:14:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736
Nov 13 10:14:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:14:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:14:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73
Nov 13 10:14:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:14:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:14:33 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd
Nov 13 10:14:33 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:14:33 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:14:33 user nova-compute[74611]: FIRMWARE:
Nov 13 10:14:33 user nova-compute[74611]: No targets found.
Nov 13 10:14:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:14:33 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:14:33 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b854a7-d4c3-4583-aaee-8908c8c595f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[47595484-fbad-41d9-b224-11d0c4a09fc3]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:14:33 user nova-compute[74611]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)
Nov 13 10:14:33 user nova-compute[74611]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 (non-flash)
Nov 13 10:14:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:14:33 user nova-compute[74611]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)
Nov 13 10:14:33 user nova-compute[74611]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 (non-flash)
Nov 13 10:14:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64389630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736'): ({'sdc'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Removing single pathed devices sdc {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fd534d-dd7e-4c7e-adfa-d848291b63d4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bd1051-514f-4e37-bf2f-ee1194d9d088]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Flushing IO for device /dev/sdc {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ac197b-a4d8-4413-b5d5-491598c41860]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea4842c-825a-4595-b369-7676a025a1ba]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] SCSI volumes sdc have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7283f1a-15bc-44ae-bb2c-84ff64b64516]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1566d5-e26e-4820-a300-9d416cef28e6]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736, portal: 172.16.0.220,3260]
Nov 13 10:14:33 user nova-compute[74611]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736, portal: 172.16.0.220,3260] successful.
Nov 13 10:14:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816efd81-264a-45c9-b24f-90a336ce2736 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[627bd12a-ccf8-41c4-b96d-23585ef29e6c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] <== disconnect_volume: return (313ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:14:33 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:14:34 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lazy-loading 'flavor' on Instance uuid ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:14:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6eed644a-6bdb-4795-af0a-a7588afc5995 tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.676s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:37 user nova-compute[74611]: INFO nova.compute.manager [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Terminating instance
Nov 13 10:14:37 user nova-compute[74611]: DEBUG nova.compute.manager [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-d6cfff6f-79a2-4958-95be-8ebde7bb1e6d req-88854e23-b5e9-4b90-8848-db30aa9ce23d service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received event network-vif-unplugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d6cfff6f-79a2-4958-95be-8ebde7bb1e6d req-88854e23-b5e9-4b90-8848-db30aa9ce23d service nova] Acquiring lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d6cfff6f-79a2-4958-95be-8ebde7bb1e6d req-88854e23-b5e9-4b90-8848-db30aa9ce23d service nova] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d6cfff6f-79a2-4958-95be-8ebde7bb1e6d req-88854e23-b5e9-4b90-8848-db30aa9ce23d service nova] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-d6cfff6f-79a2-4958-95be-8ebde7bb1e6d req-88854e23-b5e9-4b90-8848-db30aa9ce23d service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] No waiting events found dispatching network-vif-unplugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-d6cfff6f-79a2-4958-95be-8ebde7bb1e6d req-88854e23-b5e9-4b90-8848-db30aa9ce23d service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received event network-vif-unplugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:37 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Instance destroyed successfully.
Nov 13 10:14:37 user nova-compute[74611]: DEBUG nova.objects.instance [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lazy-loading 'resources' on Instance uuid 0c8cec16-35fd-4ea1-b512-fbc3bb202419 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:12:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-599850191',display_name='tempest-VolumesActionsTest-instance-599850191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-599850191',id=44,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:12:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0786686c4b784fd5a1506dcf5c008787',ramdisk_id='',reservation_id='r-1151db9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2131906562',owner_user_name='tempest-VolumesActionsTest-2131906562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:12:53Z,user_data=None,user_id='9a643b3a9df3483a83d820a5a50470bc',uuid=0c8cec16-35fd-4ea1-b512-fbc3bb202419,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "address": "fa:16:3e:90:fa:3c", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d0dcb-b6", "ovs_interfaceid": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Converting VIF {"id": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "address": "fa:16:3e:90:fa:3c", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d0dcb-b6", "ovs_interfaceid": "807d0dcb-b698-4b63-a67d-af5ddced6f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:fa:3c,bridge_name='br-int',has_traffic_filtering=True,id=807d0dcb-b698-4b63-a67d-af5ddced6f09,network=Network(3450369c-e903-4091-a496-1ce7fecf7d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807d0dcb-b6') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG os_vif [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:fa:3c,bridge_name='br-int',has_traffic_filtering=True,id=807d0dcb-b698-4b63-a67d-af5ddced6f09,network=Network(3450369c-e903-4091-a496-1ce7fecf7d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807d0dcb-b6') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap807d0dcb-b6, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b175bad6-acd4-4932-b096-036441ca818f) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:37 user nova-compute[74611]: INFO os_vif [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:fa:3c,bridge_name='br-int',has_traffic_filtering=True,id=807d0dcb-b698-4b63-a67d-af5ddced6f09,network=Network(3450369c-e903-4091-a496-1ce7fecf7d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807d0dcb-b6')
Nov 13 10:14:37 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Deleting instance files /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419_del
Nov 13 10:14:37 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Deletion of /opt/stack/data/nova/instances/0c8cec16-35fd-4ea1-b512-fbc3bb202419_del complete
Nov 13 10:14:37 user nova-compute[74611]: INFO nova.compute.manager [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 13 10:14:37 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:14:37 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:14:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:38 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:14:38 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Took 0.77 seconds to deallocate network for instance.
Nov 13 10:14:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:38 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:14:38 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:14:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:39 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Deleted allocations for instance 0c8cec16-35fd-4ea1-b512-fbc3bb202419
Nov 13 10:14:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3ab995c8-16db-42c0-9c47-d8fee10154d0 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.989s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received event network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] Acquiring lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] No waiting events found dispatching network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:14:39 user nova-compute[74611]: WARNING nova.compute.manager [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received unexpected event network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 for instance with vm_state deleted and task_state None.
Nov 13 10:14:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received event network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] Acquiring lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] No waiting events found dispatching network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:14:39 user nova-compute[74611]: WARNING nova.compute.manager [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received unexpected event network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 for instance with vm_state deleted and task_state None.
Nov 13 10:14:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received event network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] Acquiring lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] No waiting events found dispatching network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:14:39 user nova-compute[74611]: WARNING nova.compute.manager [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received unexpected event network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 for instance with vm_state deleted and task_state None.
Nov 13 10:14:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received event network-vif-unplugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] Acquiring lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] No waiting events found dispatching network-vif-unplugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:14:39 user nova-compute[74611]: WARNING nova.compute.manager [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received unexpected event network-vif-unplugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 for instance with vm_state deleted and task_state None.
Nov 13 10:14:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received event network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] Acquiring lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] Lock "0c8cec16-35fd-4ea1-b512-fbc3bb202419-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] No waiting events found dispatching network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:14:39 user nova-compute[74611]: WARNING nova.compute.manager [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received unexpected event network-vif-plugged-807d0dcb-b698-4b63-a67d-af5ddced6f09 for instance with vm_state deleted and task_state None.
Nov 13 10:14:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c5abdff-e26f-48aa-9859-19b72b77c4b1 req-8298d929-9759-4933-ac41-a6fd265bef27 service nova] [instance: 0c8cec16-35fd-4ea1-b512-fbc3bb202419] Received event network-vif-deleted-807d0dcb-b698-4b63-a67d-af5ddced6f09 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:14:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:47 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:14:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:14:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:14:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:14:47 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:14:47 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Updating instance_info_cache with network_info: [{"id": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "address": "fa:16:3e:8c:f7:c5", "network": {"id": "a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1029865477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "282fac4cc8704e0f985ab149c35aaf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa1d68a-42", "ovs_interfaceid": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:14:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:14:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:14:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:14:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:14:52 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:14:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:53 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:14:54 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:14:54 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:14:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 10:14:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] There are 0 instances to clean {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 10:14:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:56 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:14:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:58 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:14:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:14:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:14:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:14:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:14:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:14:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:14:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:14:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:14:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:15:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:15:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8249MB free_disk=25.223712921142578GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4704cd02-59cc-4d64-804a-79a38d05b00e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ed1dfac0-31b6-4e63-895e-29877e17d178 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 770d57de-444b-42d1-824b-85e881fe76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing inventories for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating ProviderTree inventory for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating inventory in ProviderTree for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing aggregate associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, aggregates: None {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing trait associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:15:00 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74611) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 10:15:01 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:15:01 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:15:02 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:15:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:15:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:15:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:15:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:15:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:15:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:15:11 user nova-compute[74611]: INFO nova.compute.manager [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Terminating instance
Nov 13 10:15:11 user nova-compute[74611]: DEBUG nova.compute.manager [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:15:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-4572edda-b64f-466b-a6a9-4e209128ad4a req-d93ed95b-69f3-4f6c-8b72-3c03487deada service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Received event network-vif-unplugged-9fa1d68a-42d8-4e69-9863-ff60ec956664 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4572edda-b64f-466b-a6a9-4e209128ad4a req-d93ed95b-69f3-4f6c-8b72-3c03487deada service nova] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4572edda-b64f-466b-a6a9-4e209128ad4a req-d93ed95b-69f3-4f6c-8b72-3c03487deada service nova] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4572edda-b64f-466b-a6a9-4e209128ad4a req-d93ed95b-69f3-4f6c-8b72-3c03487deada service nova] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-4572edda-b64f-466b-a6a9-4e209128ad4a req-d93ed95b-69f3-4f6c-8b72-3c03487deada service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] No waiting events found dispatching network-vif-unplugged-9fa1d68a-42d8-4e69-9863-ff60ec956664 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-4572edda-b64f-466b-a6a9-4e209128ad4a req-d93ed95b-69f3-4f6c-8b72-3c03487deada service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Received event network-vif-unplugged-9fa1d68a-42d8-4e69-9863-ff60ec956664 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:12 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Instance destroyed successfully.
Nov 13 10:15:12 user nova-compute[74611]: DEBUG nova.objects.instance [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lazy-loading 'resources' on Instance uuid ddbea46e-4eaf-4797-a1fb-6e5eeef170b2 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-465934460',display_name='tempest-SnapshotDataIntegrityTests-server-465934460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-465934460',id=40,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ95XQ5kHLmMjYnxdwVfR2w/1LdLhQp3xlENuDJOT+yNPrm9alErZe8HSaDMQQGvloEODd7olKYbiYb0bB36WOVmeqp/cB3At1Y38HnhXJFFLuHLEN9kzzQacmcI7w8dkA==',key_name='tempest-keypair-865768467',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:09:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='282fac4cc8704e0f985ab149c35aaf1c',ramdisk_id='',reservation_id='r-ueg5xeoy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1264141589',owner_user_name='tempest-SnapshotDataIntegrityTests-1264141589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:09:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b55061d274ba4b0ea3c0a695649b96a6',uuid=ddbea46e-4eaf-4797-a1fb-6e5eeef170b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "address": "fa:16:3e:8c:f7:c5", "network": {"id": "a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1029865477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "282fac4cc8704e0f985ab149c35aaf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa1d68a-42", "ovs_interfaceid": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Converting VIF {"id": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "address": "fa:16:3e:8c:f7:c5", "network": {"id": "a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1029865477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "282fac4cc8704e0f985ab149c35aaf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa1d68a-42", "ovs_interfaceid": "9fa1d68a-42d8-4e69-9863-ff60ec956664", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=9fa1d68a-42d8-4e69-9863-ff60ec956664,network=Network(a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa1d68a-42') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG os_vif [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=9fa1d68a-42d8-4e69-9863-ff60ec956664,network=Network(a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa1d68a-42') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fa1d68a-42, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77a9f67c-5c15-40d6-ad7a-9c4ea40179d7) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:12 user nova-compute[74611]: INFO os_vif [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:f7:c5,bridge_name='br-int',has_traffic_filtering=True,id=9fa1d68a-42d8-4e69-9863-ff60ec956664,network=Network(a3dbd85f-21a2-4ed0-87c8-2aad9bf566fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa1d68a-42')
Nov 13 10:15:12 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Deleting instance files /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2_del
Nov 13 10:15:12 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Deletion of /opt/stack/data/nova/instances/ddbea46e-4eaf-4797-a1fb-6e5eeef170b2_del complete
Nov 13 10:15:12 user nova-compute[74611]: INFO nova.compute.manager [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 13 10:15:12 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:15:12 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:15:13 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:15:13 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Took 0.67 seconds to deallocate network for instance.
Nov 13 10:15:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:15:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:15:13 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:15:13 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:15:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:15:13 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Deleted allocations for instance ddbea46e-4eaf-4797-a1fb-6e5eeef170b2
Nov 13 10:15:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7c60cbfe-e06f-4eb6-bfb7-f19a595afecf tempest-SnapshotDataIntegrityTests-1264141589 tempest-SnapshotDataIntegrityTests-1264141589-project-member] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.144s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:15:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-6fc35f4e-d608-43ca-a12d-61847d35d389 req-1db4c85a-71f1-4da3-9e7c-157969f693b5 service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Received event network-vif-plugged-9fa1d68a-42d8-4e69-9863-ff60ec956664 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:15:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6fc35f4e-d608-43ca-a12d-61847d35d389 req-1db4c85a-71f1-4da3-9e7c-157969f693b5 service nova] Acquiring lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:15:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6fc35f4e-d608-43ca-a12d-61847d35d389 req-1db4c85a-71f1-4da3-9e7c-157969f693b5 service nova] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:15:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6fc35f4e-d608-43ca-a12d-61847d35d389 req-1db4c85a-71f1-4da3-9e7c-157969f693b5 service nova] Lock "ddbea46e-4eaf-4797-a1fb-6e5eeef170b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:15:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-6fc35f4e-d608-43ca-a12d-61847d35d389 req-1db4c85a-71f1-4da3-9e7c-157969f693b5 service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] No waiting events found dispatching network-vif-plugged-9fa1d68a-42d8-4e69-9863-ff60ec956664 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:15:14 user nova-compute[74611]: WARNING nova.compute.manager [req-6fc35f4e-d608-43ca-a12d-61847d35d389 req-1db4c85a-71f1-4da3-9e7c-157969f693b5 service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Received unexpected event network-vif-plugged-9fa1d68a-42d8-4e69-9863-ff60ec956664 for instance with vm_state deleted and task_state None.
Nov 13 10:15:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-6fc35f4e-d608-43ca-a12d-61847d35d389 req-1db4c85a-71f1-4da3-9e7c-157969f693b5 service nova] [instance: ddbea46e-4eaf-4797-a1fb-6e5eeef170b2] Received event network-vif-deleted-9fa1d68a-42d8-4e69-9863-ff60ec956664 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:15:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:15:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "33eeb1f2-9510-444d-92ae-c209ea2e8393" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:15:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "33eeb1f2-9510-444d-92ae-c209ea2e8393" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:15:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:15:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:15:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:15:28 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:15:28 user nova-compute[74611]: INFO nova.compute.claims [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Claim successful on node user
Nov 13 10:15:28 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:15:28 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:15:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:15:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:15:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:15:28 user nova-compute[74611]: DEBUG nova.network.neutron [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:15:28 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:15:28 user nova-compute[74611]: DEBUG nova.compute.manager [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG nova.policy [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a643b3a9df3483a83d820a5a50470bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0786686c4b784fd5a1506dcf5c008787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG nova.compute.manager [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:15:29 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Creating image(s)
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "/opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "/opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "/opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG nova.network.neutron [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Successfully created port: 82a49b6b-6789-4652-8b08-5107437010b2 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk 1073741824" returned: 0 in 0.059s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.244s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Cannot resize image /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Ensure instance console log exists: /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:15:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.network.neutron [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Successfully updated port: 82a49b6b-6789-4652-8b08-5107437010b2 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "refresh_cache-33eeb1f2-9510-444d-92ae-c209ea2e8393" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquired lock "refresh_cache-33eeb1f2-9510-444d-92ae-c209ea2e8393" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.network.neutron [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-8ba4c720-e4a1-44b4-a597-0e886fa5ac76 req-601e8815-64e4-42f3-9f56-3b67616798e5 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Received event network-changed-82a49b6b-6789-4652-8b08-5107437010b2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-8ba4c720-e4a1-44b4-a597-0e886fa5ac76 req-601e8815-64e4-42f3-9f56-3b67616798e5 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Refreshing instance network info cache due to event network-changed-82a49b6b-6789-4652-8b08-5107437010b2. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8ba4c720-e4a1-44b4-a597-0e886fa5ac76 req-601e8815-64e4-42f3-9f56-3b67616798e5 service nova] Acquiring lock "refresh_cache-33eeb1f2-9510-444d-92ae-c209ea2e8393" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.network.neutron [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.network.neutron [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Updating instance_info_cache with network_info: [{"id": "82a49b6b-6789-4652-8b08-5107437010b2", "address": "fa:16:3e:04:a4:0f", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a49b6b-67", "ovs_interfaceid": "82a49b6b-6789-4652-8b08-5107437010b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Releasing lock "refresh_cache-33eeb1f2-9510-444d-92ae-c209ea2e8393" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.compute.manager [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Instance network_info: |[{"id": "82a49b6b-6789-4652-8b08-5107437010b2", "address": "fa:16:3e:04:a4:0f", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a49b6b-67", "ovs_interfaceid": "82a49b6b-6789-4652-8b08-5107437010b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8ba4c720-e4a1-44b4-a597-0e886fa5ac76 req-601e8815-64e4-42f3-9f56-3b67616798e5 service nova] Acquired lock "refresh_cache-33eeb1f2-9510-444d-92ae-c209ea2e8393" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.network.neutron [req-8ba4c720-e4a1-44b4-a597-0e886fa5ac76 req-601e8815-64e4-42f3-9f56-3b67616798e5 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Refreshing network info cache for port 82a49b6b-6789-4652-8b08-5107437010b2 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Start _get_guest_xml network_info=[{"id": "82a49b6b-6789-4652-8b08-5107437010b2", "address": "fa:16:3e:04:a4:0f", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a49b6b-67", "ovs_interfaceid": "82a49b6b-6789-4652-8b08-5107437010b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:15:30 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:15:30 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1570510618',display_name='tempest-VolumesActionsTest-instance-1570510618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1570510618',id=46,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0786686c4b784fd5a1506dcf5c008787',ramdisk_id='',reservation_id='r-fi810eto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2131906562',owner_user_name='tempest-VolumesActionsTest-2131906562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:15:29Z,user_data=None,user_id='9a643b3a9df3483a83d820a5a50470bc',uuid=33eeb1f2-9510-444d-92ae-c209ea2e8393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82a49b6b-6789-4652-8b08-5107437010b2", "address": "fa:16:3e:04:a4:0f", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a49b6b-67", "ovs_interfaceid": "82a49b6b-6789-4652-8b08-5107437010b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Converting VIF {"id": "82a49b6b-6789-4652-8b08-5107437010b2", "address": "fa:16:3e:04:a4:0f", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a49b6b-67", "ovs_interfaceid": "82a49b6b-6789-4652-8b08-5107437010b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:a4:0f,bridge_name='br-int',has_traffic_filtering=True,id=82a49b6b-6789-4652-8b08-5107437010b2,network=Network(3450369c-e903-4091-a496-1ce7fecf7d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a49b6b-67') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.objects.instance [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lazy-loading 'pci_devices' on Instance uuid 33eeb1f2-9510-444d-92ae-c209ea2e8393 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:15:30 user nova-compute[74611]:   <uuid>33eeb1f2-9510-444d-92ae-c209ea2e8393</uuid>
Nov 13 10:15:30 user nova-compute[74611]:   <name>instance-0000002e</name>
Nov 13 10:15:30 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:15:30 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:15:30 user nova-compute[74611]:   <metadata>
Nov 13 10:15:30 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:15:30 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:15:30 user nova-compute[74611]:       <nova:name>tempest-VolumesActionsTest-instance-1570510618</nova:name>
Nov 13 10:15:30 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:15:30</nova:creationTime>
Nov 13 10:15:30 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:15:30 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:15:30 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:15:30 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:15:30 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:15:30 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:15:30 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:15:30 user nova-compute[74611]:       <nova:owner>
Nov 13 10:15:30 user nova-compute[74611]:         <nova:user uuid="9a643b3a9df3483a83d820a5a50470bc">tempest-VolumesActionsTest-2131906562-project-member</nova:user>
Nov 13 10:15:30 user nova-compute[74611]:         <nova:project uuid="0786686c4b784fd5a1506dcf5c008787">tempest-VolumesActionsTest-2131906562</nova:project>
Nov 13 10:15:30 user nova-compute[74611]:       </nova:owner>
Nov 13 10:15:30 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:15:30 user nova-compute[74611]:       <nova:ports>
Nov 13 10:15:30 user nova-compute[74611]:         <nova:port uuid="82a49b6b-6789-4652-8b08-5107437010b2">
Nov 13 10:15:30 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 10:15:30 user nova-compute[74611]:         </nova:port>
Nov 13 10:15:30 user nova-compute[74611]:       </nova:ports>
Nov 13 10:15:30 user nova-compute[74611]:     </nova:instance>
Nov 13 10:15:30 user nova-compute[74611]:   </metadata>
Nov 13 10:15:30 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:15:30 user nova-compute[74611]:     <system>
Nov 13 10:15:30 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:15:30 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:15:30 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:15:30 user nova-compute[74611]:       <entry name="serial">33eeb1f2-9510-444d-92ae-c209ea2e8393</entry>
Nov 13 10:15:30 user nova-compute[74611]:       <entry name="uuid">33eeb1f2-9510-444d-92ae-c209ea2e8393</entry>
Nov 13 10:15:30 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:15:30 user nova-compute[74611]:     </system>
Nov 13 10:15:30 user nova-compute[74611]:   </sysinfo>
Nov 13 10:15:30 user nova-compute[74611]:   <os>
Nov 13 10:15:30 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:15:30 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:15:30 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:15:30 user nova-compute[74611]:   </os>
Nov 13 10:15:30 user nova-compute[74611]:   <features>
Nov 13 10:15:30 user nova-compute[74611]:     <acpi/>
Nov 13 10:15:30 user nova-compute[74611]:     <apic/>
Nov 13 10:15:30 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:15:30 user nova-compute[74611]:   </features>
Nov 13 10:15:30 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:15:30 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:15:30 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:15:30 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:15:30 user nova-compute[74611]:   </clock>
Nov 13 10:15:30 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:15:30 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:15:30 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:15:30 user nova-compute[74611]:   </cpu>
Nov 13 10:15:30 user nova-compute[74611]:   <devices>
Nov 13 10:15:30 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:15:30 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:15:30 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk"/>
Nov 13 10:15:30 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:15:30 user nova-compute[74611]:     </disk>
Nov 13 10:15:30 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:15:30 user nova-compute[74611]:       <mac address="fa:16:3e:04:a4:0f"/>
Nov 13 10:15:30 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:15:30 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:15:30 user nova-compute[74611]:       <target dev="tap82a49b6b-67"/>
Nov 13 10:15:30 user nova-compute[74611]:     </interface>
Nov 13 10:15:30 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:15:30 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/console.log" append="off"/>
Nov 13 10:15:30 user nova-compute[74611]:     </serial>
Nov 13 10:15:30 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:15:30 user nova-compute[74611]:     <video>
Nov 13 10:15:30 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:15:30 user nova-compute[74611]:     </video>
Nov 13 10:15:30 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:15:30 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:15:30 user nova-compute[74611]:     </rng>
Nov 13 10:15:30 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:15:30 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:15:30 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:15:30 user nova-compute[74611]:     </memballoon>
Nov 13 10:15:30 user nova-compute[74611]:   </devices>
Nov 13 10:15:30 user nova-compute[74611]: </domain>
Nov 13 10:15:30 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1570510618',display_name='tempest-VolumesActionsTest-instance-1570510618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1570510618',id=46,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0786686c4b784fd5a1506dcf5c008787',ramdisk_id='',reservation_id='r-fi810eto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2131906562',owner_user_name='tempest-VolumesActionsTest-2131906562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:15:29Z,user_data=None,user_id='9a643b3a9df3483a83d820a5a50470bc',uuid=33eeb1f2-9510-444d-92ae-c209ea2e8393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82a49b6b-6789-4652-8b08-5107437010b2", "address": "fa:16:3e:04:a4:0f", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a49b6b-67", "ovs_interfaceid": "82a49b6b-6789-4652-8b08-5107437010b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Converting VIF {"id": "82a49b6b-6789-4652-8b08-5107437010b2", "address": "fa:16:3e:04:a4:0f", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a49b6b-67", "ovs_interfaceid": "82a49b6b-6789-4652-8b08-5107437010b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:a4:0f,bridge_name='br-int',has_traffic_filtering=True,id=82a49b6b-6789-4652-8b08-5107437010b2,network=Network(3450369c-e903-4091-a496-1ce7fecf7d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a49b6b-67') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG os_vif [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:a4:0f,bridge_name='br-int',has_traffic_filtering=True,id=82a49b6b-6789-4652-8b08-5107437010b2,network=Network(3450369c-e903-4091-a496-1ce7fecf7d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a49b6b-67') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f9b6a18-09bc-55e8-bc1e-bed677258610', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82a49b6b-67, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82a49b6b-67, col_values=(('qos', UUID('a26942a4-7029-4e95-883f-20076d68a1b6')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82a49b6b-67, col_values=(('external_ids', {'iface-id': '82a49b6b-6789-4652-8b08-5107437010b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:a4:0f', 'vm-uuid': '33eeb1f2-9510-444d-92ae-c209ea2e8393'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:30 user nova-compute[74611]: INFO os_vif [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:a4:0f,bridge_name='br-int',has_traffic_filtering=True,id=82a49b6b-6789-4652-8b08-5107437010b2,network=Network(3450369c-e903-4091-a496-1ce7fecf7d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a49b6b-67')
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:15:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] No VIF found with MAC fa:16:3e:04:a4:0f, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:15:31 user nova-compute[74611]: DEBUG nova.network.neutron [req-8ba4c720-e4a1-44b4-a597-0e886fa5ac76 req-601e8815-64e4-42f3-9f56-3b67616798e5 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Updated VIF entry in instance network info cache for port 82a49b6b-6789-4652-8b08-5107437010b2. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:15:31 user nova-compute[74611]: DEBUG nova.network.neutron [req-8ba4c720-e4a1-44b4-a597-0e886fa5ac76 req-601e8815-64e4-42f3-9f56-3b67616798e5 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Updating instance_info_cache with network_info: [{"id": "82a49b6b-6789-4652-8b08-5107437010b2", "address": "fa:16:3e:04:a4:0f", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a49b6b-67", "ovs_interfaceid": "82a49b6b-6789-4652-8b08-5107437010b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:15:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8ba4c720-e4a1-44b4-a597-0e886fa5ac76 req-601e8815-64e4-42f3-9f56-3b67616798e5 service nova] Releasing lock "refresh_cache-33eeb1f2-9510-444d-92ae-c209ea2e8393" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:15:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-38ea3631-d1ee-40d8-a7de-a7b36a5baca0 req-cfa278b5-e882-4071-ba70-e5c617e84402 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Received event network-vif-plugged-82a49b6b-6789-4652-8b08-5107437010b2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:15:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-38ea3631-d1ee-40d8-a7de-a7b36a5baca0 req-cfa278b5-e882-4071-ba70-e5c617e84402 service nova] Acquiring lock "33eeb1f2-9510-444d-92ae-c209ea2e8393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:15:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-38ea3631-d1ee-40d8-a7de-a7b36a5baca0 req-cfa278b5-e882-4071-ba70-e5c617e84402 service nova] Lock "33eeb1f2-9510-444d-92ae-c209ea2e8393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:15:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-38ea3631-d1ee-40d8-a7de-a7b36a5baca0 req-cfa278b5-e882-4071-ba70-e5c617e84402 service nova] Lock "33eeb1f2-9510-444d-92ae-c209ea2e8393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:15:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-38ea3631-d1ee-40d8-a7de-a7b36a5baca0 req-cfa278b5-e882-4071-ba70-e5c617e84402 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] No waiting events found dispatching network-vif-plugged-82a49b6b-6789-4652-8b08-5107437010b2 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:15:32 user nova-compute[74611]: WARNING nova.compute.manager [req-38ea3631-d1ee-40d8-a7de-a7b36a5baca0 req-cfa278b5-e882-4071-ba70-e5c617e84402 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Received unexpected event network-vif-plugged-82a49b6b-6789-4652-8b08-5107437010b2 for instance with vm_state building and task_state spawning.
Nov 13 10:15:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:15:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:15:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Instance spawned successfully.
Nov 13 10:15:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:15:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:15:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:15:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:15:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:15:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:15:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:15:34 user nova-compute[74611]: INFO nova.compute.manager [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 13 10:15:34 user nova-compute[74611]: DEBUG nova.compute.manager [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:15:34 user nova-compute[74611]: INFO nova.compute.manager [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Took 5.82 seconds to build instance.
Nov 13 10:15:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-7aec0c61-a94e-4fab-bf41-972d2101f8a5 req-297f374c-fb77-4b07-bb53-7be02845ad09 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Received event network-vif-plugged-82a49b6b-6789-4652-8b08-5107437010b2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:15:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7aec0c61-a94e-4fab-bf41-972d2101f8a5 req-297f374c-fb77-4b07-bb53-7be02845ad09 service nova] Acquiring lock "33eeb1f2-9510-444d-92ae-c209ea2e8393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:15:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7aec0c61-a94e-4fab-bf41-972d2101f8a5 req-297f374c-fb77-4b07-bb53-7be02845ad09 service nova] Lock "33eeb1f2-9510-444d-92ae-c209ea2e8393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:15:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7aec0c61-a94e-4fab-bf41-972d2101f8a5 req-297f374c-fb77-4b07-bb53-7be02845ad09 service nova] Lock "33eeb1f2-9510-444d-92ae-c209ea2e8393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:15:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-7aec0c61-a94e-4fab-bf41-972d2101f8a5 req-297f374c-fb77-4b07-bb53-7be02845ad09 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] No waiting events found dispatching network-vif-plugged-82a49b6b-6789-4652-8b08-5107437010b2 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:15:34 user nova-compute[74611]: WARNING nova.compute.manager [req-7aec0c61-a94e-4fab-bf41-972d2101f8a5 req-297f374c-fb77-4b07-bb53-7be02845ad09 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Received unexpected event network-vif-plugged-82a49b6b-6789-4652-8b08-5107437010b2 for instance with vm_state active and task_state None.
Nov 13 10:15:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-789c3ff5-0b98-455c-90e2-b715dfc95352 tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "33eeb1f2-9510-444d-92ae-c209ea2e8393" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.916s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:15:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:43 user nova-compute[74611]: INFO nova.compute.manager [None req-86124b37-b386-4650-9532-fbc643782112 tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Get console output
Nov 13 10:15:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-3f56f9ae-2ffc-4934-9cfc-0fd4d61fb7f2 req-a891e345-8c68-4284-8934-2718d91fd5c6 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received event network-changed-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:15:43 user nova-compute[74611]: DEBUG nova.compute.manager [req-3f56f9ae-2ffc-4934-9cfc-0fd4d61fb7f2 req-a891e345-8c68-4284-8934-2718d91fd5c6 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Refreshing instance network info cache due to event network-changed-457c4784-2cc7-4521-8d86-86845bce490e. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:15:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3f56f9ae-2ffc-4934-9cfc-0fd4d61fb7f2 req-a891e345-8c68-4284-8934-2718d91fd5c6 service nova] Acquiring lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:15:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3f56f9ae-2ffc-4934-9cfc-0fd4d61fb7f2 req-a891e345-8c68-4284-8934-2718d91fd5c6 service nova] Acquired lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:15:43 user nova-compute[74611]: DEBUG nova.network.neutron [req-3f56f9ae-2ffc-4934-9cfc-0fd4d61fb7f2 req-a891e345-8c68-4284-8934-2718d91fd5c6 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Refreshing network info cache for port 457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:15:43 user nova-compute[74611]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 13 10:15:43 user nova-compute[74611]: DEBUG nova.network.neutron [req-3f56f9ae-2ffc-4934-9cfc-0fd4d61fb7f2 req-a891e345-8c68-4284-8934-2718d91fd5c6 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Updated VIF entry in instance network info cache for port 457c4784-2cc7-4521-8d86-86845bce490e. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:15:43 user nova-compute[74611]: DEBUG nova.network.neutron [req-3f56f9ae-2ffc-4934-9cfc-0fd4d61fb7f2 req-a891e345-8c68-4284-8934-2718d91fd5c6 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Updating instance_info_cache with network_info: [{"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:15:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3f56f9ae-2ffc-4934-9cfc-0fd4d61fb7f2 req-a891e345-8c68-4284-8934-2718d91fd5c6 service nova] Releasing lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:15:44 user nova-compute[74611]: DEBUG nova.compute.manager [req-e691103d-b2c3-4d98-bb91-7a598838294b req-4e908f10-c331-4dfd-bd73-c5a3cb72b88f service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received event network-changed-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:15:44 user nova-compute[74611]: DEBUG nova.compute.manager [req-e691103d-b2c3-4d98-bb91-7a598838294b req-4e908f10-c331-4dfd-bd73-c5a3cb72b88f service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Refreshing instance network info cache due to event network-changed-457c4784-2cc7-4521-8d86-86845bce490e. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:15:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e691103d-b2c3-4d98-bb91-7a598838294b req-4e908f10-c331-4dfd-bd73-c5a3cb72b88f service nova] Acquiring lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:15:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e691103d-b2c3-4d98-bb91-7a598838294b req-4e908f10-c331-4dfd-bd73-c5a3cb72b88f service nova] Acquired lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:15:44 user nova-compute[74611]: DEBUG nova.network.neutron [req-e691103d-b2c3-4d98-bb91-7a598838294b req-4e908f10-c331-4dfd-bd73-c5a3cb72b88f service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Refreshing network info cache for port 457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:15:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "4704cd02-59cc-4d64-804a-79a38d05b00e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:15:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:15:44 user nova-compute[74611]: INFO nova.compute.manager [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Detaching volume 89921eed-fd6a-4b41-af43-eec15a47fe73
Nov 13 10:15:44 user nova-compute[74611]: INFO nova.virt.block_device [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Attempting to driver detach volume 89921eed-fd6a-4b41-af43-eec15a47fe73 from mountpoint /dev/vdb
Nov 13 10:15:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Attempting to detach device vdb from instance 4704cd02-59cc-4d64-804a-79a38d05b00e from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:15:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:15:44 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:15:44 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:15:44 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:15:44 user nova-compute[74611]:   <serial>89921eed-fd6a-4b41-af43-eec15a47fe73</serial>
Nov 13 10:15:44 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 10:15:44 user nova-compute[74611]: </disk>
Nov 13 10:15:44 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:15:44 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Successfully detached device vdb from instance 4704cd02-59cc-4d64-804a-79a38d05b00e from the persistent domain config.
Nov 13 10:15:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4704cd02-59cc-4d64-804a-79a38d05b00e from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:15:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:15:44 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:15:44 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:15:44 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:15:44 user nova-compute[74611]:   <serial>89921eed-fd6a-4b41-af43-eec15a47fe73</serial>
Nov 13 10:15:44 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 10:15:44 user nova-compute[74611]: </disk>
Nov 13 10:15:44 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:15:44 user nova-compute[74611]: DEBUG nova.network.neutron [req-e691103d-b2c3-4d98-bb91-7a598838294b req-4e908f10-c331-4dfd-bd73-c5a3cb72b88f service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Updated VIF entry in instance network info cache for port 457c4784-2cc7-4521-8d86-86845bce490e. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:15:44 user nova-compute[74611]: DEBUG nova.network.neutron [req-e691103d-b2c3-4d98-bb91-7a598838294b req-4e908f10-c331-4dfd-bd73-c5a3cb72b88f service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Updating instance_info_cache with network_info: [{"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:15:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e691103d-b2c3-4d98-bb91-7a598838294b req-4e908f10-c331-4dfd-bd73-c5a3cb72b88f service nova] Releasing lock "refresh_cache-4704cd02-59cc-4d64-804a-79a38d05b00e" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:15:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4704cd02-59cc-4d64-804a-79a38d05b00e {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:15:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:47 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:15:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:15:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:15:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:15:47 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:15:47 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Updating instance_info_cache with network_info: [{"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:15:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-ed1dfac0-31b6-4e63-895e-29877e17d178" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:15:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:15:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:52 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:15:52 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:15:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:15:53 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:15:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:56 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:15:57 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:15:57 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:15:58 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:15:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:15:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:15:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:15:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:15:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:15:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:15:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:15:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:15:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:15:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:15:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:15:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:15:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:15:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:15:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:15:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:15:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:15:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:15:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:15:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:15:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:15:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:16:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:16:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8271MB free_disk=25.221786499023438GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:16:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:16:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:16:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:16:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 4704cd02-59cc-4d64-804a-79a38d05b00e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:16:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance ed1dfac0-31b6-4e63-895e-29877e17d178 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:16:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 770d57de-444b-42d1-824b-85e881fe76dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:16:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 33eeb1f2-9510-444d-92ae-c209ea2e8393 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:16:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:16:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:16:00 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:16:00 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:16:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:16:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:16:00 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:02 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:16:02 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:04 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4704cd02-59cc-4d64-804a-79a38d05b00e is timed out.
Nov 13 10:16:04 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Successfully detached device vdb from instance 4704cd02-59cc-4d64-804a-79a38d05b00e from the live domain config.
Nov 13 10:16:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPANsqny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:16:04 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:16:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[73983cbd-9c6b-47a2-8094-4f080ae87003]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:16:04 user nova-compute[74611]: No targets found.
Nov 13 10:16:04 user nova-compute[74611]: iSNS:
Nov 13 10:16:04 user nova-compute[74611]: No targets found.
Nov 13 10:16:04 user nova-compute[74611]: STATIC:
Nov 13 10:16:04 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73
Nov 13 10:16:04 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:16:04 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:16:04 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd
Nov 13 10:16:04 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:16:04 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:16:04 user nova-compute[74611]: FIRMWARE:
Nov 13 10:16:04 user nova-compute[74611]: No targets found.
Nov 13 10:16:04 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:16:04 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:16:04 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1742172-f861-4f06-919e-aa9036ff05c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd33be3-2fc8-4e63-aab5-c40485040efe]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:16:04 user nova-compute[74611]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)
Nov 13 10:16:04 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:16:04 user nova-compute[74611]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 (non-flash)
Nov 13 10:16:04 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb855dbeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[661fb0c9-8b1f-4da3-9ab6-5794117259cb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[435b53bc-24f8-4ef2-aeac-79299a465170]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0098b48f-d9b3-4b94-93b1-bf24b5b6b9b7]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:04 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7efe8e-15d3-4ca4-9bf7-3a242dd9180a]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a7fd17-f3a6-46d4-a677-d4b457f7180a]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b876a1b7-3edb-43cb-895c-d1053d6bb979]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73, portal: 172.16.0.220,3260]
Nov 13 10:16:05 user nova-compute[74611]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73, portal: 172.16.0.220,3260] successful.
Nov 13 10:16:05 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89921eed-fd6a-4b41-af43-eec15a47fe73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e402e4-e6b5-4cd8-9a4a-9ba7d2926055]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] <== disconnect_volume: return (335ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG nova.objects.instance [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lazy-loading 'flavor' on Instance uuid 4704cd02-59cc-4d64-804a-79a38d05b00e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:16:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7f3847c4-bf94-4edb-b55b-6f46f19b3f7d tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.715s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:16:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:13 user nova-compute[74611]: DEBUG nova.compute.manager [req-9725c366-41c1-4624-aac2-0aa487cc8649 req-e0e73056-f505-4942-ba0e-d0e9375adf68 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-changed-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:16:13 user nova-compute[74611]: DEBUG nova.compute.manager [req-9725c366-41c1-4624-aac2-0aa487cc8649 req-e0e73056-f505-4942-ba0e-d0e9375adf68 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Refreshing instance network info cache due to event network-changed-a3a02b77-480a-4ffe-a8da-f0bda6e70f57. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:16:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9725c366-41c1-4624-aac2-0aa487cc8649 req-e0e73056-f505-4942-ba0e-d0e9375adf68 service nova] Acquiring lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:16:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9725c366-41c1-4624-aac2-0aa487cc8649 req-e0e73056-f505-4942-ba0e-d0e9375adf68 service nova] Acquired lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:16:13 user nova-compute[74611]: DEBUG nova.network.neutron [req-9725c366-41c1-4624-aac2-0aa487cc8649 req-e0e73056-f505-4942-ba0e-d0e9375adf68 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Refreshing network info cache for port a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:16:13 user nova-compute[74611]: DEBUG nova.network.neutron [req-9725c366-41c1-4624-aac2-0aa487cc8649 req-e0e73056-f505-4942-ba0e-d0e9375adf68 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updated VIF entry in instance network info cache for port a3a02b77-480a-4ffe-a8da-f0bda6e70f57. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:16:13 user nova-compute[74611]: DEBUG nova.network.neutron [req-9725c366-41c1-4624-aac2-0aa487cc8649 req-e0e73056-f505-4942-ba0e-d0e9375adf68 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updating instance_info_cache with network_info: [{"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:16:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-9725c366-41c1-4624-aac2-0aa487cc8649 req-e0e73056-f505-4942-ba0e-d0e9375adf68 service nova] Releasing lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:16:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:16:14 user nova-compute[74611]: INFO nova.compute.manager [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] instance snapshotting
Nov 13 10:16:14 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Beginning live snapshot process
Nov 13 10:16:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json -f qcow2 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json -f qcow2 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwqyky6ug/f731df433a7d4dff8dddcaffc6e0a132.delta 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwqyky6ug/f731df433a7d4dff8dddcaffc6e0a132.delta 1073741824" returned: 0 in 0.056s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:15 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 10:16:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 10:16:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74611) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 10:16:17 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 10:16:17 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 10:16:17 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwqyky6ug/f731df433a7d4dff8dddcaffc6e0a132.delta /opt/stack/data/nova/instances/snapshots/tmpwqyky6ug/f731df433a7d4dff8dddcaffc6e0a132 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:17 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwqyky6ug/f731df433a7d4dff8dddcaffc6e0a132.delta /opt/stack/data/nova/instances/snapshots/tmpwqyky6ug/f731df433a7d4dff8dddcaffc6e0a132" returned: 0 in 0.684s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:17 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Snapshot extracted, beginning image upload
Nov 13 10:16:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:20 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Snapshot image upload complete
Nov 13 10:16:20 user nova-compute[74611]: INFO nova.compute.manager [None req-71726684-ebdc-4260-9aac-bc2fd8f2fba2 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Took 5.82 seconds to snapshot the instance on the hypervisor.
Nov 13 10:16:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "4704cd02-59cc-4d64-804a-79a38d05b00e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:16:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:16:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:16:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:16:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:16:35 user nova-compute[74611]: INFO nova.compute.manager [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Terminating instance
Nov 13 10:16:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:16:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-74b3112e-e4d1-400f-bbb7-6b88c455fad0 req-cda300a3-63b4-4633-8dea-82b1c0c95015 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received event network-vif-unplugged-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:16:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-74b3112e-e4d1-400f-bbb7-6b88c455fad0 req-cda300a3-63b4-4633-8dea-82b1c0c95015 service nova] Acquiring lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:16:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-74b3112e-e4d1-400f-bbb7-6b88c455fad0 req-cda300a3-63b4-4633-8dea-82b1c0c95015 service nova] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:16:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-74b3112e-e4d1-400f-bbb7-6b88c455fad0 req-cda300a3-63b4-4633-8dea-82b1c0c95015 service nova] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:16:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-74b3112e-e4d1-400f-bbb7-6b88c455fad0 req-cda300a3-63b4-4633-8dea-82b1c0c95015 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] No waiting events found dispatching network-vif-unplugged-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:16:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-74b3112e-e4d1-400f-bbb7-6b88c455fad0 req-cda300a3-63b4-4633-8dea-82b1c0c95015 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received event network-vif-unplugged-457c4784-2cc7-4521-8d86-86845bce490e for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:16:36 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Instance destroyed successfully.
Nov 13 10:16:36 user nova-compute[74611]: DEBUG nova.objects.instance [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lazy-loading 'resources' on Instance uuid 4704cd02-59cc-4d64-804a-79a38d05b00e {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:16:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1254234458',display_name='tempest-TestMinimumBasicScenario-server-1254234458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1254234458',id=43,image_ref='876d0ea7-601f-4d91-9da8-e815a1c512f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI92Z30Xq53Ktv+Nq8eUC6I8etuxy1sEESnYSIHfkfvgq/zsYzW7tWZ5Wp6GnOGv5ALJIAbwu1T1e4B/Y7w/27W0CDeF3iHGB5ehXLN0ga5fVz0HbSyDO2CMLaOL8EyxA==',key_name='tempest-TestMinimumBasicScenario-1202250230',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:11:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5990cb4516a04312b3ccda9c39a44c4a',ramdisk_id='',reservation_id='r-mkiy3udd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='876d0ea7-601f-4d91-9da8-e815a1c512f1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-163886892',owner_user_name='tempest-TestMinimumBasicScenario-163886892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:13:59Z,user_data=None,user_id='35bc3ea05d5b4f9a85ba453446b2bee9',uuid=4704cd02-59cc-4d64-804a-79a38d05b00e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:16:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converting VIF {"id": "457c4784-2cc7-4521-8d86-86845bce490e", "address": "fa:16:3e:13:6c:f6", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457c4784-2c", "ovs_interfaceid": "457c4784-2cc7-4521-8d86-86845bce490e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:16:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=457c4784-2cc7-4521-8d86-86845bce490e,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457c4784-2c') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:16:36 user nova-compute[74611]: DEBUG os_vif [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=457c4784-2cc7-4521-8d86-86845bce490e,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457c4784-2c') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:16:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap457c4784-2c, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:16:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:16:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa74f3cc-1dd9-486e-8f27-69f616746b79) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:16:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:16:36 user nova-compute[74611]: INFO os_vif [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=457c4784-2cc7-4521-8d86-86845bce490e,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457c4784-2c')
Nov 13 10:16:36 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Deleting instance files /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e_del
Nov 13 10:16:36 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Deletion of /opt/stack/data/nova/instances/4704cd02-59cc-4d64-804a-79a38d05b00e_del complete
Nov 13 10:16:36 user nova-compute[74611]: INFO nova.compute.manager [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 13 10:16:36 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:16:36 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:16:36 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:16:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:37 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:16:37 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Took 0.46 seconds to deallocate network for instance.
Nov 13 10:16:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-6f6c3e50-2290-4cc0-bcdd-d4bc4699447c req-8a930237-7d50-4971-a500-c4c6bdc40335 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received event network-vif-deleted-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:16:37 user nova-compute[74611]: INFO nova.compute.manager [req-6f6c3e50-2290-4cc0-bcdd-d4bc4699447c req-8a930237-7d50-4971-a500-c4c6bdc40335 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Neutron deleted interface 457c4784-2cc7-4521-8d86-86845bce490e; detaching it from the instance and deleting it from the info cache
Nov 13 10:16:37 user nova-compute[74611]: DEBUG nova.network.neutron [req-6f6c3e50-2290-4cc0-bcdd-d4bc4699447c req-8a930237-7d50-4971-a500-c4c6bdc40335 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:16:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-6f6c3e50-2290-4cc0-bcdd-d4bc4699447c req-8a930237-7d50-4971-a500-c4c6bdc40335 service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Detach interface failed, port_id=457c4784-2cc7-4521-8d86-86845bce490e, reason: Instance 4704cd02-59cc-4d64-804a-79a38d05b00e could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 10:16:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:16:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:16:37 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:16:37 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:16:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:16:37 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Deleted allocations for instance 4704cd02-59cc-4d64-804a-79a38d05b00e
Nov 13 10:16:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-9409d380-a1a8-4761-99b6-14b286005eb7 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.717s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:16:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-cc84cc9c-0597-4e15-9cbb-7d5f7c175522 req-892e8727-1ab6-4903-9dbe-d5d4d559a05d service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received event network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:16:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cc84cc9c-0597-4e15-9cbb-7d5f7c175522 req-892e8727-1ab6-4903-9dbe-d5d4d559a05d service nova] Acquiring lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:16:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cc84cc9c-0597-4e15-9cbb-7d5f7c175522 req-892e8727-1ab6-4903-9dbe-d5d4d559a05d service nova] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:16:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cc84cc9c-0597-4e15-9cbb-7d5f7c175522 req-892e8727-1ab6-4903-9dbe-d5d4d559a05d service nova] Lock "4704cd02-59cc-4d64-804a-79a38d05b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:16:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-cc84cc9c-0597-4e15-9cbb-7d5f7c175522 req-892e8727-1ab6-4903-9dbe-d5d4d559a05d service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] No waiting events found dispatching network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:16:38 user nova-compute[74611]: WARNING nova.compute.manager [req-cc84cc9c-0597-4e15-9cbb-7d5f7c175522 req-892e8727-1ab6-4903-9dbe-d5d4d559a05d service nova] [instance: 4704cd02-59cc-4d64-804a-79a38d05b00e] Received unexpected event network-vif-plugged-457c4784-2cc7-4521-8d86-86845bce490e for instance with vm_state deleted and task_state None.
Nov 13 10:16:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "ed1dfac0-31b6-4e63-895e-29877e17d178" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:16:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:16:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:16:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:16:43 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:16:43 user nova-compute[74611]: INFO nova.compute.manager [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Terminating instance
Nov 13 10:16:43 user nova-compute[74611]: DEBUG nova.compute.manager [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:16:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG nova.compute.manager [req-b154349d-9673-47c5-924f-c2a4f823a9c1 req-2784adb2-2a88-4da4-a01b-f5ad756aaf84 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received event network-vif-unplugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b154349d-9673-47c5-924f-c2a4f823a9c1 req-2784adb2-2a88-4da4-a01b-f5ad756aaf84 service nova] Acquiring lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b154349d-9673-47c5-924f-c2a4f823a9c1 req-2784adb2-2a88-4da4-a01b-f5ad756aaf84 service nova] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-b154349d-9673-47c5-924f-c2a4f823a9c1 req-2784adb2-2a88-4da4-a01b-f5ad756aaf84 service nova] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG nova.compute.manager [req-b154349d-9673-47c5-924f-c2a4f823a9c1 req-2784adb2-2a88-4da4-a01b-f5ad756aaf84 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] No waiting events found dispatching network-vif-unplugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG nova.compute.manager [req-b154349d-9673-47c5-924f-c2a4f823a9c1 req-2784adb2-2a88-4da4-a01b-f5ad756aaf84 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received event network-vif-unplugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:44 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Instance destroyed successfully.
Nov 13 10:16:44 user nova-compute[74611]: DEBUG nova.objects.instance [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lazy-loading 'resources' on Instance uuid ed1dfac0-31b6-4e63-895e-29877e17d178 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1947219481',display_name='tempest-ServerActionsTestOtherA-server-1947219481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1947219481',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyvkPZ/C5Pk5XOFxP5rMcYJVq0nGL8MEwZ1COcFqCFBcO7G74gr+o/bZOILVW3PDzyd5NY9xtWs0kgCNTm8xNQIJrW9d3YRiHEICGlxrvJ1iCAAc7YEKxcFMW7SpPA0Dw==',key_name='tempest-keypair-2093749558',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:12:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6a0b0a078bd44908cd7cd4593914eef',ramdisk_id='',reservation_id='r-ixwiy3ki',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2135577355',owner_user_name='tempest-ServerActionsTestOtherA-2135577355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:13:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22322be2dd04410b6cd53c31e639b3b',uuid=ed1dfac0-31b6-4e63-895e-29877e17d178,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converting VIF {"id": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "address": "fa:16:3e:d0:42:59", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53ebdb2-39", "ovs_interfaceid": "a53ebdb2-3917-46df-b5a3-af5682496fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:42:59,bridge_name='br-int',has_traffic_filtering=True,id=a53ebdb2-3917-46df-b5a3-af5682496fa8,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53ebdb2-39') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_vif [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:42:59,bridge_name='br-int',has_traffic_filtering=True,id=a53ebdb2-3917-46df-b5a3-af5682496fa8,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53ebdb2-39') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa53ebdb2-39, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0bac5533-6708-466f-bc68-91f0196f5ace) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:16:44 user nova-compute[74611]: INFO os_vif [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:42:59,bridge_name='br-int',has_traffic_filtering=True,id=a53ebdb2-3917-46df-b5a3-af5682496fa8,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53ebdb2-39')
Nov 13 10:16:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZwVaFIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:16:44 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7ddc22-1756-48c8-b0e5-2226ccda5556]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:16:44 user nova-compute[74611]: No targets found.
Nov 13 10:16:44 user nova-compute[74611]: iSNS:
Nov 13 10:16:44 user nova-compute[74611]: No targets found.
Nov 13 10:16:44 user nova-compute[74611]: STATIC:
Nov 13 10:16:44 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd
Nov 13 10:16:44 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:16:44 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:16:44 user nova-compute[74611]: FIRMWARE:
Nov 13 10:16:44 user nova-compute[74611]: No targets found.
Nov 13 10:16:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:16:44 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:16:44 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c546d20-a20a-4405-8de1-2a2ac930a3a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec7836e-3d3d-4646-ab78-926372a5b6ed]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:16:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd (non-flash)
Nov 13 10:16:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7c2b7b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd'): ({'sde'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Removing single pathed devices sde {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[642ac020-e087-4e35-8239-5e5970471269]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f51cce4-f0f4-4e11-b183-dcc08e438b1c]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Flushing IO for device /dev/sde {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fbf1d4-2ca7-4744-92c2-d9351eb17bb2]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e49a3c3-2d17-46f7-9f90-3f1c2d45aaab]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] SCSI volumes sde have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23165343133326231', '/dev/disk/by-id/scsi-1SCST_BIO3eab7c7-1e4132b1a142a722', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3eab7c7') {{(pid=85776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77a68d6-f4f3-45c3-af3c-8f096fd7da60]: (4, None) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8462ac79-35a9-4cf6-996d-5897814a66ea]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cabe66-254d-4e55-8fd9-9d324a2beafe]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd, portal: 172.16.0.220,3260]
Nov 13 10:16:44 user nova-compute[74611]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd, portal: 172.16.0.220,3260] successful.
Nov 13 10:16:44 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b211e65b-4e88-4035-8e8b-4cfb44706fbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[792bf9f5-0092-4940-83e0-57f959f3d56b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] <== disconnect_volume: return (318ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:16:44 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:16:44 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Deleting instance files /opt/stack/data/nova/instances/ed1dfac0-31b6-4e63-895e-29877e17d178_del
Nov 13 10:16:44 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Deletion of /opt/stack/data/nova/instances/ed1dfac0-31b6-4e63-895e-29877e17d178_del complete
Nov 13 10:16:45 user nova-compute[74611]: INFO nova.compute.manager [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 13 10:16:45 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:16:45 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:16:45 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:16:45 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:16:45 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Took 0.65 seconds to deallocate network for instance.
Nov 13 10:16:46 user nova-compute[74611]: DEBUG nova.compute.manager [req-a1156416-fdc7-4884-9385-23f97a38a4a6 req-3226218d-b055-4852-90a5-1e53eacd0b28 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received event network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:16:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a1156416-fdc7-4884-9385-23f97a38a4a6 req-3226218d-b055-4852-90a5-1e53eacd0b28 service nova] Acquiring lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:16:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a1156416-fdc7-4884-9385-23f97a38a4a6 req-3226218d-b055-4852-90a5-1e53eacd0b28 service nova] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:16:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a1156416-fdc7-4884-9385-23f97a38a4a6 req-3226218d-b055-4852-90a5-1e53eacd0b28 service nova] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:16:46 user nova-compute[74611]: DEBUG nova.compute.manager [req-a1156416-fdc7-4884-9385-23f97a38a4a6 req-3226218d-b055-4852-90a5-1e53eacd0b28 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] No waiting events found dispatching network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:16:46 user nova-compute[74611]: WARNING nova.compute.manager [req-a1156416-fdc7-4884-9385-23f97a38a4a6 req-3226218d-b055-4852-90a5-1e53eacd0b28 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received unexpected event network-vif-plugged-a53ebdb2-3917-46df-b5a3-af5682496fa8 for instance with vm_state active and task_state deleting.
Nov 13 10:16:46 user nova-compute[74611]: DEBUG nova.compute.manager [req-a1156416-fdc7-4884-9385-23f97a38a4a6 req-3226218d-b055-4852-90a5-1e53eacd0b28 service nova] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Received event network-vif-deleted-a53ebdb2-3917-46df-b5a3-af5682496fa8 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:16:46 user nova-compute[74611]: INFO nova.compute.manager [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Took 0.74 seconds to detach 1 volumes for instance.
Nov 13 10:16:46 user nova-compute[74611]: DEBUG nova.compute.manager [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: ed1dfac0-31b6-4e63-895e-29877e17d178] Deleting volume: b211e65b-4e88-4035-8e8b-4cfb44706fbd {{(pid=74611) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 10:16:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:16:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:16:46 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:16:46 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:16:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:16:46 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Deleted allocations for instance ed1dfac0-31b6-4e63-895e-29877e17d178
Nov 13 10:16:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-da538f27-5649-40d1-b93c-cdc81f2e37fb tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "ed1dfac0-31b6-4e63-895e-29877e17d178" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.992s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:16:47 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:16:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:16:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Didn't find any instances for network info cache update. {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 10:16:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:52 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:16:52 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:16:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:16:53 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:16:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:16:57 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:16:58 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:16:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:16:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:16:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:16:58 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:16:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:16:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:16:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:16:59 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:16:59 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:16:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8623MB free_disk=25.19894790649414GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:16:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:16:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:16:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 822a3afe-eae1-4960-b347-89c58fb10c4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:16:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 770d57de-444b-42d1-824b-85e881fe76dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:16:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 33eeb1f2-9510-444d-92ae-c209ea2e8393 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:16:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:16:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:16:59 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:16:59 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:17:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:17:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:01 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:17:02 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:17:04 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:17:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:17:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:17:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "33eeb1f2-9510-444d-92ae-c209ea2e8393" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "33eeb1f2-9510-444d-92ae-c209ea2e8393" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "33eeb1f2-9510-444d-92ae-c209ea2e8393-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "33eeb1f2-9510-444d-92ae-c209ea2e8393-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "33eeb1f2-9510-444d-92ae-c209ea2e8393-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:19 user nova-compute[74611]: INFO nova.compute.manager [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Terminating instance
Nov 13 10:17:19 user nova-compute[74611]: DEBUG nova.compute.manager [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:17:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-bcc8f302-7479-4889-8e57-a2b962ad8bed req-f27392a5-cfc8-4bac-b242-41234b1e21c8 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Received event network-vif-unplugged-82a49b6b-6789-4652-8b08-5107437010b2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:17:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bcc8f302-7479-4889-8e57-a2b962ad8bed req-f27392a5-cfc8-4bac-b242-41234b1e21c8 service nova] Acquiring lock "33eeb1f2-9510-444d-92ae-c209ea2e8393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bcc8f302-7479-4889-8e57-a2b962ad8bed req-f27392a5-cfc8-4bac-b242-41234b1e21c8 service nova] Lock "33eeb1f2-9510-444d-92ae-c209ea2e8393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bcc8f302-7479-4889-8e57-a2b962ad8bed req-f27392a5-cfc8-4bac-b242-41234b1e21c8 service nova] Lock "33eeb1f2-9510-444d-92ae-c209ea2e8393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-bcc8f302-7479-4889-8e57-a2b962ad8bed req-f27392a5-cfc8-4bac-b242-41234b1e21c8 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] No waiting events found dispatching network-vif-unplugged-82a49b6b-6789-4652-8b08-5107437010b2 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:17:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-bcc8f302-7479-4889-8e57-a2b962ad8bed req-f27392a5-cfc8-4bac-b242-41234b1e21c8 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Received event network-vif-unplugged-82a49b6b-6789-4652-8b08-5107437010b2 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:17:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:20 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Instance destroyed successfully.
Nov 13 10:17:20 user nova-compute[74611]: DEBUG nova.objects.instance [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lazy-loading 'resources' on Instance uuid 33eeb1f2-9510-444d-92ae-c209ea2e8393 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1570510618',display_name='tempest-VolumesActionsTest-instance-1570510618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1570510618',id=46,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0786686c4b784fd5a1506dcf5c008787',ramdisk_id='',reservation_id='r-fi810eto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2131906562',owner_user_name='tempest-VolumesActionsTest-2131906562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:15:34Z,user_data=None,user_id='9a643b3a9df3483a83d820a5a50470bc',uuid=33eeb1f2-9510-444d-92ae-c209ea2e8393,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82a49b6b-6789-4652-8b08-5107437010b2", "address": "fa:16:3e:04:a4:0f", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a49b6b-67", "ovs_interfaceid": "82a49b6b-6789-4652-8b08-5107437010b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Converting VIF {"id": "82a49b6b-6789-4652-8b08-5107437010b2", "address": "fa:16:3e:04:a4:0f", "network": {"id": "3450369c-e903-4091-a496-1ce7fecf7d0b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-701519378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0786686c4b784fd5a1506dcf5c008787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a49b6b-67", "ovs_interfaceid": "82a49b6b-6789-4652-8b08-5107437010b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:a4:0f,bridge_name='br-int',has_traffic_filtering=True,id=82a49b6b-6789-4652-8b08-5107437010b2,network=Network(3450369c-e903-4091-a496-1ce7fecf7d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a49b6b-67') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG os_vif [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:a4:0f,bridge_name='br-int',has_traffic_filtering=True,id=82a49b6b-6789-4652-8b08-5107437010b2,network=Network(3450369c-e903-4091-a496-1ce7fecf7d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a49b6b-67') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82a49b6b-67, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a26942a4-7029-4e95-883f-20076d68a1b6) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:17:20 user nova-compute[74611]: INFO os_vif [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:a4:0f,bridge_name='br-int',has_traffic_filtering=True,id=82a49b6b-6789-4652-8b08-5107437010b2,network=Network(3450369c-e903-4091-a496-1ce7fecf7d0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a49b6b-67')
Nov 13 10:17:20 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Deleting instance files /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393_del
Nov 13 10:17:20 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Deletion of /opt/stack/data/nova/instances/33eeb1f2-9510-444d-92ae-c209ea2e8393_del complete
Nov 13 10:17:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:20 user nova-compute[74611]: INFO nova.compute.manager [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 13 10:17:20 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:17:20 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Took 0.54 seconds to deallocate network for instance.
Nov 13 10:17:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-164b8633-742d-4146-ae96-1bd6410c79d7 req-0b6b5438-771c-4a1e-8c35-c137b280d52e service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Received event network-vif-deleted-82a49b6b-6789-4652-8b08-5107437010b2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:17:20 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:17:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:21 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Deleted allocations for instance 33eeb1f2-9510-444d-92ae-c209ea2e8393
Nov 13 10:17:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-53fafbb0-d387-4b80-98a4-81133ca9b14c tempest-VolumesActionsTest-2131906562 tempest-VolumesActionsTest-2131906562-project-member] Lock "33eeb1f2-9510-444d-92ae-c209ea2e8393" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.954s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:21 user nova-compute[74611]: DEBUG nova.compute.manager [req-1a95811d-4c5a-4244-b699-5c7b8e71c91b req-4879b745-faae-48c7-8cf5-b50c35074ab6 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Received event network-vif-plugged-82a49b6b-6789-4652-8b08-5107437010b2 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:17:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1a95811d-4c5a-4244-b699-5c7b8e71c91b req-4879b745-faae-48c7-8cf5-b50c35074ab6 service nova] Acquiring lock "33eeb1f2-9510-444d-92ae-c209ea2e8393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1a95811d-4c5a-4244-b699-5c7b8e71c91b req-4879b745-faae-48c7-8cf5-b50c35074ab6 service nova] Lock "33eeb1f2-9510-444d-92ae-c209ea2e8393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1a95811d-4c5a-4244-b699-5c7b8e71c91b req-4879b745-faae-48c7-8cf5-b50c35074ab6 service nova] Lock "33eeb1f2-9510-444d-92ae-c209ea2e8393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:21 user nova-compute[74611]: DEBUG nova.compute.manager [req-1a95811d-4c5a-4244-b699-5c7b8e71c91b req-4879b745-faae-48c7-8cf5-b50c35074ab6 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] No waiting events found dispatching network-vif-plugged-82a49b6b-6789-4652-8b08-5107437010b2 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:17:21 user nova-compute[74611]: WARNING nova.compute.manager [req-1a95811d-4c5a-4244-b699-5c7b8e71c91b req-4879b745-faae-48c7-8cf5-b50c35074ab6 service nova] [instance: 33eeb1f2-9510-444d-92ae-c209ea2e8393] Received unexpected event network-vif-plugged-82a49b6b-6789-4652-8b08-5107437010b2 for instance with vm_state deleted and task_state None.
Nov 13 10:17:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:29 user nova-compute[74611]: DEBUG nova.compute.manager [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:17:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:29 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:17:29 user nova-compute[74611]: INFO nova.compute.claims [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Claim successful on node user
Nov 13 10:17:29 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:17:29 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:17:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:29 user nova-compute[74611]: DEBUG nova.compute.manager [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:17:29 user nova-compute[74611]: DEBUG nova.compute.manager [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:17:29 user nova-compute[74611]: DEBUG nova.network.neutron [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:17:29 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:17:29 user nova-compute[74611]: DEBUG nova.compute.manager [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:17:29 user nova-compute[74611]: DEBUG nova.policy [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35bc3ea05d5b4f9a85ba453446b2bee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5990cb4516a04312b3ccda9c39a44c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:17:30 user nova-compute[74611]: DEBUG nova.compute.manager [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:17:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:17:30 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Creating image(s)
Nov 13 10:17:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "/opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "/opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "965225700c29c9f7174a11f26beb75c950695715" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "965225700c29c9f7174a11f26beb75c950695715" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715.part --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:17:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715.part --force-share --output=json" returned: 0 in 0.167s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:17:30 user nova-compute[74611]: DEBUG nova.virt.images [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] 75d706c4-dc49-433c-a0c9-9698b49025c0 was qcow2, converting to raw {{(pid=74611) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 10:17:30 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 10:17:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715.part /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715.converted {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG nova.network.neutron [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Successfully created port: 9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715.part /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715.converted" returned: 0 in 0.401s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715.converted --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "965225700c29c9f7174a11f26beb75c950695715" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.382s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715 --force-share --output=json" returned: 0 in 0.192s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "965225700c29c9f7174a11f26beb75c950695715" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "965225700c29c9f7174a11f26beb75c950695715" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715 --force-share --output=json" returned: 0 in 0.239s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715,backing_fmt=raw /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG nova.network.neutron [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Successfully updated port: 9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715,backing_fmt=raw /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk 1073741824" returned: 0 in 0.048s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "965225700c29c9f7174a11f26beb75c950695715" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquired lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG nova.network.neutron [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG nova.compute.manager [req-5bdd1f8b-a353-4749-9c92-74054c5e196c req-fe00b430-0ddb-4d2d-8631-45f5d69e6453 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received event network-changed-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG nova.compute.manager [req-5bdd1f8b-a353-4749-9c92-74054c5e196c req-fe00b430-0ddb-4d2d-8631-45f5d69e6453 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Refreshing instance network info cache due to event network-changed-9968045c-515a-4b9e-bc0f-26fd2939af52. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:17:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5bdd1f8b-a353-4749-9c92-74054c5e196c req-fe00b430-0ddb-4d2d-8631-45f5d69e6453 service nova] Acquiring lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.network.neutron [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715 --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Cannot resize image /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Ensure instance console log exists: /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.network.neutron [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updating instance_info_cache with network_info: [{"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Releasing lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.compute.manager [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Instance network_info: |[{"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5bdd1f8b-a353-4749-9c92-74054c5e196c req-fe00b430-0ddb-4d2d-8631-45f5d69e6453 service nova] Acquired lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.network.neutron [req-5bdd1f8b-a353-4749-9c92-74054c5e196c req-fe00b430-0ddb-4d2d-8631-45f5d69e6453 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Refreshing network info cache for port 9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Start _get_guest_xml network_info=[{"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T10:17:27Z,direct_url=<?>,disk_format='qcow2',id=75d706c4-dc49-433c-a0c9-9698b49025c0,min_disk=0,min_ram=0,name='tempest-scenario-img--1267524653',owner='5990cb4516a04312b3ccda9c39a44c4a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T10:17:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '75d706c4-dc49-433c-a0c9-9698b49025c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:17:32 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:17:32 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T10:17:27Z,direct_url=<?>,disk_format='qcow2',id=75d706c4-dc49-433c-a0c9-9698b49025c0,min_disk=0,min_ram=0,name='tempest-scenario-img--1267524653',owner='5990cb4516a04312b3ccda9c39a44c4a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T10:17:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1477867633',display_name='tempest-TestMinimumBasicScenario-server-1477867633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1477867633',id=47,image_ref='75d706c4-dc49-433c-a0c9-9698b49025c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5nMIZWPLyfRZ6I4B5+O58yjXxD0mjHO8WLKz3yVOm2GADt8bWYSrdShbjqWDz7AqIksVLxatoNCRqtuhShuXcR9yzoh8aZxzmJsJtl/HxOR4jzm8G0gDArifdAQeH9bQ==',key_name='tempest-TestMinimumBasicScenario-131080672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5990cb4516a04312b3ccda9c39a44c4a',ramdisk_id='',reservation_id='r-tnevof5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='75d706c4-dc49-433c-a0c9-9698b49025c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-163886892',owner_user_name='tempest-TestMinimumBasicScenario-163886892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:17:30Z,user_data=None,user_id='35bc3ea05d5b4f9a85ba453446b2bee9',uuid=9a5efe38-ddcc-4326-b965-6c73e99fd4c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converting VIF {"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a8:e5,bridge_name='br-int',has_traffic_filtering=True,id=9968045c-515a-4b9e-bc0f-26fd2939af52,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9968045c-51') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.objects.instance [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:17:32 user nova-compute[74611]:   <uuid>9a5efe38-ddcc-4326-b965-6c73e99fd4c6</uuid>
Nov 13 10:17:32 user nova-compute[74611]:   <name>instance-0000002f</name>
Nov 13 10:17:32 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:17:32 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:17:32 user nova-compute[74611]:   <metadata>
Nov 13 10:17:32 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:17:32 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:17:32 user nova-compute[74611]:       <nova:name>tempest-TestMinimumBasicScenario-server-1477867633</nova:name>
Nov 13 10:17:32 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:17:32</nova:creationTime>
Nov 13 10:17:32 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:17:32 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:17:32 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:17:32 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:17:32 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:17:32 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:17:32 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:17:32 user nova-compute[74611]:       <nova:owner>
Nov 13 10:17:32 user nova-compute[74611]:         <nova:user uuid="35bc3ea05d5b4f9a85ba453446b2bee9">tempest-TestMinimumBasicScenario-163886892-project-member</nova:user>
Nov 13 10:17:32 user nova-compute[74611]:         <nova:project uuid="5990cb4516a04312b3ccda9c39a44c4a">tempest-TestMinimumBasicScenario-163886892</nova:project>
Nov 13 10:17:32 user nova-compute[74611]:       </nova:owner>
Nov 13 10:17:32 user nova-compute[74611]:       <nova:root type="image" uuid="75d706c4-dc49-433c-a0c9-9698b49025c0"/>
Nov 13 10:17:32 user nova-compute[74611]:       <nova:ports>
Nov 13 10:17:32 user nova-compute[74611]:         <nova:port uuid="9968045c-515a-4b9e-bc0f-26fd2939af52">
Nov 13 10:17:32 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 10:17:32 user nova-compute[74611]:         </nova:port>
Nov 13 10:17:32 user nova-compute[74611]:       </nova:ports>
Nov 13 10:17:32 user nova-compute[74611]:     </nova:instance>
Nov 13 10:17:32 user nova-compute[74611]:   </metadata>
Nov 13 10:17:32 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:17:32 user nova-compute[74611]:     <system>
Nov 13 10:17:32 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:17:32 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:17:32 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:17:32 user nova-compute[74611]:       <entry name="serial">9a5efe38-ddcc-4326-b965-6c73e99fd4c6</entry>
Nov 13 10:17:32 user nova-compute[74611]:       <entry name="uuid">9a5efe38-ddcc-4326-b965-6c73e99fd4c6</entry>
Nov 13 10:17:32 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:17:32 user nova-compute[74611]:     </system>
Nov 13 10:17:32 user nova-compute[74611]:   </sysinfo>
Nov 13 10:17:32 user nova-compute[74611]:   <os>
Nov 13 10:17:32 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:17:32 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:17:32 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:17:32 user nova-compute[74611]:   </os>
Nov 13 10:17:32 user nova-compute[74611]:   <features>
Nov 13 10:17:32 user nova-compute[74611]:     <acpi/>
Nov 13 10:17:32 user nova-compute[74611]:     <apic/>
Nov 13 10:17:32 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:17:32 user nova-compute[74611]:   </features>
Nov 13 10:17:32 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:17:32 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:17:32 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:17:32 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:17:32 user nova-compute[74611]:   </clock>
Nov 13 10:17:32 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:17:32 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:17:32 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:17:32 user nova-compute[74611]:   </cpu>
Nov 13 10:17:32 user nova-compute[74611]:   <devices>
Nov 13 10:17:32 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:17:32 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:17:32 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk"/>
Nov 13 10:17:32 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:17:32 user nova-compute[74611]:     </disk>
Nov 13 10:17:32 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:17:32 user nova-compute[74611]:       <mac address="fa:16:3e:8d:a8:e5"/>
Nov 13 10:17:32 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:17:32 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:17:32 user nova-compute[74611]:       <target dev="tap9968045c-51"/>
Nov 13 10:17:32 user nova-compute[74611]:     </interface>
Nov 13 10:17:32 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:17:32 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/console.log" append="off"/>
Nov 13 10:17:32 user nova-compute[74611]:     </serial>
Nov 13 10:17:32 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:17:32 user nova-compute[74611]:     <video>
Nov 13 10:17:32 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:17:32 user nova-compute[74611]:     </video>
Nov 13 10:17:32 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:17:32 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:17:32 user nova-compute[74611]:     </rng>
Nov 13 10:17:32 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:17:32 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:17:32 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:17:32 user nova-compute[74611]:     </memballoon>
Nov 13 10:17:32 user nova-compute[74611]:   </devices>
Nov 13 10:17:32 user nova-compute[74611]: </domain>
Nov 13 10:17:32 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1477867633',display_name='tempest-TestMinimumBasicScenario-server-1477867633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1477867633',id=47,image_ref='75d706c4-dc49-433c-a0c9-9698b49025c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5nMIZWPLyfRZ6I4B5+O58yjXxD0mjHO8WLKz3yVOm2GADt8bWYSrdShbjqWDz7AqIksVLxatoNCRqtuhShuXcR9yzoh8aZxzmJsJtl/HxOR4jzm8G0gDArifdAQeH9bQ==',key_name='tempest-TestMinimumBasicScenario-131080672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5990cb4516a04312b3ccda9c39a44c4a',ramdisk_id='',reservation_id='r-tnevof5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='75d706c4-dc49-433c-a0c9-9698b49025c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-163886892',owner_user_name='tempest-TestMinimumBasicScenario-163886892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:17:30Z,user_data=None,user_id='35bc3ea05d5b4f9a85ba453446b2bee9',uuid=9a5efe38-ddcc-4326-b965-6c73e99fd4c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converting VIF {"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a8:e5,bridge_name='br-int',has_traffic_filtering=True,id=9968045c-515a-4b9e-bc0f-26fd2939af52,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9968045c-51') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG os_vif [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a8:e5,bridge_name='br-int',has_traffic_filtering=True,id=9968045c-515a-4b9e-bc0f-26fd2939af52,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9968045c-51') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e2d8db5-202d-5140-b3a2-287302915968', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9968045c-51, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9968045c-51, col_values=(('qos', UUID('0517ee91-30a3-48cb-b90d-c2c3801767b7')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9968045c-51, col_values=(('external_ids', {'iface-id': '9968045c-515a-4b9e-bc0f-26fd2939af52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:a8:e5', 'vm-uuid': '9a5efe38-ddcc-4326-b965-6c73e99fd4c6'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:32 user nova-compute[74611]: INFO os_vif [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a8:e5,bridge_name='br-int',has_traffic_filtering=True,id=9968045c-515a-4b9e-bc0f-26fd2939af52,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9968045c-51')
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] No VIF found with MAC fa:16:3e:8d:a8:e5, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.network.neutron [req-5bdd1f8b-a353-4749-9c92-74054c5e196c req-fe00b430-0ddb-4d2d-8631-45f5d69e6453 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updated VIF entry in instance network info cache for port 9968045c-515a-4b9e-bc0f-26fd2939af52. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG nova.network.neutron [req-5bdd1f8b-a353-4749-9c92-74054c5e196c req-fe00b430-0ddb-4d2d-8631-45f5d69e6453 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updating instance_info_cache with network_info: [{"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:17:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5bdd1f8b-a353-4749-9c92-74054c5e196c req-fe00b430-0ddb-4d2d-8631-45f5d69e6453 service nova] Releasing lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:17:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-bf0d3c66-64a9-4c90-870d-38df861a8e41 req-ab388d58-81fc-4d6d-82a1-57a674f59ce9 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received event network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:17:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bf0d3c66-64a9-4c90-870d-38df861a8e41 req-ab388d58-81fc-4d6d-82a1-57a674f59ce9 service nova] Acquiring lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bf0d3c66-64a9-4c90-870d-38df861a8e41 req-ab388d58-81fc-4d6d-82a1-57a674f59ce9 service nova] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bf0d3c66-64a9-4c90-870d-38df861a8e41 req-ab388d58-81fc-4d6d-82a1-57a674f59ce9 service nova] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-bf0d3c66-64a9-4c90-870d-38df861a8e41 req-ab388d58-81fc-4d6d-82a1-57a674f59ce9 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] No waiting events found dispatching network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:17:33 user nova-compute[74611]: WARNING nova.compute.manager [req-bf0d3c66-64a9-4c90-870d-38df861a8e41 req-ab388d58-81fc-4d6d-82a1-57a674f59ce9 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received unexpected event network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 for instance with vm_state building and task_state spawning.
Nov 13 10:17:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "822a3afe-eae1-4960-b347-89c58fb10c4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "822a3afe-eae1-4960-b347-89c58fb10c4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:35 user nova-compute[74611]: INFO nova.compute.manager [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Terminating instance
Nov 13 10:17:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-0e28bb1f-c17a-4f5e-9c92-7aa9a7d94295 req-f70b2059-f621-4ef7-81af-836a98ae6474 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Received event network-vif-unplugged-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0e28bb1f-c17a-4f5e-9c92-7aa9a7d94295 req-f70b2059-f621-4ef7-81af-836a98ae6474 service nova] Acquiring lock "822a3afe-eae1-4960-b347-89c58fb10c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0e28bb1f-c17a-4f5e-9c92-7aa9a7d94295 req-f70b2059-f621-4ef7-81af-836a98ae6474 service nova] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-0e28bb1f-c17a-4f5e-9c92-7aa9a7d94295 req-f70b2059-f621-4ef7-81af-836a98ae6474 service nova] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-0e28bb1f-c17a-4f5e-9c92-7aa9a7d94295 req-f70b2059-f621-4ef7-81af-836a98ae6474 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] No waiting events found dispatching network-vif-unplugged-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-0e28bb1f-c17a-4f5e-9c92-7aa9a7d94295 req-f70b2059-f621-4ef7-81af-836a98ae6474 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Received event network-vif-unplugged-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:17:35 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Instance spawned successfully.
Nov 13 10:17:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-a1c74d44-3d77-4189-b984-bce4f93b7653 req-90661fce-1805-42ce-99a3-f56e0a46fcf1 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received event network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a1c74d44-3d77-4189-b984-bce4f93b7653 req-90661fce-1805-42ce-99a3-f56e0a46fcf1 service nova] Acquiring lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a1c74d44-3d77-4189-b984-bce4f93b7653 req-90661fce-1805-42ce-99a3-f56e0a46fcf1 service nova] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a1c74d44-3d77-4189-b984-bce4f93b7653 req-90661fce-1805-42ce-99a3-f56e0a46fcf1 service nova] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-a1c74d44-3d77-4189-b984-bce4f93b7653 req-90661fce-1805-42ce-99a3-f56e0a46fcf1 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] No waiting events found dispatching network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:17:35 user nova-compute[74611]: WARNING nova.compute.manager [req-a1c74d44-3d77-4189-b984-bce4f93b7653 req-90661fce-1805-42ce-99a3-f56e0a46fcf1 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received unexpected event network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 for instance with vm_state building and task_state spawning.
Nov 13 10:17:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:17:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:17:36 user nova-compute[74611]: INFO nova.compute.manager [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 13 10:17:36 user nova-compute[74611]: DEBUG nova.compute.manager [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:17:36 user nova-compute[74611]: INFO nova.compute.manager [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Took 6.56 seconds to build instance.
Nov 13 10:17:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cbb0edca-e9d8-4039-82c7-a2634669c34e tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.673s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:36 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Instance destroyed successfully.
Nov 13 10:17:36 user nova-compute[74611]: DEBUG nova.objects.instance [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lazy-loading 'resources' on Instance uuid 822a3afe-eae1-4960-b347-89c58fb10c4c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:17:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T09:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-395312671',display_name='tempest-ServerActionsTestOtherA-server-395312671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-395312671',id=22,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyvkPZ/C5Pk5XOFxP5rMcYJVq0nGL8MEwZ1COcFqCFBcO7G74gr+o/bZOILVW3PDzyd5NY9xtWs0kgCNTm8xNQIJrW9d3YRiHEICGlxrvJ1iCAAc7YEKxcFMW7SpPA0Dw==',key_name='tempest-keypair-2093749558',keypairs=<?>,launch_index=0,launched_at=2023-11-13T09:58:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6a0b0a078bd44908cd7cd4593914eef',ramdisk_id='',reservation_id='r-uxg6tzfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2135577355',owner_user_name='tempest-ServerActionsTestOtherA-2135577355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T09:58:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22322be2dd04410b6cd53c31e639b3b',uuid=822a3afe-eae1-4960-b347-89c58fb10c4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "address": "fa:16:3e:b7:e1:19", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ef27e1-e7", "ovs_interfaceid": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:17:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converting VIF {"id": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "address": "fa:16:3e:b7:e1:19", "network": {"id": "5804d5d6-9069-4445-b84a-14ee4efdc8d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-21995796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0b0a078bd44908cd7cd4593914eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ef27e1-e7", "ovs_interfaceid": "a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:17:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:e1:19,bridge_name='br-int',has_traffic_filtering=True,id=a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ef27e1-e7') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:17:36 user nova-compute[74611]: DEBUG os_vif [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:e1:19,bridge_name='br-int',has_traffic_filtering=True,id=a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ef27e1-e7') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:17:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1ef27e1-e7, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:17:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:17:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e38a3fa-cb6a-4589-8cf5-a5dfb371125c) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:17:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:17:36 user nova-compute[74611]: INFO os_vif [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:e1:19,bridge_name='br-int',has_traffic_filtering=True,id=a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0,network=Network(5804d5d6-9069-4445-b84a-14ee4efdc8d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ef27e1-e7')
Nov 13 10:17:36 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Deleting instance files /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c_del
Nov 13 10:17:36 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Deletion of /opt/stack/data/nova/instances/822a3afe-eae1-4960-b347-89c58fb10c4c_del complete
Nov 13 10:17:36 user nova-compute[74611]: INFO nova.compute.manager [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 10:17:36 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:17:36 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:17:36 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:17:37 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:17:37 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Took 0.61 seconds to deallocate network for instance.
Nov 13 10:17:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:37 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:17:37 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:17:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:37 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Deleted allocations for instance 822a3afe-eae1-4960-b347-89c58fb10c4c
Nov 13 10:17:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-84147140-3ac1-4e82-9efe-0bee8fdad61d tempest-ServerActionsTestOtherA-2135577355 tempest-ServerActionsTestOtherA-2135577355-project-member] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.801s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-d46ea648-2e56-4693-bb77-504f8ebcd2a7 req-6780d6e4-ed98-4914-b33b-71b1961b3bf7 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Received event network-vif-plugged-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:17:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d46ea648-2e56-4693-bb77-504f8ebcd2a7 req-6780d6e4-ed98-4914-b33b-71b1961b3bf7 service nova] Acquiring lock "822a3afe-eae1-4960-b347-89c58fb10c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d46ea648-2e56-4693-bb77-504f8ebcd2a7 req-6780d6e4-ed98-4914-b33b-71b1961b3bf7 service nova] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d46ea648-2e56-4693-bb77-504f8ebcd2a7 req-6780d6e4-ed98-4914-b33b-71b1961b3bf7 service nova] Lock "822a3afe-eae1-4960-b347-89c58fb10c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-d46ea648-2e56-4693-bb77-504f8ebcd2a7 req-6780d6e4-ed98-4914-b33b-71b1961b3bf7 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] No waiting events found dispatching network-vif-plugged-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:17:37 user nova-compute[74611]: WARNING nova.compute.manager [req-d46ea648-2e56-4693-bb77-504f8ebcd2a7 req-6780d6e4-ed98-4914-b33b-71b1961b3bf7 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Received unexpected event network-vif-plugged-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 for instance with vm_state deleted and task_state None.
Nov 13 10:17:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-d46ea648-2e56-4693-bb77-504f8ebcd2a7 req-6780d6e4-ed98-4914-b33b-71b1961b3bf7 service nova] [instance: 822a3afe-eae1-4960-b347-89c58fb10c4c] Received event network-vif-deleted-a1ef27e1-e79c-4598-b3fd-6fa72ccbbbb0 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:17:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:17:48 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:17:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:17:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:17:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:17:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:17:48 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:17:48 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid 770d57de-444b-42d1-824b-85e881fe76dd {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:17:48 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updating instance_info_cache with network_info: [{"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:17:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:17:48 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:17:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:17:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:17:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:17:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:17:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:52 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:17:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:17:53 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:17:54 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:17:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:57 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:17:58 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:17:59 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:17:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:17:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:17:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:17:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:17:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:17:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:17:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:17:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:17:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:17:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:17:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:17:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:18:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:18:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8704MB free_disk=25.20410919189453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:18:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:18:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:18:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 770d57de-444b-42d1-824b-85e881fe76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:18:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:18:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:18:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:18:00 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:18:00 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:18:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:18:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:18:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:02 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:18:03 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:18:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "770d57de-444b-42d1-824b-85e881fe76dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG nova.objects.instance [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lazy-loading 'flavor' on Instance uuid 770d57de-444b-42d1-824b-85e881fe76dd {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "770d57de-444b-42d1-824b-85e881fe76dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "770d57de-444b-42d1-824b-85e881fe76dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:18:06 user nova-compute[74611]: INFO nova.compute.manager [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Attaching volume c8bd83ac-27b0-474e-9332-1865dc671386 to /dev/vdb
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG os_brick.utils [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82b3f4a-cd59-42e6-8e5d-807f783bb081]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9a1804-cef3-47b0-acdf-2ccae2dd39db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a349d788-ecf4-4c53-9867-392023d2fdcf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e74d69-025d-49dc-9004-557d3479618e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:18:06 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:18:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d07b44e-e04e-4a8b-a9dd-8ff0a82c2a11]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG os_brick.utils [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:18:06 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updating existing volume attachment record: ae6d7313-064b-4ed3-b583-8ff9aae0beac {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:18:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhPwEkam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:18:10 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:18:10 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:18:10 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e56dad-58bf-40b5-9df9-6cee1a82517a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:18:10 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d36b7cb-c952-4219-99bf-5bbe46fac7ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386] added
Nov 13 10:18:10 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac5cc7c-9fdd-455a-ae8c-faed49d7513f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc2d9b5-abb0-4cfd-9e58-c865a6be34e0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhPwEkam {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhPwEkam" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b90e14-c31a-4490-9d23-24dae652f936]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xhPwEkam'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebd6483-78ec-4150-8ed9-b2d8e55c84a7]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2deb20-b897-48c6-8d5b-9ed674d693da]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 10:18:10 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 10:18:10 user nova-compute[74611]:  {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:18:10 user nova-compute[74611]: WARNING os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 10:18:10 user nova-compute[74611]: 
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c412abbf-1266-478e-b65d-d23af1bbd6ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386, portal: 172.16.0.220,3260]
Nov 13 10:18:10 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386, portal: 172.16.0.220,3260] successful.
Nov 13 10:18:10 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bbeb56-23b5-4b0e-8b71-19bc6feedd62]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f883c112-5f5e-479a-a1b6-f26bf5b50876]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 (non-flash)
Nov 13 10:18:10 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 (non-flash)
Nov 13 10:18:10 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[93eb2d2d-56fc-4795-8943-4f664b81fc68]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:18:10 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhPwEkam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:18:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:18:11 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23736616465383337', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:18:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736616465383337', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:18:11 user nova-compute[74611]: DEBUG nova.objects.instance [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lazy-loading 'flavor' on Instance uuid 770d57de-444b-42d1-824b-85e881fe76dd {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:18:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:18:11 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:18:11 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:18:11 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:18:11 user nova-compute[74611]:   <serial>c8bd83ac-27b0-474e-9332-1865dc671386</serial>
Nov 13 10:18:11 user nova-compute[74611]: </disk>
Nov 13 10:18:11 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:18:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:18:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:18:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] No VIF found with MAC fa:16:3e:7f:45:a6, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:18:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-73cbe090-3a1a-4c29-858a-e01a0376c3fe tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "770d57de-444b-42d1-824b-85e881fe76dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.059s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:18:13 user nova-compute[74611]: INFO nova.compute.manager [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Rescuing
Nov 13 10:18:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:18:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquired lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:18:13 user nova-compute[74611]: DEBUG nova.network.neutron [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:18:13 user nova-compute[74611]: DEBUG nova.network.neutron [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updating instance_info_cache with network_info: [{"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:18:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Releasing lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:18:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:13 user nova-compute[74611]: DEBUG nova.compute.manager [req-3ef6fae5-2105-4453-a03c-9ab87181cf69 req-90498d31-5c95-4c9a-bf21-e6b2e5642a38 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-vif-unplugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:18:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3ef6fae5-2105-4453-a03c-9ab87181cf69 req-90498d31-5c95-4c9a-bf21-e6b2e5642a38 service nova] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:18:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3ef6fae5-2105-4453-a03c-9ab87181cf69 req-90498d31-5c95-4c9a-bf21-e6b2e5642a38 service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:18:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3ef6fae5-2105-4453-a03c-9ab87181cf69 req-90498d31-5c95-4c9a-bf21-e6b2e5642a38 service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:18:13 user nova-compute[74611]: DEBUG nova.compute.manager [req-3ef6fae5-2105-4453-a03c-9ab87181cf69 req-90498d31-5c95-4c9a-bf21-e6b2e5642a38 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] No waiting events found dispatching network-vif-unplugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:18:13 user nova-compute[74611]: WARNING nova.compute.manager [req-3ef6fae5-2105-4453-a03c-9ab87181cf69 req-90498d31-5c95-4c9a-bf21-e6b2e5642a38 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received unexpected event network-vif-unplugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 for instance with vm_state active and task_state rescuing.
Nov 13 10:18:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:14 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Instance destroyed successfully.
Nov 13 10:18:14 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Attempting a stable device rescue
Nov 13 10:18:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74611) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 10:18:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Instance directory exists: not creating {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 10:18:14 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Creating image(s)
Nov 13 10:18:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "/opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:18:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "/opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:18:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "/opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:18:14 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lazy-loading 'trusted_certs' on Instance uuid 770d57de-444b-42d1-824b-85e881fe76dd {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:18:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "4c1aa6280fe61b48abd448d077f18851b81c355d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:18:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "4c1aa6280fe61b48abd448d077f18851b81c355d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:18:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c1aa6280fe61b48abd448d077f18851b81c355d.part --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c1aa6280fe61b48abd448d077f18851b81c355d.part --force-share --output=json" returned: 0 in 0.187s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:15 user nova-compute[74611]: DEBUG nova.virt.images [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] dde41382-0bdf-4b00-a73d-62898952378b was qcow2, converting to raw {{(pid=74611) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 10:18:15 user nova-compute[74611]: DEBUG nova.privsep.utils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74611) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 10:18:15 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4c1aa6280fe61b48abd448d077f18851b81c355d.part /opt/stack/data/nova/instances/_base/4c1aa6280fe61b48abd448d077f18851b81c355d.converted {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:15 user nova-compute[74611]: DEBUG nova.compute.manager [req-04cb5e39-be06-408f-bdbd-64bcfc1181ed req-7262007e-d5a9-452d-a3f9-ca2a470f4cdc service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:18:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-04cb5e39-be06-408f-bdbd-64bcfc1181ed req-7262007e-d5a9-452d-a3f9-ca2a470f4cdc service nova] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:18:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-04cb5e39-be06-408f-bdbd-64bcfc1181ed req-7262007e-d5a9-452d-a3f9-ca2a470f4cdc service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:18:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-04cb5e39-be06-408f-bdbd-64bcfc1181ed req-7262007e-d5a9-452d-a3f9-ca2a470f4cdc service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:18:15 user nova-compute[74611]: DEBUG nova.compute.manager [req-04cb5e39-be06-408f-bdbd-64bcfc1181ed req-7262007e-d5a9-452d-a3f9-ca2a470f4cdc service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] No waiting events found dispatching network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:18:15 user nova-compute[74611]: WARNING nova.compute.manager [req-04cb5e39-be06-408f-bdbd-64bcfc1181ed req-7262007e-d5a9-452d-a3f9-ca2a470f4cdc service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received unexpected event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 for instance with vm_state active and task_state rescuing.
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4c1aa6280fe61b48abd448d077f18851b81c355d.part /opt/stack/data/nova/instances/_base/4c1aa6280fe61b48abd448d077f18851b81c355d.converted" returned: 0 in 0.468s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c1aa6280fe61b48abd448d077f18851b81c355d.converted --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c1aa6280fe61b48abd448d077f18851b81c355d.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "4c1aa6280fe61b48abd448d077f18851b81c355d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.039s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "4c1aa6280fe61b48abd448d077f18851b81c355d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "4c1aa6280fe61b48abd448d077f18851b81c355d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c1aa6280fe61b48abd448d077f18851b81c355d --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c1aa6280fe61b48abd448d077f18851b81c355d --force-share --output=json" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4c1aa6280fe61b48abd448d077f18851b81c355d,backing_fmt=raw /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.rescue {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4c1aa6280fe61b48abd448d077f18851b81c355d,backing_fmt=raw /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.rescue" returned: 0 in 0.056s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "4c1aa6280fe61b48abd448d077f18851b81c355d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lazy-loading 'migration_context' on Instance uuid 770d57de-444b-42d1-824b-85e881fe76dd {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.objects.base [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Object Instance<770d57de-444b-42d1-824b-85e881fe76dd> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Start _get_guest_xml network_info=[{"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "vif_mac": "fa:16:3e:7f:45:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dde41382-0bdf-4b00-a73d-62898952378b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'ae6d7313-064b-4ed3-b583-8ff9aae0beac', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhPwEkam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '770d57de-444b-42d1-824b-85e881fe76dd', 'attached_at': '', 'detached_at': '', 'volume_id': 'c8bd83ac-27b0-474e-9332-1865dc671386', 'serial': 'c8bd83ac-27b0-474e-9332-1865dc671386'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lazy-loading 'resources' on Instance uuid 770d57de-444b-42d1-824b-85e881fe76dd {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.objects.base [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Object Instance<770d57de-444b-42d1-824b-85e881fe76dd> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lazy-loading 'numa_topology' on Instance uuid 770d57de-444b-42d1-824b-85e881fe76dd {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.objects.base [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Object Instance<770d57de-444b-42d1-824b-85e881fe76dd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:18:16 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:18:16 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lazy-loading 'vcpu_model' on Instance uuid 770d57de-444b-42d1-824b-85e881fe76dd {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.objects.base [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Object Instance<770d57de-444b-42d1-824b-85e881fe76dd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhPwEkam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:18:16 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:18:16 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:18:16 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[615d9ffd-3eac-4d3d-8d54-a98d8890d943]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xhPwEkam\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 13 10:18:16 user nova-compute[74611]: node.name = iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386
Nov 13 10:18:16 user nova-compute[74611]: node.tpgt = -1
Nov 13 10:18:16 user nova-compute[74611]: node.startup = automatic
Nov 13 10:18:16 user nova-compute[74611]: node.leading_login = No
Nov 13 10:18:16 user nova-compute[74611]: iface.iscsi_ifacename = default
Nov 13 10:18:16 user nova-compute[74611]: iface.net_ifacename = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.ipaddress = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.prefix_len = 0
Nov 13 10:18:16 user nova-compute[74611]: iface.hwaddress = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.transport_name = tcp
Nov 13 10:18:16 user nova-compute[74611]: iface.initiatorname = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.state = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.vlan_id = 0
Nov 13 10:18:16 user nova-compute[74611]: iface.vlan_priority = 0
Nov 13 10:18:16 user nova-compute[74611]: iface.vlan_state = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.iface_num = 0
Nov 13 10:18:16 user nova-compute[74611]: iface.mtu = 0
Nov 13 10:18:16 user nova-compute[74611]: iface.port = 0
Nov 13 10:18:16 user nova-compute[74611]: iface.bootproto = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.subnet_mask = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.gateway = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.dhcp_alt_client_id_state = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.dhcp_alt_client_id = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.dhcp_dns = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.dhcp_learn_iqn = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.dhcp_req_vendor_id_state = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.dhcp_vendor_id_state = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.dhcp_vendor_id = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.dhcp_slp_da = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.fragmentation = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.gratuitous_arp = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.incoming_forwarding = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.tos_state = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.tos = 0
Nov 13 10:18:16 user nova-compute[74611]: iface.ttl = 0
Nov 13 10:18:16 user nova-compute[74611]: iface.delayed_ack = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.tcp_nagle = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.tcp_wsf_state = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.tcp_wsf = 0
Nov 13 10:18:16 user nova-compute[74611]: iface.tcp_timer_scale = 0
Nov 13 10:18:16 user nova-compute[74611]: iface.tcp_timestamp = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.redirect = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.def_task_mgmt_timeout = 0
Nov 13 10:18:16 user nova-compute[74611]: iface.header_digest = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.data_digest = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.immediate_data = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.initial_r2t = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.data_seq_inorder = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.data_pdu_inorder = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.erl = 0
Nov 13 10:18:16 user nova-compute[74611]: iface.max_receive_data_len = 0
Nov 13 10:18:16 user nova-compute[74611]: iface.first_burst_len = 0
Nov 13 10:18:16 user nova-compute[74611]: iface.max_outstanding_r2t = 0
Nov 13 10:18:16 user nova-compute[74611]: iface.max_burst_len = 0
Nov 13 10:18:16 user nova-compute[74611]: iface.chap_auth = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.bidi_chap = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.strict_login_compliance = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.discovery_auth = <empty>
Nov 13 10:18:16 user nova-compute[74611]: iface.discovery_logout = <empty>
Nov 13 10:18:16 user nova-compute[74611]: node.discovery_address = <empty>
Nov 13 10:18:16 user nova-compute[74611]: node.discovery_port = 0
Nov 13 10:18:16 user nova-compute[74611]: node.discovery_type = static
Nov 13 10:18:16 user nova-compute[74611]: node.session.initial_cmdsn = 0
Nov 13 10:18:16 user nova-compute[74611]: node.session.initial_login_retry_max = 8
Nov 13 10:18:16 user nova-compute[74611]: node.session.xmit_thread_priority = -20
Nov 13 10:18:16 user nova-compute[74611]: node.session.cmds_max = 128
Nov 13 10:18:16 user nova-compute[74611]: node.session.queue_depth = 32
Nov 13 10:18:16 user nova-compute[74611]: node.session.nr_sessions = 1
Nov 13 10:18:16 user nova-compute[74611]: node.session.auth.authmethod = CHAP
Nov 13 10:18:16 user nova-compute[74611]: node.session.auth.username = xhPwEkam
Nov 13 10:18:16 user nova-compute[74611]: node.session.auth.password = ***
Nov 13 10:18:16 user nova-compute[74611]: node.session.auth.username_in = <empty>
Nov 13 10:18:16 user nova-compute[74611]: node.session.auth.password_in = <empty>
Nov 13 10:18:16 user nova-compute[74611]: node.session.auth.chap_algs = MD5
Nov 13 10:18:16 user nova-compute[74611]: node.session.timeo.replacement_timeout = 120
Nov 13 10:18:16 user nova-compute[74611]: node.session.err_timeo.abort_timeout = 15
Nov 13 10:18:16 user nova-compute[74611]: node.session.err_timeo.lu_reset_timeout = 30
Nov 13 10:18:16 user nova-compute[74611]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 13 10:18:16 user nova-compute[74611]: node.session.err_timeo.host_reset_timeout = 60
Nov 13 10:18:16 user nova-compute[74611]: node.session.iscsi.FastAbort = Yes
Nov 13 10:18:16 user nova-compute[74611]: node.session.iscsi.InitialR2T = No
Nov 13 10:18:16 user nova-compute[74611]: node.session.iscsi.ImmediateData = Yes
Nov 13 10:18:16 user nova-compute[74611]: node.session.iscsi.FirstBurstLength = 262144
Nov 13 10:18:16 user nova-compute[74611]: node.session.iscsi.MaxBurstLength = 16776192
Nov 13 10:18:16 user nova-compute[74611]: node.session.iscsi.DefaultTime2Retain = 0
Nov 13 10:18:16 user nova-compute[74611]: node.session.iscsi.DefaultTime2Wait = 2
Nov 13 10:18:16 user nova-compute[74611]: node.session.iscsi.MaxConnections = 1
Nov 13 10:18:16 user nova-compute[74611]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 13 10:18:16 user nova-compute[74611]: node.session.iscsi.ERL = 0
Nov 13 10:18:16 user nova-compute[74611]: node.session.scan = manual
Nov 13 10:18:16 user nova-compute[74611]: node.session.reopen_max = 0
Nov 13 10:18:16 user nova-compute[74611]: node.conn[0].address = 172.16.0.220
Nov 13 10:18:16 user nova-compute[74611]: node.conn[0].port = 3260
Nov 13 10:18:16 user nova-compute[74611]: node.conn[0].startup = manual
Nov 13 10:18:16 user nova-compute[74611]: node.conn[0].tcp.window_size = 524288
Nov 13 10:18:16 user nova-compute[74611]: node.conn[0].tcp.type_of_service = 0
Nov 13 10:18:16 user nova-compute[74611]: node.conn[0].timeo.logout_timeout = 15
Nov 13 10:18:16 user nova-compute[74611]: node.conn[0].timeo.login_timeout = 15
Nov 13 10:18:16 user nova-compute[74611]: node.conn[0].timeo.auth_timeout = 45
Nov 13 10:18:16 user nova-compute[74611]: node.conn[0].timeo.noop_out_interval = 5
Nov 13 10:18:16 user nova-compute[74611]: node.conn[0].timeo.noop_out_timeout = 5
Nov 13 10:18:16 user nova-compute[74611]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 13 10:18:16 user nova-compute[74611]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 13 10:18:16 user nova-compute[74611]: node.conn[0].iscsi.HeaderDigest = None
Nov 13 10:18:16 user nova-compute[74611]: node.conn[0].iscsi.DataDigest = None
Nov 13 10:18:16 user nova-compute[74611]: node.conn[0].iscsi.IFMarker = No
Nov 13 10:18:16 user nova-compute[74611]: node.conn[0].iscsi.OFMarker = No
Nov 13 10:18:16 user nova-compute[74611]: # END RECORD
Nov 13 10:18:16 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90a6e43-394a-49aa-89f8-f7bd2ab7e347]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ee9f07-9eb3-4f7a-9093-b52ef6526b34]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhPwEkam {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhPwEkam" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87850da-63d3-420a-b3fa-a384347c8927]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xhPwEkam'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[defeefd1-45d8-4da7-8b5c-6a1a4db877fd]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bcf0b1-7407-4276-b729-03431603de23]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dd7b06-c956-4397-af6b-613c32a9b0e7 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 (non-flash)
Nov 13 10:18:16 user nova-compute[74611]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dd7b06-c956-4397-af6b-613c32a9b0e7 (non-flash)
Nov 13 10:18:16 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 (non-flash)
Nov 13 10:18:16 user nova-compute[74611]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dd7b06-c956-4397-af6b-613c32a9b0e7 (non-flash)
Nov 13 10:18:16 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.138s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] HCTL ('33', '0', '0', 0) found on session 55 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.012s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[98810e6e-92f6-4001-a1a0-0c5d06176cb6]: (4, ('0 0 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Searching for a device in session 55 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhPwEkam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.159s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] <== connect_volume: return (160ms) {'type': 'block', 'scsi_wwn': '23736616465383337', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736616465383337', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1693136491',display_name='tempest-ServerStableDeviceRescueTest-server-1693136491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1693136491',id=45,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxx5CqNADL2t5RNQuLp8M/DypFH1AecFisERGdt7rpr81WdBBxeANwcGv/OvZt5GFrbAkWwQpH9EmJNr3Nou07IZ02A/lxpyNtIglcJGILVDfJMeKuRnbD27Oo2AmLnBg==',key_name='tempest-keypair-2131338815',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:14:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9dc437b4d074101a113b7bca634ed0e',ramdisk_id='',reservation_id='r-pekagm9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1937011099',owner_user_name='tempest-ServerStableDeviceRescueTest-1937011099-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f6b2b1ceae486a9be5af84dc08de7c',uuid=770d57de-444b-42d1-824b-85e881fe76dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "vif_mac": "fa:16:3e:7f:45:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Converting VIF {"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "vif_mac": "fa:16:3e:7f:45:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:45:a6,bridge_name='br-int',has_traffic_filtering=True,id=a3a02b77-480a-4ffe-a8da-f0bda6e70f57,network=Network(72f44b48-dbe8-4430-93ac-6b4c67c195ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3a02b77-48') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.objects.instance [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lazy-loading 'pci_devices' on Instance uuid 770d57de-444b-42d1-824b-85e881fe76dd {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.objects.base [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Object Instance<770d57de-444b-42d1-824b-85e881fe76dd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:18:16 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:18:16 user nova-compute[74611]:   <uuid>770d57de-444b-42d1-824b-85e881fe76dd</uuid>
Nov 13 10:18:16 user nova-compute[74611]:   <name>instance-0000002d</name>
Nov 13 10:18:16 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:18:16 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:18:16 user nova-compute[74611]:   <metadata>
Nov 13 10:18:16 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:18:16 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:18:16 user nova-compute[74611]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1693136491</nova:name>
Nov 13 10:18:16 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:18:16</nova:creationTime>
Nov 13 10:18:16 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:18:16 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:18:16 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:18:16 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:18:16 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:18:16 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:18:16 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:18:16 user nova-compute[74611]:       <nova:owner>
Nov 13 10:18:16 user nova-compute[74611]:         <nova:user uuid="53f6b2b1ceae486a9be5af84dc08de7c">tempest-ServerStableDeviceRescueTest-1937011099-project-member</nova:user>
Nov 13 10:18:16 user nova-compute[74611]:         <nova:project uuid="a9dc437b4d074101a113b7bca634ed0e">tempest-ServerStableDeviceRescueTest-1937011099</nova:project>
Nov 13 10:18:16 user nova-compute[74611]:       </nova:owner>
Nov 13 10:18:16 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:18:16 user nova-compute[74611]:       <nova:ports>
Nov 13 10:18:16 user nova-compute[74611]:         <nova:port uuid="a3a02b77-480a-4ffe-a8da-f0bda6e70f57">
Nov 13 10:18:16 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 10:18:16 user nova-compute[74611]:         </nova:port>
Nov 13 10:18:16 user nova-compute[74611]:       </nova:ports>
Nov 13 10:18:16 user nova-compute[74611]:     </nova:instance>
Nov 13 10:18:16 user nova-compute[74611]:   </metadata>
Nov 13 10:18:16 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:18:16 user nova-compute[74611]:     <system>
Nov 13 10:18:16 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:18:16 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:18:16 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:18:16 user nova-compute[74611]:       <entry name="serial">770d57de-444b-42d1-824b-85e881fe76dd</entry>
Nov 13 10:18:16 user nova-compute[74611]:       <entry name="uuid">770d57de-444b-42d1-824b-85e881fe76dd</entry>
Nov 13 10:18:16 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:18:16 user nova-compute[74611]:     </system>
Nov 13 10:18:16 user nova-compute[74611]:   </sysinfo>
Nov 13 10:18:16 user nova-compute[74611]:   <os>
Nov 13 10:18:16 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:18:16 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:18:16 user nova-compute[74611]:   </os>
Nov 13 10:18:16 user nova-compute[74611]:   <features>
Nov 13 10:18:16 user nova-compute[74611]:     <acpi/>
Nov 13 10:18:16 user nova-compute[74611]:     <apic/>
Nov 13 10:18:16 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:18:16 user nova-compute[74611]:   </features>
Nov 13 10:18:16 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:18:16 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:18:16 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:18:16 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:18:16 user nova-compute[74611]:   </clock>
Nov 13 10:18:16 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:18:16 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:18:16 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:18:16 user nova-compute[74611]:   </cpu>
Nov 13 10:18:16 user nova-compute[74611]:   <devices>
Nov 13 10:18:16 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:18:16 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:18:16 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk"/>
Nov 13 10:18:16 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:18:16 user nova-compute[74611]:     </disk>
Nov 13 10:18:16 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:18:16 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:18:16 user nova-compute[74611]:       <source dev="/dev/sdb"/>
Nov 13 10:18:16 user nova-compute[74611]:       <target dev="vdb" bus="virtio"/>
Nov 13 10:18:16 user nova-compute[74611]:       <serial>c8bd83ac-27b0-474e-9332-1865dc671386</serial>
Nov 13 10:18:16 user nova-compute[74611]:     </disk>
Nov 13 10:18:16 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:18:16 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:18:16 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.rescue"/>
Nov 13 10:18:16 user nova-compute[74611]:       <target dev="vdc" bus="virtio"/>
Nov 13 10:18:16 user nova-compute[74611]:       <boot order="1"/>
Nov 13 10:18:16 user nova-compute[74611]:     </disk>
Nov 13 10:18:16 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:18:16 user nova-compute[74611]:       <mac address="fa:16:3e:7f:45:a6"/>
Nov 13 10:18:16 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:18:16 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:18:16 user nova-compute[74611]:       <target dev="tapa3a02b77-48"/>
Nov 13 10:18:16 user nova-compute[74611]:     </interface>
Nov 13 10:18:16 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:18:16 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/console.log" append="off"/>
Nov 13 10:18:16 user nova-compute[74611]:     </serial>
Nov 13 10:18:16 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:18:16 user nova-compute[74611]:     <video>
Nov 13 10:18:16 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:18:16 user nova-compute[74611]:     </video>
Nov 13 10:18:16 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:18:16 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:18:16 user nova-compute[74611]:     </rng>
Nov 13 10:18:16 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:18:16 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:18:16 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:18:16 user nova-compute[74611]:     </memballoon>
Nov 13 10:18:16 user nova-compute[74611]:   </devices>
Nov 13 10:18:16 user nova-compute[74611]: </domain>
Nov 13 10:18:16 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:18:16 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Instance destroyed successfully.
Nov 13 10:18:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:18:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:18:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:18:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] No VIF found with MAC fa:16:3e:7f:45:a6, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:18:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:18 user nova-compute[74611]: DEBUG nova.compute.manager [req-20774002-6760-4d89-8962-1abff5829b2d req-d3fbe1a5-4d5a-45af-b708-9ad647256a72 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:18:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-20774002-6760-4d89-8962-1abff5829b2d req-d3fbe1a5-4d5a-45af-b708-9ad647256a72 service nova] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:18:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-20774002-6760-4d89-8962-1abff5829b2d req-d3fbe1a5-4d5a-45af-b708-9ad647256a72 service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:18:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-20774002-6760-4d89-8962-1abff5829b2d req-d3fbe1a5-4d5a-45af-b708-9ad647256a72 service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:18:18 user nova-compute[74611]: DEBUG nova.compute.manager [req-20774002-6760-4d89-8962-1abff5829b2d req-d3fbe1a5-4d5a-45af-b708-9ad647256a72 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] No waiting events found dispatching network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:18:18 user nova-compute[74611]: WARNING nova.compute.manager [req-20774002-6760-4d89-8962-1abff5829b2d req-d3fbe1a5-4d5a-45af-b708-9ad647256a72 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received unexpected event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 for instance with vm_state active and task_state rescuing.
Nov 13 10:18:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:20 user nova-compute[74611]: DEBUG nova.compute.manager [None req-dd059280-c3f2-4c11-bb0a-e57584b98085 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:18:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-8ed00b4b-0037-4ccb-ad62-4f1e1a19bf24 req-5c0c1572-dc02-4d9a-838c-a17433e0ecca service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:18:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8ed00b4b-0037-4ccb-ad62-4f1e1a19bf24 req-5c0c1572-dc02-4d9a-838c-a17433e0ecca service nova] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:18:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8ed00b4b-0037-4ccb-ad62-4f1e1a19bf24 req-5c0c1572-dc02-4d9a-838c-a17433e0ecca service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:18:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8ed00b4b-0037-4ccb-ad62-4f1e1a19bf24 req-5c0c1572-dc02-4d9a-838c-a17433e0ecca service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:18:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-8ed00b4b-0037-4ccb-ad62-4f1e1a19bf24 req-5c0c1572-dc02-4d9a-838c-a17433e0ecca service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] No waiting events found dispatching network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:18:20 user nova-compute[74611]: WARNING nova.compute.manager [req-8ed00b4b-0037-4ccb-ad62-4f1e1a19bf24 req-5c0c1572-dc02-4d9a-838c-a17433e0ecca service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received unexpected event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 for instance with vm_state active and task_state rescuing.
Nov 13 10:18:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:18:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:18:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:18:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:18:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:49 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:18:49 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:18:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:18:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:18:49 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:18:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:49 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updating instance_info_cache with network_info: [{"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:18:49 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:18:49 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:18:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:53 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:18:53 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:18:54 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:18:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:56 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:18:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:57 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:18:59 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:18:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:18:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:18:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:18:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:18:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:18:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:18:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:18:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:19:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:19:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:19:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8725MB free_disk=25.08002471923828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:19:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 770d57de-444b-42d1-824b-85e881fe76dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:19:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:19:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:19:00 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:19:01 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:19:01 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:19:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:19:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:05 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:19:05 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:19:06 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:19:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:06 user nova-compute[74611]: DEBUG nova.compute.manager [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:19:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:06 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:19:06 user nova-compute[74611]: INFO nova.compute.claims [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Claim successful on node user
Nov 13 10:19:07 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG nova.network.neutron [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:19:07 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:19:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:19:07 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Creating image(s)
Nov 13 10:19:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "/opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "/opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG nova.policy [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea494122b4f5499cbdcdb6c31e464074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc5da31f2854f4082c6d4b2d344d27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.179s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.183s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk 1073741824" returned: 0 in 0.052s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG nova.network.neutron [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Successfully created port: 463649db-b2c4-4d56-a440-9f9d86999568 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Cannot resize image /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Ensure instance console log exists: /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG nova.network.neutron [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Successfully updated port: 463649db-b2c4-4d56-a440-9f9d86999568 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "refresh_cache-cf3e7269-8b6b-4a74-af7d-46ea14f02e10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquired lock "refresh_cache-cf3e7269-8b6b-4a74-af7d-46ea14f02e10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG nova.network.neutron [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-15ce4562-92f2-4a87-a59a-127fef067826 req-5b6fb0f8-2ffc-422d-bf1d-070755850ede service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Received event network-changed-463649db-b2c4-4d56-a440-9f9d86999568 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-15ce4562-92f2-4a87-a59a-127fef067826 req-5b6fb0f8-2ffc-422d-bf1d-070755850ede service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Refreshing instance network info cache due to event network-changed-463649db-b2c4-4d56-a440-9f9d86999568. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-15ce4562-92f2-4a87-a59a-127fef067826 req-5b6fb0f8-2ffc-422d-bf1d-070755850ede service nova] Acquiring lock "refresh_cache-cf3e7269-8b6b-4a74-af7d-46ea14f02e10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:19:08 user nova-compute[74611]: DEBUG nova.network.neutron [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.network.neutron [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Updating instance_info_cache with network_info: [{"id": "463649db-b2c4-4d56-a440-9f9d86999568", "address": "fa:16:3e:96:cb:62", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463649db-b2", "ovs_interfaceid": "463649db-b2c4-4d56-a440-9f9d86999568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Releasing lock "refresh_cache-cf3e7269-8b6b-4a74-af7d-46ea14f02e10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.compute.manager [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Instance network_info: |[{"id": "463649db-b2c4-4d56-a440-9f9d86999568", "address": "fa:16:3e:96:cb:62", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463649db-b2", "ovs_interfaceid": "463649db-b2c4-4d56-a440-9f9d86999568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-15ce4562-92f2-4a87-a59a-127fef067826 req-5b6fb0f8-2ffc-422d-bf1d-070755850ede service nova] Acquired lock "refresh_cache-cf3e7269-8b6b-4a74-af7d-46ea14f02e10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.network.neutron [req-15ce4562-92f2-4a87-a59a-127fef067826 req-5b6fb0f8-2ffc-422d-bf1d-070755850ede service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Refreshing network info cache for port 463649db-b2c4-4d56-a440-9f9d86999568 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Start _get_guest_xml network_info=[{"id": "463649db-b2c4-4d56-a440-9f9d86999568", "address": "fa:16:3e:96:cb:62", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463649db-b2", "ovs_interfaceid": "463649db-b2c4-4d56-a440-9f9d86999568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:19:09 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:19:09 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1771186759',display_name='tempest-VolumesSnapshotTestJSON-instance-1771186759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1771186759',id=48,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3zsLtvH8jL69knliJpqLf08ZRF04enjsH8cq6VAcN0lA39VCm/mxGu7NjnoQbzm93M5cprCLzDumFKULhU2QYPXlDR/4C5JsbOvXPKf2lvLpvmdQaVOoAFbmGYV/w0w==',key_name='tempest-keypair-1309784651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc5da31f2854f4082c6d4b2d344d27a',ramdisk_id='',reservation_id='r-21t7n0h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-928671223',owner_user_name='tempest-VolumesSnapshotTestJSON-928671223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea494122b4f5499cbdcdb6c31e464074',uuid=cf3e7269-8b6b-4a74-af7d-46ea14f02e10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "463649db-b2c4-4d56-a440-9f9d86999568", "address": "fa:16:3e:96:cb:62", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463649db-b2", "ovs_interfaceid": "463649db-b2c4-4d56-a440-9f9d86999568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Converting VIF {"id": "463649db-b2c4-4d56-a440-9f9d86999568", "address": "fa:16:3e:96:cb:62", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463649db-b2", "ovs_interfaceid": "463649db-b2c4-4d56-a440-9f9d86999568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:cb:62,bridge_name='br-int',has_traffic_filtering=True,id=463649db-b2c4-4d56-a440-9f9d86999568,network=Network(e858906b-3909-45ae-856f-ac715040a03f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463649db-b2') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.objects.instance [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lazy-loading 'pci_devices' on Instance uuid cf3e7269-8b6b-4a74-af7d-46ea14f02e10 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:19:09 user nova-compute[74611]:   <uuid>cf3e7269-8b6b-4a74-af7d-46ea14f02e10</uuid>
Nov 13 10:19:09 user nova-compute[74611]:   <name>instance-00000030</name>
Nov 13 10:19:09 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:19:09 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:19:09 user nova-compute[74611]:   <metadata>
Nov 13 10:19:09 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:19:09 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:19:09 user nova-compute[74611]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1771186759</nova:name>
Nov 13 10:19:09 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:19:09</nova:creationTime>
Nov 13 10:19:09 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:19:09 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:19:09 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:19:09 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:19:09 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:19:09 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:19:09 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:19:09 user nova-compute[74611]:       <nova:owner>
Nov 13 10:19:09 user nova-compute[74611]:         <nova:user uuid="ea494122b4f5499cbdcdb6c31e464074">tempest-VolumesSnapshotTestJSON-928671223-project-member</nova:user>
Nov 13 10:19:09 user nova-compute[74611]:         <nova:project uuid="ebc5da31f2854f4082c6d4b2d344d27a">tempest-VolumesSnapshotTestJSON-928671223</nova:project>
Nov 13 10:19:09 user nova-compute[74611]:       </nova:owner>
Nov 13 10:19:09 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:19:09 user nova-compute[74611]:       <nova:ports>
Nov 13 10:19:09 user nova-compute[74611]:         <nova:port uuid="463649db-b2c4-4d56-a440-9f9d86999568">
Nov 13 10:19:09 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 10:19:09 user nova-compute[74611]:         </nova:port>
Nov 13 10:19:09 user nova-compute[74611]:       </nova:ports>
Nov 13 10:19:09 user nova-compute[74611]:     </nova:instance>
Nov 13 10:19:09 user nova-compute[74611]:   </metadata>
Nov 13 10:19:09 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:19:09 user nova-compute[74611]:     <system>
Nov 13 10:19:09 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:19:09 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:19:09 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:19:09 user nova-compute[74611]:       <entry name="serial">cf3e7269-8b6b-4a74-af7d-46ea14f02e10</entry>
Nov 13 10:19:09 user nova-compute[74611]:       <entry name="uuid">cf3e7269-8b6b-4a74-af7d-46ea14f02e10</entry>
Nov 13 10:19:09 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:19:09 user nova-compute[74611]:     </system>
Nov 13 10:19:09 user nova-compute[74611]:   </sysinfo>
Nov 13 10:19:09 user nova-compute[74611]:   <os>
Nov 13 10:19:09 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:19:09 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:19:09 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:19:09 user nova-compute[74611]:   </os>
Nov 13 10:19:09 user nova-compute[74611]:   <features>
Nov 13 10:19:09 user nova-compute[74611]:     <acpi/>
Nov 13 10:19:09 user nova-compute[74611]:     <apic/>
Nov 13 10:19:09 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:19:09 user nova-compute[74611]:   </features>
Nov 13 10:19:09 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:19:09 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:19:09 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:19:09 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:19:09 user nova-compute[74611]:   </clock>
Nov 13 10:19:09 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:19:09 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:19:09 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:19:09 user nova-compute[74611]:   </cpu>
Nov 13 10:19:09 user nova-compute[74611]:   <devices>
Nov 13 10:19:09 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:19:09 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:19:09 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk"/>
Nov 13 10:19:09 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:19:09 user nova-compute[74611]:     </disk>
Nov 13 10:19:09 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:19:09 user nova-compute[74611]:       <mac address="fa:16:3e:96:cb:62"/>
Nov 13 10:19:09 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:19:09 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:19:09 user nova-compute[74611]:       <target dev="tap463649db-b2"/>
Nov 13 10:19:09 user nova-compute[74611]:     </interface>
Nov 13 10:19:09 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:19:09 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/console.log" append="off"/>
Nov 13 10:19:09 user nova-compute[74611]:     </serial>
Nov 13 10:19:09 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:19:09 user nova-compute[74611]:     <video>
Nov 13 10:19:09 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:19:09 user nova-compute[74611]:     </video>
Nov 13 10:19:09 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:19:09 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:19:09 user nova-compute[74611]:     </rng>
Nov 13 10:19:09 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:19:09 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:19:09 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:19:09 user nova-compute[74611]:     </memballoon>
Nov 13 10:19:09 user nova-compute[74611]:   </devices>
Nov 13 10:19:09 user nova-compute[74611]: </domain>
Nov 13 10:19:09 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1771186759',display_name='tempest-VolumesSnapshotTestJSON-instance-1771186759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1771186759',id=48,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3zsLtvH8jL69knliJpqLf08ZRF04enjsH8cq6VAcN0lA39VCm/mxGu7NjnoQbzm93M5cprCLzDumFKULhU2QYPXlDR/4C5JsbOvXPKf2lvLpvmdQaVOoAFbmGYV/w0w==',key_name='tempest-keypair-1309784651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc5da31f2854f4082c6d4b2d344d27a',ramdisk_id='',reservation_id='r-21t7n0h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-928671223',owner_user_name='tempest-VolumesSnapshotTestJSON-928671223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea494122b4f5499cbdcdb6c31e464074',uuid=cf3e7269-8b6b-4a74-af7d-46ea14f02e10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "463649db-b2c4-4d56-a440-9f9d86999568", "address": "fa:16:3e:96:cb:62", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463649db-b2", "ovs_interfaceid": "463649db-b2c4-4d56-a440-9f9d86999568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Converting VIF {"id": "463649db-b2c4-4d56-a440-9f9d86999568", "address": "fa:16:3e:96:cb:62", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463649db-b2", "ovs_interfaceid": "463649db-b2c4-4d56-a440-9f9d86999568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:cb:62,bridge_name='br-int',has_traffic_filtering=True,id=463649db-b2c4-4d56-a440-9f9d86999568,network=Network(e858906b-3909-45ae-856f-ac715040a03f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463649db-b2') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG os_vif [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:cb:62,bridge_name='br-int',has_traffic_filtering=True,id=463649db-b2c4-4d56-a440-9f9d86999568,network=Network(e858906b-3909-45ae-856f-ac715040a03f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463649db-b2') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4614273-61fc-551a-8e98-98bd1e6a7c54', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap463649db-b2, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap463649db-b2, col_values=(('qos', UUID('a43d25b6-7bf3-477c-93f8-e4b2e29be5db')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap463649db-b2, col_values=(('external_ids', {'iface-id': '463649db-b2c4-4d56-a440-9f9d86999568', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:cb:62', 'vm-uuid': 'cf3e7269-8b6b-4a74-af7d-46ea14f02e10'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:09 user nova-compute[74611]: INFO os_vif [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:cb:62,bridge_name='br-int',has_traffic_filtering=True,id=463649db-b2c4-4d56-a440-9f9d86999568,network=Network(e858906b-3909-45ae-856f-ac715040a03f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463649db-b2')
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] No VIF found with MAC fa:16:3e:96:cb:62, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.network.neutron [req-15ce4562-92f2-4a87-a59a-127fef067826 req-5b6fb0f8-2ffc-422d-bf1d-070755850ede service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Updated VIF entry in instance network info cache for port 463649db-b2c4-4d56-a440-9f9d86999568. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG nova.network.neutron [req-15ce4562-92f2-4a87-a59a-127fef067826 req-5b6fb0f8-2ffc-422d-bf1d-070755850ede service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Updating instance_info_cache with network_info: [{"id": "463649db-b2c4-4d56-a440-9f9d86999568", "address": "fa:16:3e:96:cb:62", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463649db-b2", "ovs_interfaceid": "463649db-b2c4-4d56-a440-9f9d86999568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-15ce4562-92f2-4a87-a59a-127fef067826 req-5b6fb0f8-2ffc-422d-bf1d-070755850ede service nova] Releasing lock "refresh_cache-cf3e7269-8b6b-4a74-af7d-46ea14f02e10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:19:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:10 user nova-compute[74611]: DEBUG nova.compute.manager [req-28e122e3-fb2e-4808-912b-69709abca7de req-94f61494-2935-4ce3-841b-bea209dff4d6 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Received event network-vif-plugged-463649db-b2c4-4d56-a440-9f9d86999568 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:19:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-28e122e3-fb2e-4808-912b-69709abca7de req-94f61494-2935-4ce3-841b-bea209dff4d6 service nova] Acquiring lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-28e122e3-fb2e-4808-912b-69709abca7de req-94f61494-2935-4ce3-841b-bea209dff4d6 service nova] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-28e122e3-fb2e-4808-912b-69709abca7de req-94f61494-2935-4ce3-841b-bea209dff4d6 service nova] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:10 user nova-compute[74611]: DEBUG nova.compute.manager [req-28e122e3-fb2e-4808-912b-69709abca7de req-94f61494-2935-4ce3-841b-bea209dff4d6 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] No waiting events found dispatching network-vif-plugged-463649db-b2c4-4d56-a440-9f9d86999568 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:19:10 user nova-compute[74611]: WARNING nova.compute.manager [req-28e122e3-fb2e-4808-912b-69709abca7de req-94f61494-2935-4ce3-841b-bea209dff4d6 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Received unexpected event network-vif-plugged-463649db-b2c4-4d56-a440-9f9d86999568 for instance with vm_state building and task_state spawning.
Nov 13 10:19:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Acquiring lock "37f7dc97-436e-4427-9fc0-5ec60e446e96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lock "37f7dc97-436e-4427-9fc0-5ec60e446e96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:19:12 user nova-compute[74611]: INFO nova.compute.claims [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Claim successful on node user
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-1872fd19-3f15-4f78-99a2-e84cd23b6abf req-a8ffcc98-fef0-4e50-a74e-6665f5ff9256 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Received event network-vif-plugged-463649db-b2c4-4d56-a440-9f9d86999568 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1872fd19-3f15-4f78-99a2-e84cd23b6abf req-a8ffcc98-fef0-4e50-a74e-6665f5ff9256 service nova] Acquiring lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1872fd19-3f15-4f78-99a2-e84cd23b6abf req-a8ffcc98-fef0-4e50-a74e-6665f5ff9256 service nova] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1872fd19-3f15-4f78-99a2-e84cd23b6abf req-a8ffcc98-fef0-4e50-a74e-6665f5ff9256 service nova] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-1872fd19-3f15-4f78-99a2-e84cd23b6abf req-a8ffcc98-fef0-4e50-a74e-6665f5ff9256 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] No waiting events found dispatching network-vif-plugged-463649db-b2c4-4d56-a440-9f9d86999568 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:19:12 user nova-compute[74611]: WARNING nova.compute.manager [req-1872fd19-3f15-4f78-99a2-e84cd23b6abf req-a8ffcc98-fef0-4e50-a74e-6665f5ff9256 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Received unexpected event network-vif-plugged-463649db-b2c4-4d56-a440-9f9d86999568 for instance with vm_state building and task_state spawning.
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.compute.manager [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:19:12 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Instance spawned successfully.
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:19:12 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:19:12 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:19:13 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Creating image(s)
Nov 13 10:19:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Acquiring lock "/opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lock "/opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lock "/opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:13 user nova-compute[74611]: INFO nova.compute.manager [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 13 10:19:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG nova.policy [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce2df06581614a10954e57742931b690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719a00dbc8aa45eba35ea8349a71765a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:19:13 user nova-compute[74611]: INFO nova.compute.manager [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Took 6.54 seconds to build instance.
Nov 13 10:19:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-20628d4b-d6bc-4c2f-b5b3-9f7625e4a068 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.644s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.211s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.197s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk 1073741824" returned: 0 in 0.050s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.176s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:19:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Successfully created port: 96ed6226-9881-4921-acd9-c8e3f9c9a998 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Cannot resize image /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Ensure instance console log exists: /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Successfully updated port: 96ed6226-9881-4921-acd9-c8e3f9c9a998 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Acquiring lock "refresh_cache-37f7dc97-436e-4427-9fc0-5ec60e446e96" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Acquired lock "refresh_cache-37f7dc97-436e-4427-9fc0-5ec60e446e96" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-064f547e-9b13-4b08-8a59-ee698057bfb4 req-2df797dc-1684-4437-a28b-16a0365dd316 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Received event network-changed-96ed6226-9881-4921-acd9-c8e3f9c9a998 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG nova.compute.manager [req-064f547e-9b13-4b08-8a59-ee698057bfb4 req-2df797dc-1684-4437-a28b-16a0365dd316 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Refreshing instance network info cache due to event network-changed-96ed6226-9881-4921-acd9-c8e3f9c9a998. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-064f547e-9b13-4b08-8a59-ee698057bfb4 req-2df797dc-1684-4437-a28b-16a0365dd316 service nova] Acquiring lock "refresh_cache-37f7dc97-436e-4427-9fc0-5ec60e446e96" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:19:14 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.network.neutron [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Updating instance_info_cache with network_info: [{"id": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "address": "fa:16:3e:dc:d1:12", "network": {"id": "597806f6-dbbe-48ea-abed-40e5c60e8974", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d2600c1c1bc43ca9eb9a25c96f462ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed6226-98", "ovs_interfaceid": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Releasing lock "refresh_cache-37f7dc97-436e-4427-9fc0-5ec60e446e96" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Instance network_info: |[{"id": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "address": "fa:16:3e:dc:d1:12", "network": {"id": "597806f6-dbbe-48ea-abed-40e5c60e8974", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d2600c1c1bc43ca9eb9a25c96f462ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed6226-98", "ovs_interfaceid": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-064f547e-9b13-4b08-8a59-ee698057bfb4 req-2df797dc-1684-4437-a28b-16a0365dd316 service nova] Acquired lock "refresh_cache-37f7dc97-436e-4427-9fc0-5ec60e446e96" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.network.neutron [req-064f547e-9b13-4b08-8a59-ee698057bfb4 req-2df797dc-1684-4437-a28b-16a0365dd316 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Refreshing network info cache for port 96ed6226-9881-4921-acd9-c8e3f9c9a998 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Start _get_guest_xml network_info=[{"id": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "address": "fa:16:3e:dc:d1:12", "network": {"id": "597806f6-dbbe-48ea-abed-40e5c60e8974", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d2600c1c1bc43ca9eb9a25c96f462ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed6226-98", "ovs_interfaceid": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:19:15 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:19:15 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-174047674',display_name='tempest-VolumesNegativeTest-instance-174047674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-174047674',id=49,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='719a00dbc8aa45eba35ea8349a71765a',ramdisk_id='',reservation_id='r-jldqizwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-401987712',owner_user_name='tempest-VolumesNegativeTest-401987712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:19:13Z,user_data=None,user_id='ce2df06581614a10954e57742931b690',uuid=37f7dc97-436e-4427-9fc0-5ec60e446e96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "address": "fa:16:3e:dc:d1:12", "network": {"id": "597806f6-dbbe-48ea-abed-40e5c60e8974", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d2600c1c1bc43ca9eb9a25c96f462ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed6226-98", "ovs_interfaceid": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Converting VIF {"id": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "address": "fa:16:3e:dc:d1:12", "network": {"id": "597806f6-dbbe-48ea-abed-40e5c60e8974", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d2600c1c1bc43ca9eb9a25c96f462ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed6226-98", "ovs_interfaceid": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d1:12,bridge_name='br-int',has_traffic_filtering=True,id=96ed6226-9881-4921-acd9-c8e3f9c9a998,network=Network(597806f6-dbbe-48ea-abed-40e5c60e8974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ed6226-98') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.objects.instance [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lazy-loading 'pci_devices' on Instance uuid 37f7dc97-436e-4427-9fc0-5ec60e446e96 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:19:15 user nova-compute[74611]:   <uuid>37f7dc97-436e-4427-9fc0-5ec60e446e96</uuid>
Nov 13 10:19:15 user nova-compute[74611]:   <name>instance-00000031</name>
Nov 13 10:19:15 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:19:15 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:19:15 user nova-compute[74611]:   <metadata>
Nov 13 10:19:15 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:19:15 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:19:15 user nova-compute[74611]:       <nova:name>tempest-VolumesNegativeTest-instance-174047674</nova:name>
Nov 13 10:19:15 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:19:15</nova:creationTime>
Nov 13 10:19:15 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:19:15 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:19:15 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:19:15 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:19:15 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:19:15 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:19:15 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:19:15 user nova-compute[74611]:       <nova:owner>
Nov 13 10:19:15 user nova-compute[74611]:         <nova:user uuid="ce2df06581614a10954e57742931b690">tempest-VolumesNegativeTest-401987712-project-member</nova:user>
Nov 13 10:19:15 user nova-compute[74611]:         <nova:project uuid="719a00dbc8aa45eba35ea8349a71765a">tempest-VolumesNegativeTest-401987712</nova:project>
Nov 13 10:19:15 user nova-compute[74611]:       </nova:owner>
Nov 13 10:19:15 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:19:15 user nova-compute[74611]:       <nova:ports>
Nov 13 10:19:15 user nova-compute[74611]:         <nova:port uuid="96ed6226-9881-4921-acd9-c8e3f9c9a998">
Nov 13 10:19:15 user nova-compute[74611]:           <nova:ip type="fixed" address="192.168.233.53" ipVersion="4"/>
Nov 13 10:19:15 user nova-compute[74611]:         </nova:port>
Nov 13 10:19:15 user nova-compute[74611]:       </nova:ports>
Nov 13 10:19:15 user nova-compute[74611]:     </nova:instance>
Nov 13 10:19:15 user nova-compute[74611]:   </metadata>
Nov 13 10:19:15 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:19:15 user nova-compute[74611]:     <system>
Nov 13 10:19:15 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:19:15 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:19:15 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:19:15 user nova-compute[74611]:       <entry name="serial">37f7dc97-436e-4427-9fc0-5ec60e446e96</entry>
Nov 13 10:19:15 user nova-compute[74611]:       <entry name="uuid">37f7dc97-436e-4427-9fc0-5ec60e446e96</entry>
Nov 13 10:19:15 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:19:15 user nova-compute[74611]:     </system>
Nov 13 10:19:15 user nova-compute[74611]:   </sysinfo>
Nov 13 10:19:15 user nova-compute[74611]:   <os>
Nov 13 10:19:15 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:19:15 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:19:15 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:19:15 user nova-compute[74611]:   </os>
Nov 13 10:19:15 user nova-compute[74611]:   <features>
Nov 13 10:19:15 user nova-compute[74611]:     <acpi/>
Nov 13 10:19:15 user nova-compute[74611]:     <apic/>
Nov 13 10:19:15 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:19:15 user nova-compute[74611]:   </features>
Nov 13 10:19:15 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:19:15 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:19:15 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:19:15 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:19:15 user nova-compute[74611]:   </clock>
Nov 13 10:19:15 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:19:15 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:19:15 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:19:15 user nova-compute[74611]:   </cpu>
Nov 13 10:19:15 user nova-compute[74611]:   <devices>
Nov 13 10:19:15 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:19:15 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:19:15 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk"/>
Nov 13 10:19:15 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:19:15 user nova-compute[74611]:     </disk>
Nov 13 10:19:15 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:19:15 user nova-compute[74611]:       <mac address="fa:16:3e:dc:d1:12"/>
Nov 13 10:19:15 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:19:15 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:19:15 user nova-compute[74611]:       <target dev="tap96ed6226-98"/>
Nov 13 10:19:15 user nova-compute[74611]:     </interface>
Nov 13 10:19:15 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:19:15 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/console.log" append="off"/>
Nov 13 10:19:15 user nova-compute[74611]:     </serial>
Nov 13 10:19:15 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:19:15 user nova-compute[74611]:     <video>
Nov 13 10:19:15 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:19:15 user nova-compute[74611]:     </video>
Nov 13 10:19:15 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:19:15 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:19:15 user nova-compute[74611]:     </rng>
Nov 13 10:19:15 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:19:15 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:19:15 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:19:15 user nova-compute[74611]:     </memballoon>
Nov 13 10:19:15 user nova-compute[74611]:   </devices>
Nov 13 10:19:15 user nova-compute[74611]: </domain>
Nov 13 10:19:15 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-174047674',display_name='tempest-VolumesNegativeTest-instance-174047674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-174047674',id=49,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='719a00dbc8aa45eba35ea8349a71765a',ramdisk_id='',reservation_id='r-jldqizwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-401987712',owner_user_name='tempest-VolumesNegativeTest-401987712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:19:13Z,user_data=None,user_id='ce2df06581614a10954e57742931b690',uuid=37f7dc97-436e-4427-9fc0-5ec60e446e96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "address": "fa:16:3e:dc:d1:12", "network": {"id": "597806f6-dbbe-48ea-abed-40e5c60e8974", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d2600c1c1bc43ca9eb9a25c96f462ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed6226-98", "ovs_interfaceid": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Converting VIF {"id": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "address": "fa:16:3e:dc:d1:12", "network": {"id": "597806f6-dbbe-48ea-abed-40e5c60e8974", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d2600c1c1bc43ca9eb9a25c96f462ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed6226-98", "ovs_interfaceid": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d1:12,bridge_name='br-int',has_traffic_filtering=True,id=96ed6226-9881-4921-acd9-c8e3f9c9a998,network=Network(597806f6-dbbe-48ea-abed-40e5c60e8974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ed6226-98') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG os_vif [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d1:12,bridge_name='br-int',has_traffic_filtering=True,id=96ed6226-9881-4921-acd9-c8e3f9c9a998,network=Network(597806f6-dbbe-48ea-abed-40e5c60e8974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ed6226-98') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5dd0ea86-b353-56da-b4af-9cc873d8cf4a', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96ed6226-98, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96ed6226-98, col_values=(('qos', UUID('5b98f7da-56da-4dad-ba9b-c2572d8e4340')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96ed6226-98, col_values=(('external_ids', {'iface-id': '96ed6226-9881-4921-acd9-c8e3f9c9a998', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:d1:12', 'vm-uuid': '37f7dc97-436e-4427-9fc0-5ec60e446e96'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:15 user nova-compute[74611]: INFO os_vif [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d1:12,bridge_name='br-int',has_traffic_filtering=True,id=96ed6226-9881-4921-acd9-c8e3f9c9a998,network=Network(597806f6-dbbe-48ea-abed-40e5c60e8974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ed6226-98')
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] No VIF found with MAC fa:16:3e:dc:d1:12, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.network.neutron [req-064f547e-9b13-4b08-8a59-ee698057bfb4 req-2df797dc-1684-4437-a28b-16a0365dd316 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Updated VIF entry in instance network info cache for port 96ed6226-9881-4921-acd9-c8e3f9c9a998. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG nova.network.neutron [req-064f547e-9b13-4b08-8a59-ee698057bfb4 req-2df797dc-1684-4437-a28b-16a0365dd316 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Updating instance_info_cache with network_info: [{"id": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "address": "fa:16:3e:dc:d1:12", "network": {"id": "597806f6-dbbe-48ea-abed-40e5c60e8974", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d2600c1c1bc43ca9eb9a25c96f462ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed6226-98", "ovs_interfaceid": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:19:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-064f547e-9b13-4b08-8a59-ee698057bfb4 req-2df797dc-1684-4437-a28b-16a0365dd316 service nova] Releasing lock "refresh_cache-37f7dc97-436e-4427-9fc0-5ec60e446e96" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:19:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:17 user nova-compute[74611]: DEBUG nova.compute.manager [req-66d2c253-7b27-4ba7-84bf-cd7282bdd997 req-5f1d2508-2f81-4cb3-9837-5808d1dee985 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Received event network-vif-plugged-96ed6226-9881-4921-acd9-c8e3f9c9a998 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:19:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-66d2c253-7b27-4ba7-84bf-cd7282bdd997 req-5f1d2508-2f81-4cb3-9837-5808d1dee985 service nova] Acquiring lock "37f7dc97-436e-4427-9fc0-5ec60e446e96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-66d2c253-7b27-4ba7-84bf-cd7282bdd997 req-5f1d2508-2f81-4cb3-9837-5808d1dee985 service nova] Lock "37f7dc97-436e-4427-9fc0-5ec60e446e96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-66d2c253-7b27-4ba7-84bf-cd7282bdd997 req-5f1d2508-2f81-4cb3-9837-5808d1dee985 service nova] Lock "37f7dc97-436e-4427-9fc0-5ec60e446e96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:17 user nova-compute[74611]: DEBUG nova.compute.manager [req-66d2c253-7b27-4ba7-84bf-cd7282bdd997 req-5f1d2508-2f81-4cb3-9837-5808d1dee985 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] No waiting events found dispatching network-vif-plugged-96ed6226-9881-4921-acd9-c8e3f9c9a998 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:19:17 user nova-compute[74611]: WARNING nova.compute.manager [req-66d2c253-7b27-4ba7-84bf-cd7282bdd997 req-5f1d2508-2f81-4cb3-9837-5808d1dee985 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Received unexpected event network-vif-plugged-96ed6226-9881-4921-acd9-c8e3f9c9a998 for instance with vm_state building and task_state spawning.
Nov 13 10:19:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-07ccf952-ebe4-4731-9f10-24490f43796a req-00899482-2f5c-44da-aa24-61d3b6056704 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Received event network-vif-plugged-96ed6226-9881-4921-acd9-c8e3f9c9a998 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:19:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-07ccf952-ebe4-4731-9f10-24490f43796a req-00899482-2f5c-44da-aa24-61d3b6056704 service nova] Acquiring lock "37f7dc97-436e-4427-9fc0-5ec60e446e96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-07ccf952-ebe4-4731-9f10-24490f43796a req-00899482-2f5c-44da-aa24-61d3b6056704 service nova] Lock "37f7dc97-436e-4427-9fc0-5ec60e446e96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-07ccf952-ebe4-4731-9f10-24490f43796a req-00899482-2f5c-44da-aa24-61d3b6056704 service nova] Lock "37f7dc97-436e-4427-9fc0-5ec60e446e96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-07ccf952-ebe4-4731-9f10-24490f43796a req-00899482-2f5c-44da-aa24-61d3b6056704 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] No waiting events found dispatching network-vif-plugged-96ed6226-9881-4921-acd9-c8e3f9c9a998 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:19:19 user nova-compute[74611]: WARNING nova.compute.manager [req-07ccf952-ebe4-4731-9f10-24490f43796a req-00899482-2f5c-44da-aa24-61d3b6056704 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Received unexpected event network-vif-plugged-96ed6226-9881-4921-acd9-c8e3f9c9a998 for instance with vm_state building and task_state spawning.
Nov 13 10:19:19 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:19:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:19:19 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Instance spawned successfully.
Nov 13 10:19:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:19:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:19:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:19:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:19:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:19:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:19:19 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:19:19 user nova-compute[74611]: INFO nova.compute.manager [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 13 10:19:19 user nova-compute[74611]: DEBUG nova.compute.manager [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:19:19 user nova-compute[74611]: INFO nova.compute.manager [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Took 6.86 seconds to build instance.
Nov 13 10:19:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c28c9bdd-3a0e-49b5-bd8b-fc8e0b9c1915 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lock "37f7dc97-436e-4427-9fc0-5ec60e446e96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.977s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG nova.objects.instance [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lazy-loading 'flavor' on Instance uuid 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:22 user nova-compute[74611]: INFO nova.compute.manager [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Attaching volume ed9bdcdb-3b0b-457e-a004-c545041aaebb to /dev/vdb
Nov 13 10:19:22 user nova-compute[74611]: DEBUG os_brick.utils [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2e5d76-3aa7-4c72-96e0-c8deb55ce635]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4ffafd-df1a-4e00-a2f8-9b0e66040a96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77b6590-7ebe-49f3-b734-ccd65f8d0576]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dedf0b-321e-4a0f-8f86-425f5e2a5f6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:19:22 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:19:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5698a57d-d4fd-4244-887a-b25124b2f2a8]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG os_brick.utils [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:19:22 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updating existing volume attachment record: 787fb163-c8d0-4aa3-a8c4-576ed985741c {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:19:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLNsjSut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:19:26 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:19:26 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:19:26 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacd0d73-b873-4672-969f-d028f174c6da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:19:26 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63e996f-b97d-4047-acdb-ea2ef0d5dc73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb] added
Nov 13 10:19:26 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[324c1028-faeb-4fa0-8ecc-a6d8f5d738a6]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed69b8b9-9b35-4727-8c9d-c278b4bfe183]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PLNsjSut {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PLNsjSut" returned: 0 in 0.034s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[47aa0c8b-3e49-4217-b80e-a17b2f8755d0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PLNsjSut'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72ecabb-bce7-426c-8fcf-6d886dbacf13]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5180329-46cf-4c8b-accc-77f805e71a1d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 (non-flash)
Nov 13 10:19:26 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 (non-flash)
Nov 13 10:19:26 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b5e404-e1a5-4afc-a467-fb0662f6e899]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb, portal: 172.16.0.220,3260]
Nov 13 10:19:26 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb, portal: 172.16.0.220,3260] successful.
Nov 13 10:19:26 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b68c89-69a3-4d31-85ed-6e48f8cd6701]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd31b8a-eeee-4e88-846f-7010b6537311]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 (non-flash)
Nov 13 10:19:26 user nova-compute[74611]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)
Nov 13 10:19:26 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 (non-flash)
Nov 13 10:19:26 user nova-compute[74611]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)
Nov 13 10:19:26 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbae14e9-9820-4034-bb17-5b4ae4cceeee]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:19:26 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLNsjSut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:19:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:19:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23737313361383130', 'path': '/dev/sdc'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:19:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737313361383130', 'path': '/dev/sdc'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:19:27 user nova-compute[74611]: DEBUG nova.objects.instance [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lazy-loading 'flavor' on Instance uuid 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:19:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:19:28 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:19:28 user nova-compute[74611]:   <source dev="/dev/sdc"/>
Nov 13 10:19:28 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:19:28 user nova-compute[74611]:   <serial>ed9bdcdb-3b0b-457e-a004-c545041aaebb</serial>
Nov 13 10:19:28 user nova-compute[74611]: </disk>
Nov 13 10:19:28 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:19:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:19:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:19:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] No VIF found with MAC fa:16:3e:8d:a8:e5, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:19:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-041741b3-20e0-44c9-8baa-bd7067190489 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.225s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-a7593f3b-1894-4c43-a861-f0681fe43fc4 req-9ba0bc6e-43aa-471f-8a15-60392766928a service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received event network-changed-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:19:30 user nova-compute[74611]: DEBUG nova.compute.manager [req-a7593f3b-1894-4c43-a861-f0681fe43fc4 req-9ba0bc6e-43aa-471f-8a15-60392766928a service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Refreshing instance network info cache due to event network-changed-9968045c-515a-4b9e-bc0f-26fd2939af52. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:19:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a7593f3b-1894-4c43-a861-f0681fe43fc4 req-9ba0bc6e-43aa-471f-8a15-60392766928a service nova] Acquiring lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:19:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a7593f3b-1894-4c43-a861-f0681fe43fc4 req-9ba0bc6e-43aa-471f-8a15-60392766928a service nova] Acquired lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:19:30 user nova-compute[74611]: DEBUG nova.network.neutron [req-a7593f3b-1894-4c43-a861-f0681fe43fc4 req-9ba0bc6e-43aa-471f-8a15-60392766928a service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Refreshing network info cache for port 9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:19:31 user nova-compute[74611]: DEBUG nova.network.neutron [req-a7593f3b-1894-4c43-a861-f0681fe43fc4 req-9ba0bc6e-43aa-471f-8a15-60392766928a service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updated VIF entry in instance network info cache for port 9968045c-515a-4b9e-bc0f-26fd2939af52. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:19:31 user nova-compute[74611]: DEBUG nova.network.neutron [req-a7593f3b-1894-4c43-a861-f0681fe43fc4 req-9ba0bc6e-43aa-471f-8a15-60392766928a service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updating instance_info_cache with network_info: [{"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:19:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-a7593f3b-1894-4c43-a861-f0681fe43fc4 req-9ba0bc6e-43aa-471f-8a15-60392766928a service nova] Releasing lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:19:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-004def41-f67c-49cd-a724-1791604dd573 req-8f8f206f-7b37-43e6-b8f8-32e9c9073551 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received event network-changed-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:19:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-004def41-f67c-49cd-a724-1791604dd573 req-8f8f206f-7b37-43e6-b8f8-32e9c9073551 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Refreshing instance network info cache due to event network-changed-9968045c-515a-4b9e-bc0f-26fd2939af52. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:19:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-004def41-f67c-49cd-a724-1791604dd573 req-8f8f206f-7b37-43e6-b8f8-32e9c9073551 service nova] Acquiring lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:19:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-004def41-f67c-49cd-a724-1791604dd573 req-8f8f206f-7b37-43e6-b8f8-32e9c9073551 service nova] Acquired lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:19:32 user nova-compute[74611]: DEBUG nova.network.neutron [req-004def41-f67c-49cd-a724-1791604dd573 req-8f8f206f-7b37-43e6-b8f8-32e9c9073551 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Refreshing network info cache for port 9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:19:33 user nova-compute[74611]: DEBUG nova.network.neutron [req-004def41-f67c-49cd-a724-1791604dd573 req-8f8f206f-7b37-43e6-b8f8-32e9c9073551 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updated VIF entry in instance network info cache for port 9968045c-515a-4b9e-bc0f-26fd2939af52. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:19:33 user nova-compute[74611]: DEBUG nova.network.neutron [req-004def41-f67c-49cd-a724-1791604dd573 req-8f8f206f-7b37-43e6-b8f8-32e9c9073551 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updating instance_info_cache with network_info: [{"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:19:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-004def41-f67c-49cd-a724-1791604dd573 req-8f8f206f-7b37-43e6-b8f8-32e9c9073551 service nova] Releasing lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:19:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-31f2e110-6216-4540-9ef9-f50b727165fb tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-31f2e110-6216-4540-9ef9-f50b727165fb tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:33 user nova-compute[74611]: INFO nova.compute.manager [None req-31f2e110-6216-4540-9ef9-f50b727165fb tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Rebooting instance
Nov 13 10:19:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-31f2e110-6216-4540-9ef9-f50b727165fb tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:19:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-31f2e110-6216-4540-9ef9-f50b727165fb tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquired lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:19:33 user nova-compute[74611]: DEBUG nova.network.neutron [None req-31f2e110-6216-4540-9ef9-f50b727165fb tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:19:33 user nova-compute[74611]: DEBUG nova.network.neutron [None req-31f2e110-6216-4540-9ef9-f50b727165fb tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updating instance_info_cache with network_info: [{"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:19:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-31f2e110-6216-4540-9ef9-f50b727165fb tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Releasing lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:19:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-31f2e110-6216-4540-9ef9-f50b727165fb tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:19:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-bdbe2927-75a9-454f-9171-41fb9a7081a8 req-9fde3a0a-879b-4b24-8c9b-682a74a325dd service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received event network-vif-unplugged-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:19:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bdbe2927-75a9-454f-9171-41fb9a7081a8 req-9fde3a0a-879b-4b24-8c9b-682a74a325dd service nova] Acquiring lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bdbe2927-75a9-454f-9171-41fb9a7081a8 req-9fde3a0a-879b-4b24-8c9b-682a74a325dd service nova] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-bdbe2927-75a9-454f-9171-41fb9a7081a8 req-9fde3a0a-879b-4b24-8c9b-682a74a325dd service nova] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-bdbe2927-75a9-454f-9171-41fb9a7081a8 req-9fde3a0a-879b-4b24-8c9b-682a74a325dd service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] No waiting events found dispatching network-vif-unplugged-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:19:36 user nova-compute[74611]: WARNING nova.compute.manager [req-bdbe2927-75a9-454f-9171-41fb9a7081a8 req-9fde3a0a-879b-4b24-8c9b-682a74a325dd service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received unexpected event network-vif-unplugged-9968045c-515a-4b9e-bc0f-26fd2939af52 for instance with vm_state active and task_state reboot_started.
Nov 13 10:19:36 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-31f2e110-6216-4540-9ef9-f50b727165fb tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Instance shutdown successfully.
Nov 13 10:19:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-2b8b3be0-a6e2-429b-b264-9752e8181d55 req-aaad0c1b-2ff3-44af-8449-423de2c18d68 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received event network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:19:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2b8b3be0-a6e2-429b-b264-9752e8181d55 req-aaad0c1b-2ff3-44af-8449-423de2c18d68 service nova] Acquiring lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2b8b3be0-a6e2-429b-b264-9752e8181d55 req-aaad0c1b-2ff3-44af-8449-423de2c18d68 service nova] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2b8b3be0-a6e2-429b-b264-9752e8181d55 req-aaad0c1b-2ff3-44af-8449-423de2c18d68 service nova] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-2b8b3be0-a6e2-429b-b264-9752e8181d55 req-aaad0c1b-2ff3-44af-8449-423de2c18d68 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] No waiting events found dispatching network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:19:38 user nova-compute[74611]: WARNING nova.compute.manager [req-2b8b3be0-a6e2-429b-b264-9752e8181d55 req-aaad0c1b-2ff3-44af-8449-423de2c18d68 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received unexpected event network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 for instance with vm_state active and task_state reboot_started.
Nov 13 10:19:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:40 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Instance running successfully.
Nov 13 10:19:40 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-31f2e110-6216-4540-9ef9-f50b727165fb tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Instance soft rebooted successfully.
Nov 13 10:19:40 user nova-compute[74611]: DEBUG nova.compute.manager [None req-31f2e110-6216-4540-9ef9-f50b727165fb tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:19:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-1517b798-4ec3-4015-a293-a1ddeaa685a3 req-5fdec693-782e-4e5d-8ca3-58df0b574f81 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received event network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:19:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1517b798-4ec3-4015-a293-a1ddeaa685a3 req-5fdec693-782e-4e5d-8ca3-58df0b574f81 service nova] Acquiring lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1517b798-4ec3-4015-a293-a1ddeaa685a3 req-5fdec693-782e-4e5d-8ca3-58df0b574f81 service nova] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1517b798-4ec3-4015-a293-a1ddeaa685a3 req-5fdec693-782e-4e5d-8ca3-58df0b574f81 service nova] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-1517b798-4ec3-4015-a293-a1ddeaa685a3 req-5fdec693-782e-4e5d-8ca3-58df0b574f81 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] No waiting events found dispatching network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:19:40 user nova-compute[74611]: WARNING nova.compute.manager [req-1517b798-4ec3-4015-a293-a1ddeaa685a3 req-5fdec693-782e-4e5d-8ca3-58df0b574f81 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received unexpected event network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 for instance with vm_state active and task_state reboot_started.
Nov 13 10:19:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-1517b798-4ec3-4015-a293-a1ddeaa685a3 req-5fdec693-782e-4e5d-8ca3-58df0b574f81 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received event network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:19:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1517b798-4ec3-4015-a293-a1ddeaa685a3 req-5fdec693-782e-4e5d-8ca3-58df0b574f81 service nova] Acquiring lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1517b798-4ec3-4015-a293-a1ddeaa685a3 req-5fdec693-782e-4e5d-8ca3-58df0b574f81 service nova] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1517b798-4ec3-4015-a293-a1ddeaa685a3 req-5fdec693-782e-4e5d-8ca3-58df0b574f81 service nova] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:40 user nova-compute[74611]: DEBUG nova.compute.manager [req-1517b798-4ec3-4015-a293-a1ddeaa685a3 req-5fdec693-782e-4e5d-8ca3-58df0b574f81 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] No waiting events found dispatching network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:19:40 user nova-compute[74611]: WARNING nova.compute.manager [req-1517b798-4ec3-4015-a293-a1ddeaa685a3 req-5fdec693-782e-4e5d-8ca3-58df0b574f81 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received unexpected event network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 for instance with vm_state active and task_state reboot_started.
Nov 13 10:19:40 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-31f2e110-6216-4540-9ef9-f50b727165fb tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.123s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:51 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:19:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:19:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:19:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:19:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:19:51 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:19:51 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid 770d57de-444b-42d1-824b-85e881fe76dd {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:19:51 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updating instance_info_cache with network_info: [{"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:19:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:19:51 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:19:54 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:19:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:19:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:56 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:19:57 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:19:59 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:19:59 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:19:59 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:19:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:19:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:19:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:19:59 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:19:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:19:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:19:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:19:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:19:59 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:00 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:20:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.rescue --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:01 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:20:01 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:20:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8388MB free_disk=25.019359588623047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:20:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:20:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:20:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 770d57de-444b-42d1-824b-85e881fe76dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:20:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:20:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance cf3e7269-8b6b-4a74-af7d-46ea14f02e10 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:20:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 37f7dc97-436e-4427-9fc0-5ec60e446e96 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:20:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:20:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:20:01 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing inventories for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 10:20:01 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating ProviderTree inventory for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 10:20:01 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating inventory in ProviderTree for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 10:20:01 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing aggregate associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, aggregates: None {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 10:20:01 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing trait associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 10:20:01 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:20:01 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:20:02 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:20:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:20:02 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:20:02 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 10:20:02 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] There are 0 instances to clean {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 10:20:03 user nova-compute[74611]: INFO nova.compute.manager [None req-91d9142a-f669-4b09-abf6-8d8e7ba2705c tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Unrescuing
Nov 13 10:20:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-91d9142a-f669-4b09-abf6-8d8e7ba2705c tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:20:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-91d9142a-f669-4b09-abf6-8d8e7ba2705c tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquired lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:20:03 user nova-compute[74611]: DEBUG nova.network.neutron [None req-91d9142a-f669-4b09-abf6-8d8e7ba2705c tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:20:04 user nova-compute[74611]: DEBUG nova.network.neutron [None req-91d9142a-f669-4b09-abf6-8d8e7ba2705c tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updating instance_info_cache with network_info: [{"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:20:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-91d9142a-f669-4b09-abf6-8d8e7ba2705c tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Releasing lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:20:04 user nova-compute[74611]: DEBUG nova.objects.instance [None req-91d9142a-f669-4b09-abf6-8d8e7ba2705c tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lazy-loading 'flavor' on Instance uuid 770d57de-444b-42d1-824b-85e881fe76dd {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:20:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-c47d145b-488b-460e-baa9-a7a561080460 req-d2674f65-c141-428d-9e29-19070fe3afa9 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-vif-unplugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:20:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c47d145b-488b-460e-baa9-a7a561080460 req-d2674f65-c141-428d-9e29-19070fe3afa9 service nova] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:20:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c47d145b-488b-460e-baa9-a7a561080460 req-d2674f65-c141-428d-9e29-19070fe3afa9 service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:20:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c47d145b-488b-460e-baa9-a7a561080460 req-d2674f65-c141-428d-9e29-19070fe3afa9 service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:20:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-c47d145b-488b-460e-baa9-a7a561080460 req-d2674f65-c141-428d-9e29-19070fe3afa9 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] No waiting events found dispatching network-vif-unplugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:20:04 user nova-compute[74611]: WARNING nova.compute.manager [req-c47d145b-488b-460e-baa9-a7a561080460 req-d2674f65-c141-428d-9e29-19070fe3afa9 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received unexpected event network-vif-unplugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:20:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:04 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Instance destroyed successfully.
Nov 13 10:20:05 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG nova.compute.manager [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG nova.compute.manager [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] No waiting events found dispatching network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:20:06 user nova-compute[74611]: WARNING nova.compute.manager [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received unexpected event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:20:06 user nova-compute[74611]: DEBUG nova.compute.manager [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-changed-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG nova.compute.manager [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Refreshing instance network info cache due to event network-changed-a3a02b77-480a-4ffe-a8da-f0bda6e70f57. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] Acquiring lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] Acquired lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG nova.network.neutron [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Refreshing network info cache for port a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG nova.network.neutron [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updated VIF entry in instance network info cache for port a3a02b77-480a-4ffe-a8da-f0bda6e70f57. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG nova.network.neutron [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updating instance_info_cache with network_info: [{"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] Releasing lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-changed-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Refreshing instance network info cache due to event network-changed-a3a02b77-480a-4ffe-a8da-f0bda6e70f57. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] Acquiring lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] Acquired lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG nova.network.neutron [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Refreshing network info cache for port a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG nova.network.neutron [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updated VIF entry in instance network info cache for port a3a02b77-480a-4ffe-a8da-f0bda6e70f57. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG nova.network.neutron [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updating instance_info_cache with network_info: [{"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] Releasing lock "refresh_cache-770d57de-444b-42d1-824b-85e881fe76dd" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:20:07 user nova-compute[74611]: DEBUG nova.compute.manager [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] No waiting events found dispatching network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:20:07 user nova-compute[74611]: WARNING nova.compute.manager [req-97f1e142-fa27-40c7-9e08-bc06a04d42b5 req-8f218649-9226-49b9-b559-dc136fcb4c64 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received unexpected event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 for instance with vm_state rescued and task_state unrescuing.
Nov 13 10:20:08 user nova-compute[74611]: DEBUG nova.compute.manager [None req-91d9142a-f669-4b09-abf6-8d8e7ba2705c tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:20:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c24eea23-2682-49cd-b149-fa7f2ee3aef9 req-921b288d-c894-448e-85df-20e8fa3fda29 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:20:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c24eea23-2682-49cd-b149-fa7f2ee3aef9 req-921b288d-c894-448e-85df-20e8fa3fda29 service nova] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:20:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c24eea23-2682-49cd-b149-fa7f2ee3aef9 req-921b288d-c894-448e-85df-20e8fa3fda29 service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:20:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c24eea23-2682-49cd-b149-fa7f2ee3aef9 req-921b288d-c894-448e-85df-20e8fa3fda29 service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:20:08 user nova-compute[74611]: DEBUG nova.compute.manager [req-c24eea23-2682-49cd-b149-fa7f2ee3aef9 req-921b288d-c894-448e-85df-20e8fa3fda29 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] No waiting events found dispatching network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:20:08 user nova-compute[74611]: WARNING nova.compute.manager [req-c24eea23-2682-49cd-b149-fa7f2ee3aef9 req-921b288d-c894-448e-85df-20e8fa3fda29 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received unexpected event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 for instance with vm_state active and task_state None.
Nov 13 10:20:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:13 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:20:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74611) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 10:20:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:15 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:20:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:26 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:20:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:20:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "770d57de-444b-42d1-824b-85e881fe76dd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:20:36 user nova-compute[74611]: INFO nova.compute.manager [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Detaching volume c8bd83ac-27b0-474e-9332-1865dc671386
Nov 13 10:20:37 user nova-compute[74611]: INFO nova.virt.block_device [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Attempting to driver detach volume c8bd83ac-27b0-474e-9332-1865dc671386 from mountpoint /dev/vdb
Nov 13 10:20:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Attempting to detach device vdb from instance 770d57de-444b-42d1-824b-85e881fe76dd from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:20:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:20:37 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:20:37 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:20:37 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:20:37 user nova-compute[74611]:   <serial>c8bd83ac-27b0-474e-9332-1865dc671386</serial>
Nov 13 10:20:37 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:20:37 user nova-compute[74611]: </disk>
Nov 13 10:20:37 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:20:37 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Successfully detached device vdb from instance 770d57de-444b-42d1-824b-85e881fe76dd from the persistent domain config.
Nov 13 10:20:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 770d57de-444b-42d1-824b-85e881fe76dd from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:20:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:20:37 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:20:37 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:20:37 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:20:37 user nova-compute[74611]:   <serial>c8bd83ac-27b0-474e-9332-1865dc671386</serial>
Nov 13 10:20:37 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:20:37 user nova-compute[74611]: </disk>
Nov 13 10:20:37 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:20:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 770d57de-444b-42d1-824b-85e881fe76dd {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:20:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:45 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:20:52 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:20:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:20:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:20:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:20:52 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:20:52 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updating instance_info_cache with network_info: [{"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:20:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:20:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:20:55 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:20:56 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:20:56 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:20:57 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 770d57de-444b-42d1-824b-85e881fe76dd is timed out.
Nov 13 10:20:57 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Successfully detached device vdb from instance 770d57de-444b-42d1-824b-85e881fe76dd from the live domain config.
Nov 13 10:20:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhPwEkam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:20:57 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[52de63b9-ea0a-43ac-bda0-2a41aaa980bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:20:57 user nova-compute[74611]: No targets found.
Nov 13 10:20:57 user nova-compute[74611]: iSNS:
Nov 13 10:20:57 user nova-compute[74611]: No targets found.
Nov 13 10:20:57 user nova-compute[74611]: STATIC:
Nov 13 10:20:57 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb
Nov 13 10:20:57 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:20:57 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:20:57 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386
Nov 13 10:20:57 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:20:57 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:20:57 user nova-compute[74611]: FIRMWARE:
Nov 13 10:20:57 user nova-compute[74611]: No targets found.
Nov 13 10:20:57 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:20:57 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:20:57 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[989a9ba1-92d2-4dd4-99b8-8dbf2beb7322]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[729dcd5d-9c3d-4af9-b69d-90e5140d5ab6]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 (non-flash)
Nov 13 10:20:57 user nova-compute[74611]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)
Nov 13 10:20:57 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 (non-flash)
Nov 13 10:20:57 user nova-compute[74611]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)
Nov 13 10:20:57 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64249900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7873c424-114d-462c-bf12-752c63a32034]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf629ea7-546e-45c9-a60c-c07d8e13f032]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[929d3e4c-34df-439c-b6ad-3d917a77bbc3]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG nova.compute.manager [req-dfa7a180-02e4-4d75-ad56-5c137dc044a7 req-0109849e-f99c-4032-9ca2-c77f7b1a1741 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Received event network-changed-463649db-b2c4-4d56-a440-9f9d86999568 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG nova.compute.manager [req-dfa7a180-02e4-4d75-ad56-5c137dc044a7 req-0109849e-f99c-4032-9ca2-c77f7b1a1741 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Refreshing instance network info cache due to event network-changed-463649db-b2c4-4d56-a440-9f9d86999568. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dfa7a180-02e4-4d75-ad56-5c137dc044a7 req-0109849e-f99c-4032-9ca2-c77f7b1a1741 service nova] Acquiring lock "refresh_cache-cf3e7269-8b6b-4a74-af7d-46ea14f02e10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dfa7a180-02e4-4d75-ad56-5c137dc044a7 req-0109849e-f99c-4032-9ca2-c77f7b1a1741 service nova] Acquired lock "refresh_cache-cf3e7269-8b6b-4a74-af7d-46ea14f02e10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG nova.network.neutron [req-dfa7a180-02e4-4d75-ad56-5c137dc044a7 req-0109849e-f99c-4032-9ca2-c77f7b1a1741 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Refreshing network info cache for port 463649db-b2c4-4d56-a440-9f9d86999568 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a42bc5-ff82-419b-8318-835a9114ee29]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bc1d9e-319e-4ce3-b885-f90245da4707]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa81c2b7-a491-4500-ab61-19ea005e50c3]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386, portal: 172.16.0.220,3260]
Nov 13 10:20:57 user nova-compute[74611]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386, portal: 172.16.0.220,3260] successful.
Nov 13 10:20:57 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8bd83ac-27b0-474e-9332-1865dc671386 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c40dba-6613-42b2-a5bf-acdbabac5e64]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] <== disconnect_volume: return (300ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:20:57 user nova-compute[74611]: DEBUG nova.objects.instance [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lazy-loading 'flavor' on Instance uuid cf3e7269-8b6b-4a74-af7d-46ea14f02e10 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:20:57 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Ignoring supplied device name: /dev/vdb
Nov 13 10:20:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:20:58 user nova-compute[74611]: INFO nova.compute.manager [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Attaching volume 5addc1a5-8bc2-4859-8ec4-7f51186342cf to /dev/vdb
Nov 13 10:20:58 user nova-compute[74611]: DEBUG os_brick.utils [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[060d5435-f3ee-4f37-a9d3-55b6542143fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8abf091-eb50-43a0-ad31-6d735e65f3d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[14beb2be-eb3d-4e5b-8878-0e1df67df8c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[066c77f4-bb67-49f6-afac-a649e1f0ac31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:20:58 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cccbb64-ef25-4c73-b356-e5239b50d9d8]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG os_brick.utils [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Updating existing volume attachment record: bc16420a-8b6f-4cf1-8563-d20c03b56793 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG nova.network.neutron [req-dfa7a180-02e4-4d75-ad56-5c137dc044a7 req-0109849e-f99c-4032-9ca2-c77f7b1a1741 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Updated VIF entry in instance network info cache for port 463649db-b2c4-4d56-a440-9f9d86999568. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG nova.network.neutron [req-dfa7a180-02e4-4d75-ad56-5c137dc044a7 req-0109849e-f99c-4032-9ca2-c77f7b1a1741 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Updating instance_info_cache with network_info: [{"id": "463649db-b2c4-4d56-a440-9f9d86999568", "address": "fa:16:3e:96:cb:62", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463649db-b2", "ovs_interfaceid": "463649db-b2c4-4d56-a440-9f9d86999568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-dfa7a180-02e4-4d75-ad56-5c137dc044a7 req-0109849e-f99c-4032-9ca2-c77f7b1a1741 service nova] Releasing lock "refresh_cache-cf3e7269-8b6b-4a74-af7d-46ea14f02e10" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG nova.objects.instance [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lazy-loading 'flavor' on Instance uuid 770d57de-444b-42d1-824b-85e881fe76dd {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:20:58 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-60f27578-150f-400a-bad4-e6f6e0a771e8 tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "770d57de-444b-42d1-824b-85e881fe76dd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.657s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:20:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:00 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:01 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:21:01 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:21:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:01 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:21:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:01 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:21:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqMrpmcR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:21:02 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:21:02 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:21:02 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[443876ba-8580-4316-9e5e-2282548475c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:21:02 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fbc1e1-7b11-4b23-8a83-00b099e0f6eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf] added
Nov 13 10:21:02 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b077642-b5c6-454b-882d-8963e61ba4f8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d94921-4094-4e23-8194-5d0002ac8b3a]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JqMrpmcR {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JqMrpmcR" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2d6b8f-7f3c-4881-a128-535abece85d5]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JqMrpmcR'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ed292a-5919-40fb-92c7-dfa6b4dd31cf]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b415a47-d532-4413-b288-2b3a3a3b2e22]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)
Nov 13 10:21:02 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)
Nov 13 10:21:02 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2ff4e5-80db-45aa-9a95-c93a40776757]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf, portal: 172.16.0.220,3260]
Nov 13 10:21:02 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf, portal: 172.16.0.220,3260] successful.
Nov 13 10:21:02 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[26deee11-3b32-4469-b6d7-a97b84c37ce4]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[128e2ce6-2f57-40ec-bf63-7c8b428bc56c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)
Nov 13 10:21:02 user nova-compute[74611]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf (non-flash)
Nov 13 10:21:02 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)
Nov 13 10:21:02 user nova-compute[74611]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf (non-flash)
Nov 13 10:21:02 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf69695-ee6d-4ef0-83ee-86bd7d0cf64d]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqMrpmcR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Acquiring lock "37f7dc97-436e-4427-9fc0-5ec60e446e96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lock "37f7dc97-436e-4427-9fc0-5ec60e446e96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Acquiring lock "37f7dc97-436e-4427-9fc0-5ec60e446e96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lock "37f7dc97-436e-4427-9fc0-5ec60e446e96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lock "37f7dc97-436e-4427-9fc0-5ec60e446e96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:02 user nova-compute[74611]: INFO nova.compute.manager [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Terminating instance
Nov 13 10:21:02 user nova-compute[74611]: DEBUG nova.compute.manager [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.601s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] <== connect_volume: return (1603ms) {'type': 'block', 'scsi_wwn': '23666326439643137', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666326439643137', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.compute.manager [req-3a1ba48b-0040-4393-a294-7521142a1566 req-2a92383c-4df7-4963-9a89-872e409afeb8 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Received event network-vif-unplugged-96ed6226-9881-4921-acd9-c8e3f9c9a998 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3a1ba48b-0040-4393-a294-7521142a1566 req-2a92383c-4df7-4963-9a89-872e409afeb8 service nova] Acquiring lock "37f7dc97-436e-4427-9fc0-5ec60e446e96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3a1ba48b-0040-4393-a294-7521142a1566 req-2a92383c-4df7-4963-9a89-872e409afeb8 service nova] Lock "37f7dc97-436e-4427-9fc0-5ec60e446e96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-3a1ba48b-0040-4393-a294-7521142a1566 req-2a92383c-4df7-4963-9a89-872e409afeb8 service nova] Lock "37f7dc97-436e-4427-9fc0-5ec60e446e96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.compute.manager [req-3a1ba48b-0040-4393-a294-7521142a1566 req-2a92383c-4df7-4963-9a89-872e409afeb8 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] No waiting events found dispatching network-vif-unplugged-96ed6226-9881-4921-acd9-c8e3f9c9a998 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.compute.manager [req-3a1ba48b-0040-4393-a294-7521142a1566 req-2a92383c-4df7-4963-9a89-872e409afeb8 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Received event network-vif-unplugged-96ed6226-9881-4921-acd9-c8e3f9c9a998 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:21:03 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Instance destroyed successfully.
Nov 13 10:21:03 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:21:03 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8502MB free_disk=25.01870346069336GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.objects.instance [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lazy-loading 'resources' on Instance uuid 37f7dc97-436e-4427-9fc0-5ec60e446e96 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.objects.instance [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lazy-loading 'flavor' on Instance uuid cf3e7269-8b6b-4a74-af7d-46ea14f02e10 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-174047674',display_name='tempest-VolumesNegativeTest-instance-174047674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-174047674',id=49,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:19:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='719a00dbc8aa45eba35ea8349a71765a',ramdisk_id='',reservation_id='r-jldqizwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-401987712',owner_user_name='tempest-VolumesNegativeTest-401987712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:19:19Z,user_data=None,user_id='ce2df06581614a10954e57742931b690',uuid=37f7dc97-436e-4427-9fc0-5ec60e446e96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "address": "fa:16:3e:dc:d1:12", "network": {"id": "597806f6-dbbe-48ea-abed-40e5c60e8974", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d2600c1c1bc43ca9eb9a25c96f462ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed6226-98", "ovs_interfaceid": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Converting VIF {"id": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "address": "fa:16:3e:dc:d1:12", "network": {"id": "597806f6-dbbe-48ea-abed-40e5c60e8974", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d2600c1c1bc43ca9eb9a25c96f462ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed6226-98", "ovs_interfaceid": "96ed6226-9881-4921-acd9-c8e3f9c9a998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d1:12,bridge_name='br-int',has_traffic_filtering=True,id=96ed6226-9881-4921-acd9-c8e3f9c9a998,network=Network(597806f6-dbbe-48ea-abed-40e5c60e8974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ed6226-98') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG os_vif [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d1:12,bridge_name='br-int',has_traffic_filtering=True,id=96ed6226-9881-4921-acd9-c8e3f9c9a998,network=Network(597806f6-dbbe-48ea-abed-40e5c60e8974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ed6226-98') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96ed6226-98, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b98f7da-56da-4dad-ba9b-c2572d8e4340) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:21:03 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:21:03 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:21:03 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:21:03 user nova-compute[74611]:   <serial>5addc1a5-8bc2-4859-8ec4-7f51186342cf</serial>
Nov 13 10:21:03 user nova-compute[74611]: </disk>
Nov 13 10:21:03 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:21:03 user nova-compute[74611]: INFO os_vif [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d1:12,bridge_name='br-int',has_traffic_filtering=True,id=96ed6226-9881-4921-acd9-c8e3f9c9a998,network=Network(597806f6-dbbe-48ea-abed-40e5c60e8974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ed6226-98')
Nov 13 10:21:03 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Deleting instance files /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96_del
Nov 13 10:21:03 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Deletion of /opt/stack/data/nova/instances/37f7dc97-436e-4427-9fc0-5ec60e446e96_del complete
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 770d57de-444b-42d1-824b-85e881fe76dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance cf3e7269-8b6b-4a74-af7d-46ea14f02e10 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 37f7dc97-436e-4427-9fc0-5ec60e446e96 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:21:03 user nova-compute[74611]: INFO nova.compute.manager [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 13 10:21:03 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:21:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:21:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:21:04 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] No VIF found with MAC fa:16:3e:96:cb:62, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:21:04 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:21:04 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Took 0.47 seconds to deallocate network for instance.
Nov 13 10:21:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-a54b3478-0c5e-4113-bee1-be745202e2f4 req-5d845297-b90f-404b-aba8-ff9a276d1301 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Received event network-vif-deleted-96ed6226-9881-4921-acd9-c8e3f9c9a998 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:21:04 user nova-compute[74611]: INFO nova.compute.manager [req-a54b3478-0c5e-4113-bee1-be745202e2f4 req-5d845297-b90f-404b-aba8-ff9a276d1301 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Neutron deleted interface 96ed6226-9881-4921-acd9-c8e3f9c9a998; detaching it from the instance and deleting it from the info cache
Nov 13 10:21:04 user nova-compute[74611]: DEBUG nova.network.neutron [req-a54b3478-0c5e-4113-bee1-be745202e2f4 req-5d845297-b90f-404b-aba8-ff9a276d1301 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:21:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-71c762a8-dc6c-4785-9560-c9d40942b10f tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.260s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-a54b3478-0c5e-4113-bee1-be745202e2f4 req-5d845297-b90f-404b-aba8-ff9a276d1301 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Detach interface failed, port_id=96ed6226-9881-4921-acd9-c8e3f9c9a998, reason: Instance 37f7dc97-436e-4427-9fc0-5ec60e446e96 could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 10:21:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:04 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:21:04 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:21:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:04 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Deleted allocations for instance 37f7dc97-436e-4427-9fc0-5ec60e446e96
Nov 13 10:21:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3af5cd4a-6f93-4a44-b257-03b21e1c5354 tempest-VolumesNegativeTest-401987712 tempest-VolumesNegativeTest-401987712-project-member] Lock "37f7dc97-436e-4427-9fc0-5ec60e446e96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.931s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa1a2d78-aab4-4977-a70f-051779010d98 req-6cd8d322-a8f3-4f55-8a39-229342df31e6 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Received event network-vif-plugged-96ed6226-9881-4921-acd9-c8e3f9c9a998 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:21:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa1a2d78-aab4-4977-a70f-051779010d98 req-6cd8d322-a8f3-4f55-8a39-229342df31e6 service nova] Acquiring lock "37f7dc97-436e-4427-9fc0-5ec60e446e96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa1a2d78-aab4-4977-a70f-051779010d98 req-6cd8d322-a8f3-4f55-8a39-229342df31e6 service nova] Lock "37f7dc97-436e-4427-9fc0-5ec60e446e96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-aa1a2d78-aab4-4977-a70f-051779010d98 req-6cd8d322-a8f3-4f55-8a39-229342df31e6 service nova] Lock "37f7dc97-436e-4427-9fc0-5ec60e446e96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:05 user nova-compute[74611]: DEBUG nova.compute.manager [req-aa1a2d78-aab4-4977-a70f-051779010d98 req-6cd8d322-a8f3-4f55-8a39-229342df31e6 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] No waiting events found dispatching network-vif-plugged-96ed6226-9881-4921-acd9-c8e3f9c9a998 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:21:05 user nova-compute[74611]: WARNING nova.compute.manager [req-aa1a2d78-aab4-4977-a70f-051779010d98 req-6cd8d322-a8f3-4f55-8a39-229342df31e6 service nova] [instance: 37f7dc97-436e-4427-9fc0-5ec60e446e96] Received unexpected event network-vif-plugged-96ed6226-9881-4921-acd9-c8e3f9c9a998 for instance with vm_state deleted and task_state None.
Nov 13 10:21:07 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:21:07 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:21:07 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:21:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:21:09 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid 770d57de-444b-42d1-824b-85e881fe76dd {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:21:09 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:21:09 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Triggering sync for uuid cf3e7269-8b6b-4a74-af7d-46ea14f02e10 {{(pid=74611) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 10:21:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "770d57de-444b-42d1-824b-85e881fe76dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "770d57de-444b-42d1-824b-85e881fe76dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:11 user nova-compute[74611]: INFO nova.compute.manager [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Detaching volume 5addc1a5-8bc2-4859-8ec4-7f51186342cf
Nov 13 10:21:11 user nova-compute[74611]: INFO nova.virt.block_device [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Attempting to driver detach volume 5addc1a5-8bc2-4859-8ec4-7f51186342cf from mountpoint /dev/vdb
Nov 13 10:21:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Attempting to detach device vdb from instance cf3e7269-8b6b-4a74-af7d-46ea14f02e10 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:21:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:21:11 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:21:11 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:21:11 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:21:11 user nova-compute[74611]:   <serial>5addc1a5-8bc2-4859-8ec4-7f51186342cf</serial>
Nov 13 10:21:11 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:21:11 user nova-compute[74611]: </disk>
Nov 13 10:21:11 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:21:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:11 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Successfully detached device vdb from instance cf3e7269-8b6b-4a74-af7d-46ea14f02e10 from the persistent domain config.
Nov 13 10:21:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cf3e7269-8b6b-4a74-af7d-46ea14f02e10 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:21:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:21:11 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:21:11 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:21:11 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:21:11 user nova-compute[74611]:   <serial>5addc1a5-8bc2-4859-8ec4-7f51186342cf</serial>
Nov 13 10:21:11 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:21:11 user nova-compute[74611]: </disk>
Nov 13 10:21:11 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:21:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cf3e7269-8b6b-4a74-af7d-46ea14f02e10 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:21:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:21:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:24 user nova-compute[74611]: DEBUG nova.compute.manager [req-c9578756-fbb8-43fa-9cfa-fbcdf6ff2d02 req-fd47d477-bc9b-4f9d-b231-3b61c9b06be7 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received event network-changed-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:21:24 user nova-compute[74611]: DEBUG nova.compute.manager [req-c9578756-fbb8-43fa-9cfa-fbcdf6ff2d02 req-fd47d477-bc9b-4f9d-b231-3b61c9b06be7 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Refreshing instance network info cache due to event network-changed-9968045c-515a-4b9e-bc0f-26fd2939af52. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:21:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9578756-fbb8-43fa-9cfa-fbcdf6ff2d02 req-fd47d477-bc9b-4f9d-b231-3b61c9b06be7 service nova] Acquiring lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:21:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9578756-fbb8-43fa-9cfa-fbcdf6ff2d02 req-fd47d477-bc9b-4f9d-b231-3b61c9b06be7 service nova] Acquired lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:21:24 user nova-compute[74611]: DEBUG nova.network.neutron [req-c9578756-fbb8-43fa-9cfa-fbcdf6ff2d02 req-fd47d477-bc9b-4f9d-b231-3b61c9b06be7 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Refreshing network info cache for port 9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:21:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:25 user nova-compute[74611]: DEBUG nova.network.neutron [req-c9578756-fbb8-43fa-9cfa-fbcdf6ff2d02 req-fd47d477-bc9b-4f9d-b231-3b61c9b06be7 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updated VIF entry in instance network info cache for port 9968045c-515a-4b9e-bc0f-26fd2939af52. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:21:25 user nova-compute[74611]: DEBUG nova.network.neutron [req-c9578756-fbb8-43fa-9cfa-fbcdf6ff2d02 req-fd47d477-bc9b-4f9d-b231-3b61c9b06be7 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updating instance_info_cache with network_info: [{"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:21:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9578756-fbb8-43fa-9cfa-fbcdf6ff2d02 req-fd47d477-bc9b-4f9d-b231-3b61c9b06be7 service nova] Releasing lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:21:25 user nova-compute[74611]: DEBUG nova.compute.manager [req-c0f5aa73-b8d8-42ec-9e76-880b01bee794 req-960d493d-1501-4265-88a3-08687fb5eb4c service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received event network-changed-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:21:25 user nova-compute[74611]: DEBUG nova.compute.manager [req-c0f5aa73-b8d8-42ec-9e76-880b01bee794 req-960d493d-1501-4265-88a3-08687fb5eb4c service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Refreshing instance network info cache due to event network-changed-9968045c-515a-4b9e-bc0f-26fd2939af52. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:21:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c0f5aa73-b8d8-42ec-9e76-880b01bee794 req-960d493d-1501-4265-88a3-08687fb5eb4c service nova] Acquiring lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:21:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c0f5aa73-b8d8-42ec-9e76-880b01bee794 req-960d493d-1501-4265-88a3-08687fb5eb4c service nova] Acquired lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:21:25 user nova-compute[74611]: DEBUG nova.network.neutron [req-c0f5aa73-b8d8-42ec-9e76-880b01bee794 req-960d493d-1501-4265-88a3-08687fb5eb4c service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Refreshing network info cache for port 9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:21:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:25 user nova-compute[74611]: INFO nova.compute.manager [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Detaching volume ed9bdcdb-3b0b-457e-a004-c545041aaebb
Nov 13 10:21:25 user nova-compute[74611]: INFO nova.virt.block_device [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Attempting to driver detach volume ed9bdcdb-3b0b-457e-a004-c545041aaebb from mountpoint /dev/vdb
Nov 13 10:21:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Attempting to detach device vdb from instance 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:21:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:21:25 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:21:25 user nova-compute[74611]:   <source dev="/dev/sdc"/>
Nov 13 10:21:25 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:21:25 user nova-compute[74611]:   <serial>ed9bdcdb-3b0b-457e-a004-c545041aaebb</serial>
Nov 13 10:21:25 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:21:25 user nova-compute[74611]: </disk>
Nov 13 10:21:25 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:21:25 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Successfully detached device vdb from instance 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 from the persistent domain config.
Nov 13 10:21:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:21:25 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:21:25 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:21:25 user nova-compute[74611]:   <source dev="/dev/sdc"/>
Nov 13 10:21:25 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:21:25 user nova-compute[74611]:   <serial>ed9bdcdb-3b0b-457e-a004-c545041aaebb</serial>
Nov 13 10:21:25 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:21:25 user nova-compute[74611]: </disk>
Nov 13 10:21:25 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:21:25 user nova-compute[74611]: DEBUG nova.network.neutron [req-c0f5aa73-b8d8-42ec-9e76-880b01bee794 req-960d493d-1501-4265-88a3-08687fb5eb4c service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updated VIF entry in instance network info cache for port 9968045c-515a-4b9e-bc0f-26fd2939af52. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:21:25 user nova-compute[74611]: DEBUG nova.network.neutron [req-c0f5aa73-b8d8-42ec-9e76-880b01bee794 req-960d493d-1501-4265-88a3-08687fb5eb4c service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updating instance_info_cache with network_info: [{"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:21:25 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c0f5aa73-b8d8-42ec-9e76-880b01bee794 req-960d493d-1501-4265-88a3-08687fb5eb4c service nova] Releasing lock "refresh_cache-9a5efe38-ddcc-4326-b965-6c73e99fd4c6" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:21:26 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:21:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "770d57de-444b-42d1-824b-85e881fe76dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:27 user nova-compute[74611]: INFO nova.compute.manager [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Terminating instance
Nov 13 10:21:27 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:21:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-7338b3bf-14dd-4086-8c85-dad4cc3b631a req-c923bd4d-d1d3-4eb1-9ee3-ae842105153e service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-vif-unplugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:21:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7338b3bf-14dd-4086-8c85-dad4cc3b631a req-c923bd4d-d1d3-4eb1-9ee3-ae842105153e service nova] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7338b3bf-14dd-4086-8c85-dad4cc3b631a req-c923bd4d-d1d3-4eb1-9ee3-ae842105153e service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:27 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7338b3bf-14dd-4086-8c85-dad4cc3b631a req-c923bd4d-d1d3-4eb1-9ee3-ae842105153e service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-7338b3bf-14dd-4086-8c85-dad4cc3b631a req-c923bd4d-d1d3-4eb1-9ee3-ae842105153e service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] No waiting events found dispatching network-vif-unplugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:21:27 user nova-compute[74611]: DEBUG nova.compute.manager [req-7338b3bf-14dd-4086-8c85-dad4cc3b631a req-c923bd4d-d1d3-4eb1-9ee3-ae842105153e service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-vif-unplugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:21:28 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Instance destroyed successfully.
Nov 13 10:21:28 user nova-compute[74611]: DEBUG nova.objects.instance [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lazy-loading 'resources' on Instance uuid 770d57de-444b-42d1-824b-85e881fe76dd {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:21:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1693136491',display_name='tempest-ServerStableDeviceRescueTest-server-1693136491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1693136491',id=45,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxx5CqNADL2t5RNQuLp8M/DypFH1AecFisERGdt7rpr81WdBBxeANwcGv/OvZt5GFrbAkWwQpH9EmJNr3Nou07IZ02A/lxpyNtIglcJGILVDfJMeKuRnbD27Oo2AmLnBg==',key_name='tempest-keypair-2131338815',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:18:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9dc437b4d074101a113b7bca634ed0e',ramdisk_id='',reservation_id='r-pekagm9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1937011099',owner_user_name='tempest-ServerStableDeviceRescueTest-1937011099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:20:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f6b2b1ceae486a9be5af84dc08de7c',uuid=770d57de-444b-42d1-824b-85e881fe76dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:21:28 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Converting VIF {"id": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "address": "fa:16:3e:7f:45:a6", "network": {"id": "72f44b48-dbe8-4430-93ac-6b4c67c195ee", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1432684206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9dc437b4d074101a113b7bca634ed0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3a02b77-48", "ovs_interfaceid": "a3a02b77-480a-4ffe-a8da-f0bda6e70f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:21:28 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:45:a6,bridge_name='br-int',has_traffic_filtering=True,id=a3a02b77-480a-4ffe-a8da-f0bda6e70f57,network=Network(72f44b48-dbe8-4430-93ac-6b4c67c195ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3a02b77-48') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:21:28 user nova-compute[74611]: DEBUG os_vif [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:45:a6,bridge_name='br-int',has_traffic_filtering=True,id=a3a02b77-480a-4ffe-a8da-f0bda6e70f57,network=Network(72f44b48-dbe8-4430-93ac-6b4c67c195ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3a02b77-48') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:21:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3a02b77-48, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:21:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=876b34cb-151a-42a6-a78b-6d1f5d5b7e5f) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:21:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:28 user nova-compute[74611]: INFO os_vif [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:45:a6,bridge_name='br-int',has_traffic_filtering=True,id=a3a02b77-480a-4ffe-a8da-f0bda6e70f57,network=Network(72f44b48-dbe8-4430-93ac-6b4c67c195ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3a02b77-48')
Nov 13 10:21:28 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Deleting instance files /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd_del
Nov 13 10:21:28 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Deletion of /opt/stack/data/nova/instances/770d57de-444b-42d1-824b-85e881fe76dd_del complete
Nov 13 10:21:28 user nova-compute[74611]: INFO nova.compute.manager [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 13 10:21:28 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:21:28 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:21:28 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:21:29 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:21:29 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Took 0.77 seconds to deallocate network for instance.
Nov 13 10:21:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-41acba73-1112-4a30-bcca-d6ab4933ee3c req-ae407283-73b6-443c-a67b-10fbc5e0e3f3 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-vif-deleted-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:21:29 user nova-compute[74611]: INFO nova.compute.manager [req-41acba73-1112-4a30-bcca-d6ab4933ee3c req-ae407283-73b6-443c-a67b-10fbc5e0e3f3 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Neutron deleted interface a3a02b77-480a-4ffe-a8da-f0bda6e70f57; detaching it from the instance and deleting it from the info cache
Nov 13 10:21:29 user nova-compute[74611]: DEBUG nova.network.neutron [req-41acba73-1112-4a30-bcca-d6ab4933ee3c req-ae407283-73b6-443c-a67b-10fbc5e0e3f3 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:21:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-41acba73-1112-4a30-bcca-d6ab4933ee3c req-ae407283-73b6-443c-a67b-10fbc5e0e3f3 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Detach interface failed, port_id=a3a02b77-480a-4ffe-a8da-f0bda6e70f57, reason: Instance 770d57de-444b-42d1-824b-85e881fe76dd could not be found. {{(pid=74611) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 10:21:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:29 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:21:29 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:21:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:29 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Deleted allocations for instance 770d57de-444b-42d1-824b-85e881fe76dd
Nov 13 10:21:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ab36ed99-733a-42ec-a8d8-84f73640492e tempest-ServerStableDeviceRescueTest-1937011099 tempest-ServerStableDeviceRescueTest-1937011099-project-member] Lock "770d57de-444b-42d1-824b-85e881fe76dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.040s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-abfb1231-1505-46d4-9fc6-c85879183043 req-f263c827-7c0d-4d90-8ddc-483690965056 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:21:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-abfb1231-1505-46d4-9fc6-c85879183043 req-f263c827-7c0d-4d90-8ddc-483690965056 service nova] Acquiring lock "770d57de-444b-42d1-824b-85e881fe76dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-abfb1231-1505-46d4-9fc6-c85879183043 req-f263c827-7c0d-4d90-8ddc-483690965056 service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-abfb1231-1505-46d4-9fc6-c85879183043 req-f263c827-7c0d-4d90-8ddc-483690965056 service nova] Lock "770d57de-444b-42d1-824b-85e881fe76dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:29 user nova-compute[74611]: DEBUG nova.compute.manager [req-abfb1231-1505-46d4-9fc6-c85879183043 req-f263c827-7c0d-4d90-8ddc-483690965056 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] No waiting events found dispatching network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:21:29 user nova-compute[74611]: WARNING nova.compute.manager [req-abfb1231-1505-46d4-9fc6-c85879183043 req-f263c827-7c0d-4d90-8ddc-483690965056 service nova] [instance: 770d57de-444b-42d1-824b-85e881fe76dd] Received unexpected event network-vif-plugged-a3a02b77-480a-4ffe-a8da-f0bda6e70f57 for instance with vm_state deleted and task_state None.
Nov 13 10:21:32 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cf3e7269-8b6b-4a74-af7d-46ea14f02e10 is timed out.
Nov 13 10:21:32 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Successfully detached device vdb from instance cf3e7269-8b6b-4a74-af7d-46ea14f02e10 from the live domain config.
Nov 13 10:21:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqMrpmcR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:21:32 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca1ff66-fa6e-4818-a463-3232e0df742a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:21:32 user nova-compute[74611]: No targets found.
Nov 13 10:21:32 user nova-compute[74611]: iSNS:
Nov 13 10:21:32 user nova-compute[74611]: No targets found.
Nov 13 10:21:32 user nova-compute[74611]: STATIC:
Nov 13 10:21:32 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb
Nov 13 10:21:32 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:21:32 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:21:32 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf
Nov 13 10:21:32 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:21:32 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:21:32 user nova-compute[74611]: FIRMWARE:
Nov 13 10:21:32 user nova-compute[74611]: No targets found.
Nov 13 10:21:32 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:21:32 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:21:32 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed56d31-ba39-48e3-872b-a3ca92d50aa3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[882e50d3-c139-4ceb-93f8-63f02dece650]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)
Nov 13 10:21:32 user nova-compute[74611]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf (non-flash)
Nov 13 10:21:32 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)
Nov 13 10:21:32 user nova-compute[74611]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf (non-flash)
Nov 13 10:21:32 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb84374d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[de60c9e8-6ae1-4416-8f22-0e666c2c9138]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed24f005-8097-49a5-ae15-0ddb17bba6d6]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11e3271-5f7c-4f64-aeb7-23601cef92bd]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2f146c-c508-416c-9ebf-6610fffe1187]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2973168c-123b-43cd-98d7-88f9284df83a]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa44bd5-dbfc-4dbc-86f5-eb06670bfda4]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf, portal: 172.16.0.220,3260]
Nov 13 10:21:32 user nova-compute[74611]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf, portal: 172.16.0.220,3260] successful.
Nov 13 10:21:32 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c59dee1-a487-4652-ad89-80be4f25f835]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] <== disconnect_volume: return (271ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:21:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lazy-loading 'flavor' on Instance uuid cf3e7269-8b6b-4a74-af7d-46ea14f02e10 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6aa6b5bd-daf7-489a-84a8-5d20e38df46c tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.691s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.592s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:33 user nova-compute[74611]: INFO nova.compute.manager [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Terminating instance
Nov 13 10:21:33 user nova-compute[74611]: DEBUG nova.compute.manager [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-4f9cbb37-8ef8-4d40-b641-73a6953afad9 req-d9a5b3d0-2eec-4054-b6ca-3f7efbd0c6e5 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Received event network-vif-unplugged-463649db-b2c4-4d56-a440-9f9d86999568 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4f9cbb37-8ef8-4d40-b641-73a6953afad9 req-d9a5b3d0-2eec-4054-b6ca-3f7efbd0c6e5 service nova] Acquiring lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4f9cbb37-8ef8-4d40-b641-73a6953afad9 req-d9a5b3d0-2eec-4054-b6ca-3f7efbd0c6e5 service nova] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4f9cbb37-8ef8-4d40-b641-73a6953afad9 req-d9a5b3d0-2eec-4054-b6ca-3f7efbd0c6e5 service nova] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-4f9cbb37-8ef8-4d40-b641-73a6953afad9 req-d9a5b3d0-2eec-4054-b6ca-3f7efbd0c6e5 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] No waiting events found dispatching network-vif-unplugged-463649db-b2c4-4d56-a440-9f9d86999568 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:21:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-4f9cbb37-8ef8-4d40-b641-73a6953afad9 req-d9a5b3d0-2eec-4054-b6ca-3f7efbd0c6e5 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Received event network-vif-unplugged-463649db-b2c4-4d56-a440-9f9d86999568 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:21:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Instance destroyed successfully.
Nov 13 10:21:34 user nova-compute[74611]: DEBUG nova.objects.instance [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lazy-loading 'resources' on Instance uuid cf3e7269-8b6b-4a74-af7d-46ea14f02e10 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1771186759',display_name='tempest-VolumesSnapshotTestJSON-instance-1771186759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1771186759',id=48,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3zsLtvH8jL69knliJpqLf08ZRF04enjsH8cq6VAcN0lA39VCm/mxGu7NjnoQbzm93M5cprCLzDumFKULhU2QYPXlDR/4C5JsbOvXPKf2lvLpvmdQaVOoAFbmGYV/w0w==',key_name='tempest-keypair-1309784651',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:19:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc5da31f2854f4082c6d4b2d344d27a',ramdisk_id='',reservation_id='r-21t7n0h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-928671223',owner_user_name='tempest-VolumesSnapshotTestJSON-928671223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea494122b4f5499cbdcdb6c31e464074',uuid=cf3e7269-8b6b-4a74-af7d-46ea14f02e10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "463649db-b2c4-4d56-a440-9f9d86999568", "address": "fa:16:3e:96:cb:62", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463649db-b2", "ovs_interfaceid": "463649db-b2c4-4d56-a440-9f9d86999568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Converting VIF {"id": "463649db-b2c4-4d56-a440-9f9d86999568", "address": "fa:16:3e:96:cb:62", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463649db-b2", "ovs_interfaceid": "463649db-b2c4-4d56-a440-9f9d86999568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:cb:62,bridge_name='br-int',has_traffic_filtering=True,id=463649db-b2c4-4d56-a440-9f9d86999568,network=Network(e858906b-3909-45ae-856f-ac715040a03f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463649db-b2') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG os_vif [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:cb:62,bridge_name='br-int',has_traffic_filtering=True,id=463649db-b2c4-4d56-a440-9f9d86999568,network=Network(e858906b-3909-45ae-856f-ac715040a03f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463649db-b2') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap463649db-b2, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a43d25b6-7bf3-477c-93f8-e4b2e29be5db) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:34 user nova-compute[74611]: INFO os_vif [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:cb:62,bridge_name='br-int',has_traffic_filtering=True,id=463649db-b2c4-4d56-a440-9f9d86999568,network=Network(e858906b-3909-45ae-856f-ac715040a03f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463649db-b2')
Nov 13 10:21:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqMrpmcR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:21:34 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:21:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3b98d4-3a60-4d60-92c9-3e0197d01376]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:21:34 user nova-compute[74611]: No targets found.
Nov 13 10:21:34 user nova-compute[74611]: iSNS:
Nov 13 10:21:34 user nova-compute[74611]: No targets found.
Nov 13 10:21:34 user nova-compute[74611]: STATIC:
Nov 13 10:21:34 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb
Nov 13 10:21:34 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:21:34 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:21:34 user nova-compute[74611]: FIRMWARE:
Nov 13 10:21:34 user nova-compute[74611]: No targets found.
Nov 13 10:21:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:21:34 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:21:34 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5addc1a5-8bc2-4859-8ec4-7f51186342cf', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a51abef-aaad-4343-b36a-110b1883c316]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c2dec9-b2ac-44cc-a1f6-8aee33e5a751]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)
Nov 13 10:21:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)
Nov 13 10:21:34 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64684820>, {}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Disconnecting from: [] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] <== disconnect_volume: return (73ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:21:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Deleting instance files /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10_del
Nov 13 10:21:34 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Deletion of /opt/stack/data/nova/instances/cf3e7269-8b6b-4a74-af7d-46ea14f02e10_del complete
Nov 13 10:21:34 user nova-compute[74611]: INFO nova.compute.manager [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 13 10:21:34 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:21:34 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:21:35 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:21:35 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Took 0.64 seconds to deallocate network for instance.
Nov 13 10:21:35 user nova-compute[74611]: WARNING nova.volume.cinder [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Attachment bc16420a-8b6f-4cf1-8563-d20c03b56793 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = bc16420a-8b6f-4cf1-8563-d20c03b56793. (HTTP 404) (Request-ID: req-c3faaae1-589e-45c3-8897-2eb037190bcb)
Nov 13 10:21:35 user nova-compute[74611]: INFO nova.compute.manager [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Took 0.02 seconds to detach 1 volumes for instance.
Nov 13 10:21:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:35 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:21:35 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:21:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:35 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Deleted allocations for instance cf3e7269-8b6b-4a74-af7d-46ea14f02e10
Nov 13 10:21:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-aedbdf30-0e98-4b7e-99bd-e9c45de3e5bd tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.904s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-d640fd5c-7cf7-4074-b836-34d2ba3d7af2 req-af992e77-e6f6-4015-9620-6136234a3552 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Received event network-vif-plugged-463649db-b2c4-4d56-a440-9f9d86999568 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:21:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d640fd5c-7cf7-4074-b836-34d2ba3d7af2 req-af992e77-e6f6-4015-9620-6136234a3552 service nova] Acquiring lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:21:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d640fd5c-7cf7-4074-b836-34d2ba3d7af2 req-af992e77-e6f6-4015-9620-6136234a3552 service nova] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:21:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d640fd5c-7cf7-4074-b836-34d2ba3d7af2 req-af992e77-e6f6-4015-9620-6136234a3552 service nova] Lock "cf3e7269-8b6b-4a74-af7d-46ea14f02e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-d640fd5c-7cf7-4074-b836-34d2ba3d7af2 req-af992e77-e6f6-4015-9620-6136234a3552 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] No waiting events found dispatching network-vif-plugged-463649db-b2c4-4d56-a440-9f9d86999568 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:21:35 user nova-compute[74611]: WARNING nova.compute.manager [req-d640fd5c-7cf7-4074-b836-34d2ba3d7af2 req-af992e77-e6f6-4015-9620-6136234a3552 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Received unexpected event network-vif-plugged-463649db-b2c4-4d56-a440-9f9d86999568 for instance with vm_state deleted and task_state None.
Nov 13 10:21:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-d640fd5c-7cf7-4074-b836-34d2ba3d7af2 req-af992e77-e6f6-4015-9620-6136234a3552 service nova] [instance: cf3e7269-8b6b-4a74-af7d-46ea14f02e10] Received event network-vif-deleted-463649db-b2c4-4d56-a440-9f9d86999568 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:21:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:21:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:21:46 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 is timed out.
Nov 13 10:21:46 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Successfully detached device vdb from instance 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 from the live domain config.
Nov 13 10:21:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLNsjSut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:21:46 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd592418-c625-4905-ba28-1fbdbac500db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:21:46 user nova-compute[74611]: No targets found.
Nov 13 10:21:46 user nova-compute[74611]: iSNS:
Nov 13 10:21:46 user nova-compute[74611]: No targets found.
Nov 13 10:21:46 user nova-compute[74611]: STATIC:
Nov 13 10:21:46 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb
Nov 13 10:21:46 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:21:46 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:21:46 user nova-compute[74611]: FIRMWARE:
Nov 13 10:21:46 user nova-compute[74611]: No targets found.
Nov 13 10:21:46 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:21:46 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:21:46 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f655cfce-787f-4860-a2ae-23a7ea7392f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[12293cfa-e94e-4930-8f49-d546525dae0d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)
Nov 13 10:21:46 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb (non-flash)
Nov 13 10:21:46 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64248c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb'): ({'sdc'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Removing single pathed devices sdc {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a965ff6-6cd6-4c24-a76b-1912a580ccc0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[46adadeb-0180-4a4c-b688-eb9b4a1441fa]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Flushing IO for device /dev/sdc {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8171808b-03f5-4cc4-bf2d-ddebfb02b3bc]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b3b867-906a-4f1b-a135-41bdf87f891b]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] SCSI volumes sdc have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce805ae-a9ae-4739-85e0-ea40f8b7a583]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4d2f75-322c-4e60-8966-5707fe7f411e]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb, portal: 172.16.0.220,3260]
Nov 13 10:21:46 user nova-compute[74611]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb, portal: 172.16.0.220,3260] successful.
Nov 13 10:21:46 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9bdcdb-3b0b-457e-a004-c545041aaebb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[73647927-5b0c-446d-852e-b5eb12e201c2]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] <== disconnect_volume: return (275ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:21:46 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:21:47 user nova-compute[74611]: DEBUG nova.objects.instance [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lazy-loading 'flavor' on Instance uuid 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:21:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-5b46641d-1978-457d-8aa5-0806e4a24a32 tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.583s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:21:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:21:53 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:21:53 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:21:53 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Didn't find any instances for network info cache update. {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 10:21:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:21:58 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:21:58 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:21:58 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:21:58 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:21:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:01 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:22:01 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:22:03 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:22:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:22:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:22:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:22:03 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:22:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:22:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:22:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:22:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:22:04 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:22:04 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:22:04 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8893MB free_disk=25.189788818359375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:22:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:22:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:22:04 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:22:04 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:22:04 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:22:04 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:22:04 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:22:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:22:04 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:22:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:22:06 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:22:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:08 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:22:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:22:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:22:10 user nova-compute[74611]: INFO nova.compute.claims [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Claim successful on node user
Nov 13 10:22:10 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:22:10 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:22:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG nova.policy [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea494122b4f5499cbdcdb6c31e464074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc5da31f2854f4082c6d4b2d344d27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:22:10 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Creating image(s)
Nov 13 10:22:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "/opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "/opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:22:10 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.192s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.193s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk 1073741824" returned: 0 in 0.055s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Successfully created port: 92fb7e25-7410-4853-ae8c-ad9a8033f947 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Cannot resize image /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Ensure instance console log exists: /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:22:11 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Successfully updated port: 92fb7e25-7410-4853-ae8c-ad9a8033f947 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "refresh_cache-8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquired lock "refresh_cache-8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-92d6f5a5-d6b9-44f0-941f-79c5d8f26ef0 req-19cf2b76-c3e5-47d8-900d-d54cf4a74f4f service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Received event network-changed-92fb7e25-7410-4853-ae8c-ad9a8033f947 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.compute.manager [req-92d6f5a5-d6b9-44f0-941f-79c5d8f26ef0 req-19cf2b76-c3e5-47d8-900d-d54cf4a74f4f service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Refreshing instance network info cache due to event network-changed-92fb7e25-7410-4853-ae8c-ad9a8033f947. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-92d6f5a5-d6b9-44f0-941f-79c5d8f26ef0 req-19cf2b76-c3e5-47d8-900d-d54cf4a74f4f service nova] Acquiring lock "refresh_cache-8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.network.neutron [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Updating instance_info_cache with network_info: [{"id": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "address": "fa:16:3e:e1:f1:03", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fb7e25-74", "ovs_interfaceid": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Releasing lock "refresh_cache-8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Instance network_info: |[{"id": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "address": "fa:16:3e:e1:f1:03", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fb7e25-74", "ovs_interfaceid": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-92d6f5a5-d6b9-44f0-941f-79c5d8f26ef0 req-19cf2b76-c3e5-47d8-900d-d54cf4a74f4f service nova] Acquired lock "refresh_cache-8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.network.neutron [req-92d6f5a5-d6b9-44f0-941f-79c5d8f26ef0 req-19cf2b76-c3e5-47d8-900d-d54cf4a74f4f service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Refreshing network info cache for port 92fb7e25-7410-4853-ae8c-ad9a8033f947 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Start _get_guest_xml network_info=[{"id": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "address": "fa:16:3e:e1:f1:03", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fb7e25-74", "ovs_interfaceid": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:22:12 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:22:12 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-521850251',display_name='tempest-VolumesSnapshotTestJSON-instance-521850251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-521850251',id=50,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZUVRNmTDlGdnmBASAoH7yUYaRrcX5qSAXDLXD1Umq4VaqaxUDViHW7nJ4lpXxekTPcV0Yjx+EAIdAlDAFpLh2PrnyOdPyQTSiDnQI6P2U1agzggZpQscoOJ+Ydm7B8WA==',key_name='tempest-keypair-877514124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc5da31f2854f4082c6d4b2d344d27a',ramdisk_id='',reservation_id='r-hgjccd2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-928671223',owner_user_name='tempest-VolumesSnapshotTestJSON-928671223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:22:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea494122b4f5499cbdcdb6c31e464074',uuid=8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "address": "fa:16:3e:e1:f1:03", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fb7e25-74", "ovs_interfaceid": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Converting VIF {"id": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "address": "fa:16:3e:e1:f1:03", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fb7e25-74", "ovs_interfaceid": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f1:03,bridge_name='br-int',has_traffic_filtering=True,id=92fb7e25-7410-4853-ae8c-ad9a8033f947,network=Network(e858906b-3909-45ae-856f-ac715040a03f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92fb7e25-74') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.objects.instance [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:22:12 user nova-compute[74611]:   <uuid>8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4</uuid>
Nov 13 10:22:12 user nova-compute[74611]:   <name>instance-00000032</name>
Nov 13 10:22:12 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:22:12 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:22:12 user nova-compute[74611]:   <metadata>
Nov 13 10:22:12 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:22:12 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:22:12 user nova-compute[74611]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-521850251</nova:name>
Nov 13 10:22:12 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:22:12</nova:creationTime>
Nov 13 10:22:12 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:22:12 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:22:12 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:22:12 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:22:12 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:22:12 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:22:12 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:22:12 user nova-compute[74611]:       <nova:owner>
Nov 13 10:22:12 user nova-compute[74611]:         <nova:user uuid="ea494122b4f5499cbdcdb6c31e464074">tempest-VolumesSnapshotTestJSON-928671223-project-member</nova:user>
Nov 13 10:22:12 user nova-compute[74611]:         <nova:project uuid="ebc5da31f2854f4082c6d4b2d344d27a">tempest-VolumesSnapshotTestJSON-928671223</nova:project>
Nov 13 10:22:12 user nova-compute[74611]:       </nova:owner>
Nov 13 10:22:12 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:22:12 user nova-compute[74611]:       <nova:ports>
Nov 13 10:22:12 user nova-compute[74611]:         <nova:port uuid="92fb7e25-7410-4853-ae8c-ad9a8033f947">
Nov 13 10:22:12 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 10:22:12 user nova-compute[74611]:         </nova:port>
Nov 13 10:22:12 user nova-compute[74611]:       </nova:ports>
Nov 13 10:22:12 user nova-compute[74611]:     </nova:instance>
Nov 13 10:22:12 user nova-compute[74611]:   </metadata>
Nov 13 10:22:12 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:22:12 user nova-compute[74611]:     <system>
Nov 13 10:22:12 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:22:12 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:22:12 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:22:12 user nova-compute[74611]:       <entry name="serial">8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4</entry>
Nov 13 10:22:12 user nova-compute[74611]:       <entry name="uuid">8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4</entry>
Nov 13 10:22:12 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:22:12 user nova-compute[74611]:     </system>
Nov 13 10:22:12 user nova-compute[74611]:   </sysinfo>
Nov 13 10:22:12 user nova-compute[74611]:   <os>
Nov 13 10:22:12 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:22:12 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:22:12 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:22:12 user nova-compute[74611]:   </os>
Nov 13 10:22:12 user nova-compute[74611]:   <features>
Nov 13 10:22:12 user nova-compute[74611]:     <acpi/>
Nov 13 10:22:12 user nova-compute[74611]:     <apic/>
Nov 13 10:22:12 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:22:12 user nova-compute[74611]:   </features>
Nov 13 10:22:12 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:22:12 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:22:12 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:22:12 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:22:12 user nova-compute[74611]:   </clock>
Nov 13 10:22:12 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:22:12 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:22:12 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:22:12 user nova-compute[74611]:   </cpu>
Nov 13 10:22:12 user nova-compute[74611]:   <devices>
Nov 13 10:22:12 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:22:12 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:22:12 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk"/>
Nov 13 10:22:12 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:22:12 user nova-compute[74611]:     </disk>
Nov 13 10:22:12 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:22:12 user nova-compute[74611]:       <mac address="fa:16:3e:e1:f1:03"/>
Nov 13 10:22:12 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:22:12 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:22:12 user nova-compute[74611]:       <target dev="tap92fb7e25-74"/>
Nov 13 10:22:12 user nova-compute[74611]:     </interface>
Nov 13 10:22:12 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:22:12 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/console.log" append="off"/>
Nov 13 10:22:12 user nova-compute[74611]:     </serial>
Nov 13 10:22:12 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:22:12 user nova-compute[74611]:     <video>
Nov 13 10:22:12 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:22:12 user nova-compute[74611]:     </video>
Nov 13 10:22:12 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:22:12 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:22:12 user nova-compute[74611]:     </rng>
Nov 13 10:22:12 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:22:12 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:22:12 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:22:12 user nova-compute[74611]:     </memballoon>
Nov 13 10:22:12 user nova-compute[74611]:   </devices>
Nov 13 10:22:12 user nova-compute[74611]: </domain>
Nov 13 10:22:12 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-521850251',display_name='tempest-VolumesSnapshotTestJSON-instance-521850251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-521850251',id=50,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZUVRNmTDlGdnmBASAoH7yUYaRrcX5qSAXDLXD1Umq4VaqaxUDViHW7nJ4lpXxekTPcV0Yjx+EAIdAlDAFpLh2PrnyOdPyQTSiDnQI6P2U1agzggZpQscoOJ+Ydm7B8WA==',key_name='tempest-keypair-877514124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc5da31f2854f4082c6d4b2d344d27a',ramdisk_id='',reservation_id='r-hgjccd2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-928671223',owner_user_name='tempest-VolumesSnapshotTestJSON-928671223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:22:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea494122b4f5499cbdcdb6c31e464074',uuid=8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "address": "fa:16:3e:e1:f1:03", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fb7e25-74", "ovs_interfaceid": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Converting VIF {"id": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "address": "fa:16:3e:e1:f1:03", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fb7e25-74", "ovs_interfaceid": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f1:03,bridge_name='br-int',has_traffic_filtering=True,id=92fb7e25-7410-4853-ae8c-ad9a8033f947,network=Network(e858906b-3909-45ae-856f-ac715040a03f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92fb7e25-74') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG os_vif [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f1:03,bridge_name='br-int',has_traffic_filtering=True,id=92fb7e25-7410-4853-ae8c-ad9a8033f947,network=Network(e858906b-3909-45ae-856f-ac715040a03f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92fb7e25-74') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5844390-9d17-5857-be60-6716cc8132a4', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92fb7e25-74, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92fb7e25-74, col_values=(('qos', UUID('0e204b77-3525-413d-a430-5b3e12206e02')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92fb7e25-74, col_values=(('external_ids', {'iface-id': '92fb7e25-7410-4853-ae8c-ad9a8033f947', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:f1:03', 'vm-uuid': '8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:12 user nova-compute[74611]: INFO os_vif [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f1:03,bridge_name='br-int',has_traffic_filtering=True,id=92fb7e25-7410-4853-ae8c-ad9a8033f947,network=Network(e858906b-3909-45ae-856f-ac715040a03f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92fb7e25-74')
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] No VIF found with MAC fa:16:3e:e1:f1:03, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.network.neutron [req-92d6f5a5-d6b9-44f0-941f-79c5d8f26ef0 req-19cf2b76-c3e5-47d8-900d-d54cf4a74f4f service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Updated VIF entry in instance network info cache for port 92fb7e25-7410-4853-ae8c-ad9a8033f947. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG nova.network.neutron [req-92d6f5a5-d6b9-44f0-941f-79c5d8f26ef0 req-19cf2b76-c3e5-47d8-900d-d54cf4a74f4f service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Updating instance_info_cache with network_info: [{"id": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "address": "fa:16:3e:e1:f1:03", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fb7e25-74", "ovs_interfaceid": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:22:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-92d6f5a5-d6b9-44f0-941f-79c5d8f26ef0 req-19cf2b76-c3e5-47d8-900d-d54cf4a74f4f service nova] Releasing lock "refresh_cache-8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:22:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:13 user nova-compute[74611]: DEBUG nova.compute.manager [req-25ce1e5a-d06a-4dec-9e10-92669a544ac4 req-baa090a0-3291-49a9-a426-db3a90defbc8 service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Received event network-vif-plugged-92fb7e25-7410-4853-ae8c-ad9a8033f947 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:22:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-25ce1e5a-d06a-4dec-9e10-92669a544ac4 req-baa090a0-3291-49a9-a426-db3a90defbc8 service nova] Acquiring lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:22:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-25ce1e5a-d06a-4dec-9e10-92669a544ac4 req-baa090a0-3291-49a9-a426-db3a90defbc8 service nova] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:22:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-25ce1e5a-d06a-4dec-9e10-92669a544ac4 req-baa090a0-3291-49a9-a426-db3a90defbc8 service nova] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:22:13 user nova-compute[74611]: DEBUG nova.compute.manager [req-25ce1e5a-d06a-4dec-9e10-92669a544ac4 req-baa090a0-3291-49a9-a426-db3a90defbc8 service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] No waiting events found dispatching network-vif-plugged-92fb7e25-7410-4853-ae8c-ad9a8033f947 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:22:13 user nova-compute[74611]: WARNING nova.compute.manager [req-25ce1e5a-d06a-4dec-9e10-92669a544ac4 req-baa090a0-3291-49a9-a426-db3a90defbc8 service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Received unexpected event network-vif-plugged-92fb7e25-7410-4853-ae8c-ad9a8033f947 for instance with vm_state building and task_state spawning.
Nov 13 10:22:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:15 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:22:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:22:15 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Instance spawned successfully.
Nov 13 10:22:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:22:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:22:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:22:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:22:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:22:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:22:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:22:15 user nova-compute[74611]: DEBUG nova.compute.manager [req-db625a06-7d2a-417a-919b-b0b38cf42ab4 req-7d6c2f6c-14be-4db7-80ed-43121ebd4dd1 service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Received event network-vif-plugged-92fb7e25-7410-4853-ae8c-ad9a8033f947 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:22:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-db625a06-7d2a-417a-919b-b0b38cf42ab4 req-7d6c2f6c-14be-4db7-80ed-43121ebd4dd1 service nova] Acquiring lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:22:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-db625a06-7d2a-417a-919b-b0b38cf42ab4 req-7d6c2f6c-14be-4db7-80ed-43121ebd4dd1 service nova] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:22:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-db625a06-7d2a-417a-919b-b0b38cf42ab4 req-7d6c2f6c-14be-4db7-80ed-43121ebd4dd1 service nova] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:22:15 user nova-compute[74611]: DEBUG nova.compute.manager [req-db625a06-7d2a-417a-919b-b0b38cf42ab4 req-7d6c2f6c-14be-4db7-80ed-43121ebd4dd1 service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] No waiting events found dispatching network-vif-plugged-92fb7e25-7410-4853-ae8c-ad9a8033f947 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:22:15 user nova-compute[74611]: WARNING nova.compute.manager [req-db625a06-7d2a-417a-919b-b0b38cf42ab4 req-7d6c2f6c-14be-4db7-80ed-43121ebd4dd1 service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Received unexpected event network-vif-plugged-92fb7e25-7410-4853-ae8c-ad9a8033f947 for instance with vm_state building and task_state spawning.
Nov 13 10:22:15 user nova-compute[74611]: INFO nova.compute.manager [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 13 10:22:15 user nova-compute[74611]: DEBUG nova.compute.manager [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:22:16 user nova-compute[74611]: INFO nova.compute.manager [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Took 5.62 seconds to build instance.
Nov 13 10:22:16 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-6cfee5e0-34cf-4991-ba3f-7e6d2821f2c7 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.720s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:22:17 user nova-compute[74611]: INFO nova.compute.manager [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Terminating instance
Nov 13 10:22:17 user nova-compute[74611]: DEBUG nova.compute.manager [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG nova.compute.manager [req-c636a1c6-ee1a-4884-b45f-1f003a99804c req-3871b64a-5f94-42e5-8ecd-dd44b0f21fdd service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received event network-vif-unplugged-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c636a1c6-ee1a-4884-b45f-1f003a99804c req-3871b64a-5f94-42e5-8ecd-dd44b0f21fdd service nova] Acquiring lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c636a1c6-ee1a-4884-b45f-1f003a99804c req-3871b64a-5f94-42e5-8ecd-dd44b0f21fdd service nova] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c636a1c6-ee1a-4884-b45f-1f003a99804c req-3871b64a-5f94-42e5-8ecd-dd44b0f21fdd service nova] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG nova.compute.manager [req-c636a1c6-ee1a-4884-b45f-1f003a99804c req-3871b64a-5f94-42e5-8ecd-dd44b0f21fdd service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] No waiting events found dispatching network-vif-unplugged-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG nova.compute.manager [req-c636a1c6-ee1a-4884-b45f-1f003a99804c req-3871b64a-5f94-42e5-8ecd-dd44b0f21fdd service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received event network-vif-unplugged-9968045c-515a-4b9e-bc0f-26fd2939af52 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:22:17 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Instance destroyed successfully.
Nov 13 10:22:17 user nova-compute[74611]: DEBUG nova.objects.instance [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lazy-loading 'resources' on Instance uuid 9a5efe38-ddcc-4326-b965-6c73e99fd4c6 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1477867633',display_name='tempest-TestMinimumBasicScenario-server-1477867633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1477867633',id=47,image_ref='75d706c4-dc49-433c-a0c9-9698b49025c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5nMIZWPLyfRZ6I4B5+O58yjXxD0mjHO8WLKz3yVOm2GADt8bWYSrdShbjqWDz7AqIksVLxatoNCRqtuhShuXcR9yzoh8aZxzmJsJtl/HxOR4jzm8G0gDArifdAQeH9bQ==',key_name='tempest-TestMinimumBasicScenario-131080672',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:17:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5990cb4516a04312b3ccda9c39a44c4a',ramdisk_id='',reservation_id='r-tnevof5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='75d706c4-dc49-433c-a0c9-9698b49025c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-163886892',owner_user_name='tempest-TestMinimumBasicScenario-163886892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:19:40Z,user_data=None,user_id='35bc3ea05d5b4f9a85ba453446b2bee9',uuid=9a5efe38-ddcc-4326-b965-6c73e99fd4c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converting VIF {"id": "9968045c-515a-4b9e-bc0f-26fd2939af52", "address": "fa:16:3e:8d:a8:e5", "network": {"id": "a256793f-628c-44af-9ebf-316b65ed5cc1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1884331625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5990cb4516a04312b3ccda9c39a44c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9968045c-51", "ovs_interfaceid": "9968045c-515a-4b9e-bc0f-26fd2939af52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:a8:e5,bridge_name='br-int',has_traffic_filtering=True,id=9968045c-515a-4b9e-bc0f-26fd2939af52,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9968045c-51') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG os_vif [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:a8:e5,bridge_name='br-int',has_traffic_filtering=True,id=9968045c-515a-4b9e-bc0f-26fd2939af52,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9968045c-51') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9968045c-51, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0517ee91-30a3-48cb-b90d-c2c3801767b7) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:17 user nova-compute[74611]: INFO os_vif [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:a8:e5,bridge_name='br-int',has_traffic_filtering=True,id=9968045c-515a-4b9e-bc0f-26fd2939af52,network=Network(a256793f-628c-44af-9ebf-316b65ed5cc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9968045c-51')
Nov 13 10:22:17 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Deleting instance files /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6_del
Nov 13 10:22:17 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Deletion of /opt/stack/data/nova/instances/9a5efe38-ddcc-4326-b965-6c73e99fd4c6_del complete
Nov 13 10:22:18 user nova-compute[74611]: INFO nova.compute.manager [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 13 10:22:18 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:22:18 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:22:18 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:22:18 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:22:18 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Took 0.78 seconds to deallocate network for instance.
Nov 13 10:22:18 user nova-compute[74611]: DEBUG nova.compute.manager [req-00f5a37e-3ce6-4816-a894-8dd6da373c45 req-e9d7c694-510c-45fc-9c24-11dd05c5fbce service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received event network-vif-deleted-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:22:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:22:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:22:19 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:22:19 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:22:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:22:19 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Deleted allocations for instance 9a5efe38-ddcc-4326-b965-6c73e99fd4c6
Nov 13 10:22:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-105d3eb7-b686-430a-be2f-dacebb67658b tempest-TestMinimumBasicScenario-163886892 tempest-TestMinimumBasicScenario-163886892-project-member] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.265s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:22:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-c9bd8825-066c-4e74-8846-bde2993140d9 req-620ab664-e8a0-45fe-bb94-3db76f4df178 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received event network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:22:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9bd8825-066c-4e74-8846-bde2993140d9 req-620ab664-e8a0-45fe-bb94-3db76f4df178 service nova] Acquiring lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:22:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9bd8825-066c-4e74-8846-bde2993140d9 req-620ab664-e8a0-45fe-bb94-3db76f4df178 service nova] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:22:19 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-c9bd8825-066c-4e74-8846-bde2993140d9 req-620ab664-e8a0-45fe-bb94-3db76f4df178 service nova] Lock "9a5efe38-ddcc-4326-b965-6c73e99fd4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:22:19 user nova-compute[74611]: DEBUG nova.compute.manager [req-c9bd8825-066c-4e74-8846-bde2993140d9 req-620ab664-e8a0-45fe-bb94-3db76f4df178 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] No waiting events found dispatching network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:22:19 user nova-compute[74611]: WARNING nova.compute.manager [req-c9bd8825-066c-4e74-8846-bde2993140d9 req-620ab664-e8a0-45fe-bb94-3db76f4df178 service nova] [instance: 9a5efe38-ddcc-4326-b965-6c73e99fd4c6] Received unexpected event network-vif-plugged-9968045c-515a-4b9e-bc0f-26fd2939af52 for instance with vm_state deleted and task_state None.
Nov 13 10:22:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:22:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:22:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:22:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:22:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:22:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:22:55 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:22:55 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:22:55 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:22:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:22:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:22:55 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:22:55 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:22:55 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Updating instance_info_cache with network_info: [{"id": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "address": "fa:16:3e:e1:f1:03", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fb7e25-74", "ovs_interfaceid": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:22:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:22:55 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:22:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:22:58 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:23:00 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:23:00 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:23:00 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:23:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:23:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:23:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:23:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:23:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:03 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:23:03 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:23:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:23:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:23:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:23:03 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:23:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:23:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:23:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:23:03 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:23:04 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:23:04 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:23:04 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8964MB free_disk=25.186161041259766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:23:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:23:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:23:04 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:23:04 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:23:04 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:23:04 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:23:04 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:23:04 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:23:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:23:07 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:23:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:23:10 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:23:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "0fdac3ec-fd51-446d-becb-217c51ecd466" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:23:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:23:29 user nova-compute[74611]: DEBUG nova.compute.manager [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:23:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:23:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:23:29 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:23:29 user nova-compute[74611]: INFO nova.compute.claims [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Claim successful on node user
Nov 13 10:23:29 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:23:29 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:23:29 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:23:29 user nova-compute[74611]: DEBUG nova.compute.manager [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG nova.compute.manager [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG nova.network.neutron [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:23:30 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:23:30 user nova-compute[74611]: DEBUG nova.compute.manager [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG nova.policy [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab79aeb071d64eb7a02160d4a6200880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60965b95c752466ab527ae17ce5eddca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG nova.compute.manager [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:23:30 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Creating image(s)
Nov 13 10:23:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "/opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "/opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk 1073741824" returned: 0 in 0.054s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:23:30 user nova-compute[74611]: DEBUG nova.network.neutron [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Successfully created port: 3a75ae91-43cb-4031-b840-8c4f04c9e6e6 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.184s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Cannot resize image /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Ensure instance console log exists: /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.network.neutron [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Successfully updated port: 3a75ae91-43cb-4031-b840-8c4f04c9e6e6 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "refresh_cache-0fdac3ec-fd51-446d-becb-217c51ecd466" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquired lock "refresh_cache-0fdac3ec-fd51-446d-becb-217c51ecd466" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.network.neutron [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c5a0390-25e7-4406-bde6-289e1aadbf6b req-1ae7f7bc-5d04-4e67-a3d2-7fd95b62abdf service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Received event network-changed-3a75ae91-43cb-4031-b840-8c4f04c9e6e6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.compute.manager [req-7c5a0390-25e7-4406-bde6-289e1aadbf6b req-1ae7f7bc-5d04-4e67-a3d2-7fd95b62abdf service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Refreshing instance network info cache due to event network-changed-3a75ae91-43cb-4031-b840-8c4f04c9e6e6. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5a0390-25e7-4406-bde6-289e1aadbf6b req-1ae7f7bc-5d04-4e67-a3d2-7fd95b62abdf service nova] Acquiring lock "refresh_cache-0fdac3ec-fd51-446d-becb-217c51ecd466" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.network.neutron [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.network.neutron [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Updating instance_info_cache with network_info: [{"id": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "address": "fa:16:3e:17:9b:e5", "network": {"id": "b178054f-dd8e-404f-af05-a4023fd81d93", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-305581073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60965b95c752466ab527ae17ce5eddca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a75ae91-43", "ovs_interfaceid": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Releasing lock "refresh_cache-0fdac3ec-fd51-446d-becb-217c51ecd466" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.compute.manager [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Instance network_info: |[{"id": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "address": "fa:16:3e:17:9b:e5", "network": {"id": "b178054f-dd8e-404f-af05-a4023fd81d93", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-305581073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60965b95c752466ab527ae17ce5eddca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a75ae91-43", "ovs_interfaceid": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5a0390-25e7-4406-bde6-289e1aadbf6b req-1ae7f7bc-5d04-4e67-a3d2-7fd95b62abdf service nova] Acquired lock "refresh_cache-0fdac3ec-fd51-446d-becb-217c51ecd466" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.network.neutron [req-7c5a0390-25e7-4406-bde6-289e1aadbf6b req-1ae7f7bc-5d04-4e67-a3d2-7fd95b62abdf service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Refreshing network info cache for port 3a75ae91-43cb-4031-b840-8c4f04c9e6e6 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Start _get_guest_xml network_info=[{"id": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "address": "fa:16:3e:17:9b:e5", "network": {"id": "b178054f-dd8e-404f-af05-a4023fd81d93", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-305581073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60965b95c752466ab527ae17ce5eddca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a75ae91-43", "ovs_interfaceid": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:23:31 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:23:31 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:23:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-758567933',display_name='tempest-TestServerVolumeAttachmentScenario-server-758567933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-758567933',id=51,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAwJzy6Utqswrs7Z/FQFAgHliLp7CJf2B2Ha5gGTZJrtc8AyCEXy59cd5ws6sgCTx/1sc3tlC8igQRwkp/RRWc9IMtRKX/73Bflg3mI+FIRUSnYXjPtHbLniD/rmingeQ==',key_name='tempest-keypair-1063547603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60965b95c752466ab527ae17ce5eddca',ramdisk_id='',reservation_id='r-wttc0yhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-709578559',owner_user_name='tempest-TestServerVolumeAttachmentScenario-709578559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:23:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab79aeb071d64eb7a02160d4a6200880',uuid=0fdac3ec-fd51-446d-becb-217c51ecd466,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "address": "fa:16:3e:17:9b:e5", "network": {"id": "b178054f-dd8e-404f-af05-a4023fd81d93", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-305581073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60965b95c752466ab527ae17ce5eddca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a75ae91-43", "ovs_interfaceid": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Converting VIF {"id": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "address": "fa:16:3e:17:9b:e5", "network": {"id": "b178054f-dd8e-404f-af05-a4023fd81d93", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-305581073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60965b95c752466ab527ae17ce5eddca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a75ae91-43", "ovs_interfaceid": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:9b:e5,bridge_name='br-int',has_traffic_filtering=True,id=3a75ae91-43cb-4031-b840-8c4f04c9e6e6,network=Network(b178054f-dd8e-404f-af05-a4023fd81d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a75ae91-43') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.objects.instance [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fdac3ec-fd51-446d-becb-217c51ecd466 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:23:31 user nova-compute[74611]:   <uuid>0fdac3ec-fd51-446d-becb-217c51ecd466</uuid>
Nov 13 10:23:31 user nova-compute[74611]:   <name>instance-00000033</name>
Nov 13 10:23:31 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:23:31 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:23:31 user nova-compute[74611]:   <metadata>
Nov 13 10:23:31 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:23:31 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:23:31 user nova-compute[74611]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-758567933</nova:name>
Nov 13 10:23:31 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:23:31</nova:creationTime>
Nov 13 10:23:31 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:23:31 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:23:31 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:23:31 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:23:31 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:23:31 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:23:31 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:23:31 user nova-compute[74611]:       <nova:owner>
Nov 13 10:23:31 user nova-compute[74611]:         <nova:user uuid="ab79aeb071d64eb7a02160d4a6200880">tempest-TestServerVolumeAttachmentScenario-709578559-project-member</nova:user>
Nov 13 10:23:31 user nova-compute[74611]:         <nova:project uuid="60965b95c752466ab527ae17ce5eddca">tempest-TestServerVolumeAttachmentScenario-709578559</nova:project>
Nov 13 10:23:31 user nova-compute[74611]:       </nova:owner>
Nov 13 10:23:31 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:23:31 user nova-compute[74611]:       <nova:ports>
Nov 13 10:23:31 user nova-compute[74611]:         <nova:port uuid="3a75ae91-43cb-4031-b840-8c4f04c9e6e6">
Nov 13 10:23:31 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 10:23:31 user nova-compute[74611]:         </nova:port>
Nov 13 10:23:31 user nova-compute[74611]:       </nova:ports>
Nov 13 10:23:31 user nova-compute[74611]:     </nova:instance>
Nov 13 10:23:31 user nova-compute[74611]:   </metadata>
Nov 13 10:23:31 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:23:31 user nova-compute[74611]:     <system>
Nov 13 10:23:31 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:23:31 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:23:31 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:23:31 user nova-compute[74611]:       <entry name="serial">0fdac3ec-fd51-446d-becb-217c51ecd466</entry>
Nov 13 10:23:31 user nova-compute[74611]:       <entry name="uuid">0fdac3ec-fd51-446d-becb-217c51ecd466</entry>
Nov 13 10:23:31 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:23:31 user nova-compute[74611]:     </system>
Nov 13 10:23:31 user nova-compute[74611]:   </sysinfo>
Nov 13 10:23:31 user nova-compute[74611]:   <os>
Nov 13 10:23:31 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:23:31 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:23:31 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:23:31 user nova-compute[74611]:   </os>
Nov 13 10:23:31 user nova-compute[74611]:   <features>
Nov 13 10:23:31 user nova-compute[74611]:     <acpi/>
Nov 13 10:23:31 user nova-compute[74611]:     <apic/>
Nov 13 10:23:31 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:23:31 user nova-compute[74611]:   </features>
Nov 13 10:23:31 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:23:31 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:23:31 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:23:31 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:23:31 user nova-compute[74611]:   </clock>
Nov 13 10:23:31 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:23:31 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:23:31 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:23:31 user nova-compute[74611]:   </cpu>
Nov 13 10:23:31 user nova-compute[74611]:   <devices>
Nov 13 10:23:31 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:23:31 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:23:31 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk"/>
Nov 13 10:23:31 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:23:31 user nova-compute[74611]:     </disk>
Nov 13 10:23:31 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:23:31 user nova-compute[74611]:       <mac address="fa:16:3e:17:9b:e5"/>
Nov 13 10:23:31 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:23:31 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:23:31 user nova-compute[74611]:       <target dev="tap3a75ae91-43"/>
Nov 13 10:23:31 user nova-compute[74611]:     </interface>
Nov 13 10:23:31 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:23:31 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/console.log" append="off"/>
Nov 13 10:23:31 user nova-compute[74611]:     </serial>
Nov 13 10:23:31 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:23:31 user nova-compute[74611]:     <video>
Nov 13 10:23:31 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:23:31 user nova-compute[74611]:     </video>
Nov 13 10:23:31 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:23:31 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:23:31 user nova-compute[74611]:     </rng>
Nov 13 10:23:31 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:23:31 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:23:31 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:23:31 user nova-compute[74611]:     </memballoon>
Nov 13 10:23:31 user nova-compute[74611]:   </devices>
Nov 13 10:23:31 user nova-compute[74611]: </domain>
Nov 13 10:23:31 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:23:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-758567933',display_name='tempest-TestServerVolumeAttachmentScenario-server-758567933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-758567933',id=51,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAwJzy6Utqswrs7Z/FQFAgHliLp7CJf2B2Ha5gGTZJrtc8AyCEXy59cd5ws6sgCTx/1sc3tlC8igQRwkp/RRWc9IMtRKX/73Bflg3mI+FIRUSnYXjPtHbLniD/rmingeQ==',key_name='tempest-keypair-1063547603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60965b95c752466ab527ae17ce5eddca',ramdisk_id='',reservation_id='r-wttc0yhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-709578559',owner_user_name='tempest-TestServerVolumeAttachmentScenario-709578559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:23:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab79aeb071d64eb7a02160d4a6200880',uuid=0fdac3ec-fd51-446d-becb-217c51ecd466,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "address": "fa:16:3e:17:9b:e5", "network": {"id": "b178054f-dd8e-404f-af05-a4023fd81d93", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-305581073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60965b95c752466ab527ae17ce5eddca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a75ae91-43", "ovs_interfaceid": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Converting VIF {"id": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "address": "fa:16:3e:17:9b:e5", "network": {"id": "b178054f-dd8e-404f-af05-a4023fd81d93", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-305581073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60965b95c752466ab527ae17ce5eddca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a75ae91-43", "ovs_interfaceid": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:9b:e5,bridge_name='br-int',has_traffic_filtering=True,id=3a75ae91-43cb-4031-b840-8c4f04c9e6e6,network=Network(b178054f-dd8e-404f-af05-a4023fd81d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a75ae91-43') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG os_vif [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:9b:e5,bridge_name='br-int',has_traffic_filtering=True,id=3a75ae91-43cb-4031-b840-8c4f04c9e6e6,network=Network(b178054f-dd8e-404f-af05-a4023fd81d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a75ae91-43') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '219af8ab-d57d-5f1d-ba55-d5568a1ef8cc', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a75ae91-43, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a75ae91-43, col_values=(('qos', UUID('29bb4584-5e64-4def-9f47-c5a5ef3e547f')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a75ae91-43, col_values=(('external_ids', {'iface-id': '3a75ae91-43cb-4031-b840-8c4f04c9e6e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:9b:e5', 'vm-uuid': '0fdac3ec-fd51-446d-becb-217c51ecd466'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:31 user nova-compute[74611]: INFO os_vif [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:9b:e5,bridge_name='br-int',has_traffic_filtering=True,id=3a75ae91-43cb-4031-b840-8c4f04c9e6e6,network=Network(b178054f-dd8e-404f-af05-a4023fd81d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a75ae91-43')
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:23:31 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] No VIF found with MAC fa:16:3e:17:9b:e5, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:23:32 user nova-compute[74611]: DEBUG nova.network.neutron [req-7c5a0390-25e7-4406-bde6-289e1aadbf6b req-1ae7f7bc-5d04-4e67-a3d2-7fd95b62abdf service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Updated VIF entry in instance network info cache for port 3a75ae91-43cb-4031-b840-8c4f04c9e6e6. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:23:32 user nova-compute[74611]: DEBUG nova.network.neutron [req-7c5a0390-25e7-4406-bde6-289e1aadbf6b req-1ae7f7bc-5d04-4e67-a3d2-7fd95b62abdf service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Updating instance_info_cache with network_info: [{"id": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "address": "fa:16:3e:17:9b:e5", "network": {"id": "b178054f-dd8e-404f-af05-a4023fd81d93", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-305581073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60965b95c752466ab527ae17ce5eddca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a75ae91-43", "ovs_interfaceid": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:23:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-7c5a0390-25e7-4406-bde6-289e1aadbf6b req-1ae7f7bc-5d04-4e67-a3d2-7fd95b62abdf service nova] Releasing lock "refresh_cache-0fdac3ec-fd51-446d-becb-217c51ecd466" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:23:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-1fe2227f-e755-46d6-8a84-72166f999436 req-41a11861-4186-45ff-9284-2c785b84f5f3 service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Received event network-vif-plugged-3a75ae91-43cb-4031-b840-8c4f04c9e6e6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:23:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1fe2227f-e755-46d6-8a84-72166f999436 req-41a11861-4186-45ff-9284-2c785b84f5f3 service nova] Acquiring lock "0fdac3ec-fd51-446d-becb-217c51ecd466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:23:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1fe2227f-e755-46d6-8a84-72166f999436 req-41a11861-4186-45ff-9284-2c785b84f5f3 service nova] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:23:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1fe2227f-e755-46d6-8a84-72166f999436 req-41a11861-4186-45ff-9284-2c785b84f5f3 service nova] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:23:33 user nova-compute[74611]: DEBUG nova.compute.manager [req-1fe2227f-e755-46d6-8a84-72166f999436 req-41a11861-4186-45ff-9284-2c785b84f5f3 service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] No waiting events found dispatching network-vif-plugged-3a75ae91-43cb-4031-b840-8c4f04c9e6e6 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:23:33 user nova-compute[74611]: WARNING nova.compute.manager [req-1fe2227f-e755-46d6-8a84-72166f999436 req-41a11861-4186-45ff-9284-2c785b84f5f3 service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Received unexpected event network-vif-plugged-3a75ae91-43cb-4031-b840-8c4f04c9e6e6 for instance with vm_state building and task_state spawning.
Nov 13 10:23:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:23:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:23:35 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Instance spawned successfully.
Nov 13 10:23:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:23:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:23:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:23:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:23:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:23:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:23:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:23:35 user nova-compute[74611]: INFO nova.compute.manager [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 13 10:23:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:23:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-6a100a3f-5afa-4204-9d30-9f19e57577f7 req-32001d22-83d5-4bec-9656-a18889ad8def service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Received event network-vif-plugged-3a75ae91-43cb-4031-b840-8c4f04c9e6e6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:23:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6a100a3f-5afa-4204-9d30-9f19e57577f7 req-32001d22-83d5-4bec-9656-a18889ad8def service nova] Acquiring lock "0fdac3ec-fd51-446d-becb-217c51ecd466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:23:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6a100a3f-5afa-4204-9d30-9f19e57577f7 req-32001d22-83d5-4bec-9656-a18889ad8def service nova] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:23:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6a100a3f-5afa-4204-9d30-9f19e57577f7 req-32001d22-83d5-4bec-9656-a18889ad8def service nova] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:23:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-6a100a3f-5afa-4204-9d30-9f19e57577f7 req-32001d22-83d5-4bec-9656-a18889ad8def service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] No waiting events found dispatching network-vif-plugged-3a75ae91-43cb-4031-b840-8c4f04c9e6e6 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:23:35 user nova-compute[74611]: WARNING nova.compute.manager [req-6a100a3f-5afa-4204-9d30-9f19e57577f7 req-32001d22-83d5-4bec-9656-a18889ad8def service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Received unexpected event network-vif-plugged-3a75ae91-43cb-4031-b840-8c4f04c9e6e6 for instance with vm_state building and task_state spawning.
Nov 13 10:23:35 user nova-compute[74611]: INFO nova.compute.manager [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Took 5.71 seconds to build instance.
Nov 13 10:23:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-bc3713f6-9d51-4319-bd87-27263c84e740 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.802s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:23:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:23:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:23:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:23:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:23:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:56 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:23:56 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:23:56 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:23:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:23:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:23:56 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:23:56 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:23:56 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Updating instance_info_cache with network_info: [{"id": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "address": "fa:16:3e:e1:f1:03", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fb7e25-74", "ovs_interfaceid": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:23:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:23:56 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:23:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:23:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:00 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:24:00 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:24:00 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-1bab856c-a3a8-4cc3-8618-2fbe2b573ddb req-364957db-1c8b-4f3b-8d3b-5fbb0a7be624 service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Received event network-changed-92fb7e25-7410-4853-ae8c-ad9a8033f947 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-1bab856c-a3a8-4cc3-8618-2fbe2b573ddb req-364957db-1c8b-4f3b-8d3b-5fbb0a7be624 service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Refreshing instance network info cache due to event network-changed-92fb7e25-7410-4853-ae8c-ad9a8033f947. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1bab856c-a3a8-4cc3-8618-2fbe2b573ddb req-364957db-1c8b-4f3b-8d3b-5fbb0a7be624 service nova] Acquiring lock "refresh_cache-8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1bab856c-a3a8-4cc3-8618-2fbe2b573ddb req-364957db-1c8b-4f3b-8d3b-5fbb0a7be624 service nova] Acquired lock "refresh_cache-8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG nova.network.neutron [req-1bab856c-a3a8-4cc3-8618-2fbe2b573ddb req-364957db-1c8b-4f3b-8d3b-5fbb0a7be624 service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Refreshing network info cache for port 92fb7e25-7410-4853-ae8c-ad9a8033f947 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG nova.objects.instance [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lazy-loading 'flavor' on Instance uuid 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:24:01 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Ignoring supplied device name: /dev/vdb
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:24:01 user nova-compute[74611]: INFO nova.compute.manager [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Attaching volume 30e26eca-4af3-426f-9da8-c9fe88304044 to /dev/vdb
Nov 13 10:24:01 user nova-compute[74611]: DEBUG os_brick.utils [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea73951-9dd0-4f4d-9e07-4ebbe5db334c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[81014df2-b3c3-421d-82cb-9049e2c0a692]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[94525cb7-c7da-4bf2-81c8-f64ba5330db1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[550bdf82-06a7-44d2-b2af-62cddb1a90ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:24:01 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:24:01 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c734a11-b91d-4ba6-a71f-bad0e0e03f75]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG os_brick.utils [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Updating existing volume attachment record: ab31ab08-93c5-467e-9ea0-71373e271693 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG nova.network.neutron [req-1bab856c-a3a8-4cc3-8618-2fbe2b573ddb req-364957db-1c8b-4f3b-8d3b-5fbb0a7be624 service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Updated VIF entry in instance network info cache for port 92fb7e25-7410-4853-ae8c-ad9a8033f947. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:24:01 user nova-compute[74611]: DEBUG nova.network.neutron [req-1bab856c-a3a8-4cc3-8618-2fbe2b573ddb req-364957db-1c8b-4f3b-8d3b-5fbb0a7be624 service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Updating instance_info_cache with network_info: [{"id": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "address": "fa:16:3e:e1:f1:03", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fb7e25-74", "ovs_interfaceid": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:24:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-1bab856c-a3a8-4cc3-8618-2fbe2b573ddb req-364957db-1c8b-4f3b-8d3b-5fbb0a7be624 service nova] Releasing lock "refresh_cache-8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:24:03 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:24:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:05 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:24:05 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:24:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:24:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:24:05 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:24:05 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:24:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:05 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zuAUHqwi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:24:06 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:24:06 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:24:06 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:06 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:24:06 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:24:06 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=25.187076568603516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f77cc69-8147-47de-8323-37ba7e3adb92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:24:06 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff19c6f-d79b-4b80-9e8a-780a33ac6b60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044] added
Nov 13 10:24:06 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[711032ce-b8ad-425f-b592-436a346d096d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6940d6e3-11de-40e7-96ec-9a3d90f5dc71]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zuAUHqwi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 0fdac3ec-fd51-446d-becb-217c51ecd466 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zuAUHqwi" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d1a12d-2250-4418-a6a8-77462afd3a6e]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zuAUHqwi'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacdfea7-8f5e-46c2-8918-ef471381a88f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fa0b99-4cac-49a5-a299-bcf156d97037]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 10:24:06 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 10:24:06 user nova-compute[74611]:  {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:24:06 user nova-compute[74611]: WARNING os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 10:24:06 user nova-compute[74611]: 
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86a46c7-f0b6-4fbe-bcfa-c5dd89220d8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044, portal: 172.16.0.220,3260]
Nov 13 10:24:06 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044, portal: 172.16.0.220,3260] successful.
Nov 13 10:24:06 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde11286-cd25-436d-af86-a6b8413ca1e5]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[53350813-a4cc-4a79-aba2-67af6f6b1b18]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 (non-flash)
Nov 13 10:24:06 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 (non-flash)
Nov 13 10:24:06 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[50aa77b2-56e0-4961-b905-d63061c877d0]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:24:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:07 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:24:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zuAUHqwi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:24:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:24:07 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26163333333343665', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:24:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163333333343665', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:24:07 user nova-compute[74611]: DEBUG nova.objects.instance [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lazy-loading 'flavor' on Instance uuid 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:24:07 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:24:07 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:24:07 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:24:07 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:24:07 user nova-compute[74611]:   <serial>30e26eca-4af3-426f-9da8-c9fe88304044</serial>
Nov 13 10:24:07 user nova-compute[74611]: </disk>
Nov 13 10:24:07 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:24:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:24:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:24:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] No VIF found with MAC fa:16:3e:e1:f1:03, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:24:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-72e54569-d423-4e5a-ae13-4ece63a5a939 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.764s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:24:08 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:24:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:10 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:24:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:12 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:24:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:24:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:24:15 user nova-compute[74611]: INFO nova.compute.manager [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Detaching volume 30e26eca-4af3-426f-9da8-c9fe88304044
Nov 13 10:24:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:24:15 user nova-compute[74611]: INFO nova.virt.block_device [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Attempting to driver detach volume 30e26eca-4af3-426f-9da8-c9fe88304044 from mountpoint /dev/vdb
Nov 13 10:24:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Attempting to detach device vdb from instance 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:24:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:24:15 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:24:15 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:24:15 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:24:15 user nova-compute[74611]:   <serial>30e26eca-4af3-426f-9da8-c9fe88304044</serial>
Nov 13 10:24:15 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:24:15 user nova-compute[74611]: </disk>
Nov 13 10:24:15 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:24:15 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Successfully detached device vdb from instance 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4 from the persistent domain config.
Nov 13 10:24:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:24:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:24:15 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:24:15 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:24:15 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:24:15 user nova-compute[74611]:   <serial>30e26eca-4af3-426f-9da8-c9fe88304044</serial>
Nov 13 10:24:15 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:24:15 user nova-compute[74611]: </disk>
Nov 13 10:24:15 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:24:15 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:24:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:24:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:35 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4 is timed out.
Nov 13 10:24:35 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Successfully detached device vdb from instance 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4 from the live domain config.
Nov 13 10:24:35 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zuAUHqwi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:24:36 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a7d7bf-38f1-480d-85d6-11c21107a328]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:24:36 user nova-compute[74611]: No targets found.
Nov 13 10:24:36 user nova-compute[74611]: iSNS:
Nov 13 10:24:36 user nova-compute[74611]: No targets found.
Nov 13 10:24:36 user nova-compute[74611]: STATIC:
Nov 13 10:24:36 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044
Nov 13 10:24:36 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:24:36 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:24:36 user nova-compute[74611]: FIRMWARE:
Nov 13 10:24:36 user nova-compute[74611]: No targets found.
Nov 13 10:24:36 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:24:36 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:24:36 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c6ee51-c2c4-4d95-8561-34aa4a4364db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[427669d9-e281-4398-8602-c470e31d3fca]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 (non-flash)
Nov 13 10:24:36 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 (non-flash)
Nov 13 10:24:36 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb646817e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7092812b-6510-47b7-94f5-633dba738f5d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0530073f-3016-4112-8096-a11360983eca]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d484e09-43aa-4fe0-8a90-b4e05c37ec9b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[59be8b20-3cdd-4db3-b6d4-7bf1f1629c71]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cc1935-9f7a-4333-84bf-cb3d5e9376fb]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[503ba17f-4366-4834-8c83-339624aaf090]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044, portal: 172.16.0.220,3260]
Nov 13 10:24:36 user nova-compute[74611]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044, portal: 172.16.0.220,3260] successful.
Nov 13 10:24:36 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[27417240-f385-4e36-9fc4-9f11a924a66b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] <== disconnect_volume: return (265ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:36 user nova-compute[74611]: DEBUG nova.objects.instance [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lazy-loading 'flavor' on Instance uuid 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-c818f447-560b-49ea-a8b6-e71dd2eb4495 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.601s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.532s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:24:37 user nova-compute[74611]: INFO nova.compute.manager [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Terminating instance
Nov 13 10:24:37 user nova-compute[74611]: DEBUG nova.compute.manager [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-4a889463-7aeb-460b-b905-6d908ce7dc34 req-5832493a-ef16-4a98-b5b4-94a8607ca74c service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Received event network-vif-unplugged-92fb7e25-7410-4853-ae8c-ad9a8033f947 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4a889463-7aeb-460b-b905-6d908ce7dc34 req-5832493a-ef16-4a98-b5b4-94a8607ca74c service nova] Acquiring lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4a889463-7aeb-460b-b905-6d908ce7dc34 req-5832493a-ef16-4a98-b5b4-94a8607ca74c service nova] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-4a889463-7aeb-460b-b905-6d908ce7dc34 req-5832493a-ef16-4a98-b5b4-94a8607ca74c service nova] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-4a889463-7aeb-460b-b905-6d908ce7dc34 req-5832493a-ef16-4a98-b5b4-94a8607ca74c service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] No waiting events found dispatching network-vif-unplugged-92fb7e25-7410-4853-ae8c-ad9a8033f947 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-4a889463-7aeb-460b-b905-6d908ce7dc34 req-5832493a-ef16-4a98-b5b4-94a8607ca74c service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Received event network-vif-unplugged-92fb7e25-7410-4853-ae8c-ad9a8033f947 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:37 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Instance destroyed successfully.
Nov 13 10:24:37 user nova-compute[74611]: DEBUG nova.objects.instance [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lazy-loading 'resources' on Instance uuid 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-521850251',display_name='tempest-VolumesSnapshotTestJSON-instance-521850251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-521850251',id=50,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZUVRNmTDlGdnmBASAoH7yUYaRrcX5qSAXDLXD1Umq4VaqaxUDViHW7nJ4lpXxekTPcV0Yjx+EAIdAlDAFpLh2PrnyOdPyQTSiDnQI6P2U1agzggZpQscoOJ+Ydm7B8WA==',key_name='tempest-keypair-877514124',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:22:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc5da31f2854f4082c6d4b2d344d27a',ramdisk_id='',reservation_id='r-hgjccd2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-928671223',owner_user_name='tempest-VolumesSnapshotTestJSON-928671223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea494122b4f5499cbdcdb6c31e464074',uuid=8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "address": "fa:16:3e:e1:f1:03", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fb7e25-74", "ovs_interfaceid": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Converting VIF {"id": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "address": "fa:16:3e:e1:f1:03", "network": {"id": "e858906b-3909-45ae-856f-ac715040a03f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1350604470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc5da31f2854f4082c6d4b2d344d27a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fb7e25-74", "ovs_interfaceid": "92fb7e25-7410-4853-ae8c-ad9a8033f947", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:f1:03,bridge_name='br-int',has_traffic_filtering=True,id=92fb7e25-7410-4853-ae8c-ad9a8033f947,network=Network(e858906b-3909-45ae-856f-ac715040a03f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92fb7e25-74') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG os_vif [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:f1:03,bridge_name='br-int',has_traffic_filtering=True,id=92fb7e25-7410-4853-ae8c-ad9a8033f947,network=Network(e858906b-3909-45ae-856f-ac715040a03f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92fb7e25-74') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92fb7e25-74, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e204b77-3525-413d-a430-5b3e12206e02) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:37 user nova-compute[74611]: INFO os_vif [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:f1:03,bridge_name='br-int',has_traffic_filtering=True,id=92fb7e25-7410-4853-ae8c-ad9a8033f947,network=Network(e858906b-3909-45ae-856f-ac715040a03f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92fb7e25-74')
Nov 13 10:24:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:30e26eca-4af3-426f-9da8-c9fe88304044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zuAUHqwi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:24:37 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:24:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[c67f15dc-4e3f-4e85-a5fe-5e054e3d0f6e]: Unexpected error while running command.
Nov 13 10:24:37 user nova-compute[74611]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 13 10:24:37 user nova-compute[74611]: Exit code: 21
Nov 13 10:24:37 user nova-compute[74611]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 13 10:24:37 user nova-compute[74611]: Stderr: '' {{(pid=85776) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 13 10:24:37 user nova-compute[74611]: Traceback (most recent call last):
Nov 13 10:24:37 user nova-compute[74611]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 13 10:24:37 user nova-compute[74611]:     ret = func(*f_args, **f_kwargs)
Nov 13 10:24:37 user nova-compute[74611]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 13 10:24:37 user nova-compute[74611]:     return func(*args, **kwargs)
Nov 13 10:24:37 user nova-compute[74611]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 13 10:24:37 user nova-compute[74611]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 13 10:24:37 user nova-compute[74611]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 13 10:24:37 user nova-compute[74611]:     return putils.execute(on_execute=on_execute,
Nov 13 10:24:37 user nova-compute[74611]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 13 10:24:37 user nova-compute[74611]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 13 10:24:37 user nova-compute[74611]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 13 10:24:37 user nova-compute[74611]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 13 10:24:37 user nova-compute[74611]: Exit code: 21
Nov 13 10:24:37 user nova-compute[74611]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 13 10:24:37 user nova-compute[74611]: Stderr: ''
Nov 13 10:24:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67f15dc-4e3f-4e85-a5fe-5e054e3d0f6e]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 13 10:24:37 user nova-compute[74611]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 13 10:24:37 user nova-compute[74611]: Exit code: 21
Nov 13 10:24:37 user nova-compute[74611]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 13 10:24:37 user nova-compute[74611]: Stderr: ''
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 13 10:24:37 user nova-compute[74611]: ERROR os_brick.initiator.connectors.iscsi 
Nov 13 10:24:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74611) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] <== disconnect_volume: return (71ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:24:37 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Deleting instance files /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4_del
Nov 13 10:24:37 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Deletion of /opt/stack/data/nova/instances/8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4_del complete
Nov 13 10:24:37 user nova-compute[74611]: INFO nova.compute.manager [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 13 10:24:37 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:24:37 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:24:38 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:24:38 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Took 0.91 seconds to deallocate network for instance.
Nov 13 10:24:38 user nova-compute[74611]: WARNING nova.volume.cinder [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Attachment ab31ab08-93c5-467e-9ea0-71373e271693 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ab31ab08-93c5-467e-9ea0-71373e271693. (HTTP 404) (Request-ID: req-bc836097-9265-4ba1-aa65-a671e89575ef)
Nov 13 10:24:38 user nova-compute[74611]: INFO nova.compute.manager [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Took 0.03 seconds to detach 1 volumes for instance.
Nov 13 10:24:38 user nova-compute[74611]: DEBUG nova.compute.manager [req-0f7c0c36-eeff-43c2-864e-6d55220cc3a6 req-361b8397-d46e-49eb-a98f-b225fdd3e838 service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Received event network-vif-deleted-92fb7e25-7410-4853-ae8c-ad9a8033f947 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:24:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:24:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:24:39 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:24:39 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:24:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:24:39 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Deleted allocations for instance 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4
Nov 13 10:24:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d8e3c25a-ab1a-4403-a334-f9ad91138dc4 tempest-VolumesSnapshotTestJSON-928671223 tempest-VolumesSnapshotTestJSON-928671223-project-member] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.254s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:24:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-f088a7e1-0a67-48f5-9fd1-573f52605666 req-19148593-df6e-4104-af94-c5b98dcf3ff4 service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Received event network-vif-plugged-92fb7e25-7410-4853-ae8c-ad9a8033f947 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:24:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f088a7e1-0a67-48f5-9fd1-573f52605666 req-19148593-df6e-4104-af94-c5b98dcf3ff4 service nova] Acquiring lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:24:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f088a7e1-0a67-48f5-9fd1-573f52605666 req-19148593-df6e-4104-af94-c5b98dcf3ff4 service nova] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:24:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-f088a7e1-0a67-48f5-9fd1-573f52605666 req-19148593-df6e-4104-af94-c5b98dcf3ff4 service nova] Lock "8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:24:39 user nova-compute[74611]: DEBUG nova.compute.manager [req-f088a7e1-0a67-48f5-9fd1-573f52605666 req-19148593-df6e-4104-af94-c5b98dcf3ff4 service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] No waiting events found dispatching network-vif-plugged-92fb7e25-7410-4853-ae8c-ad9a8033f947 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:24:39 user nova-compute[74611]: WARNING nova.compute.manager [req-f088a7e1-0a67-48f5-9fd1-573f52605666 req-19148593-df6e-4104-af94-c5b98dcf3ff4 service nova] [instance: 8d7e7c09-a3e8-4542-b361-ccbfc0f3a8c4] Received unexpected event network-vif-plugged-92fb7e25-7410-4853-ae8c-ad9a8033f947 for instance with vm_state deleted and task_state None.
Nov 13 10:24:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:24:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:57 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:24:57 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:24:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-0fdac3ec-fd51-446d-becb-217c51ecd466" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:24:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-0fdac3ec-fd51-446d-becb-217c51ecd466" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:24:57 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:24:57 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Updating instance_info_cache with network_info: [{"id": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "address": "fa:16:3e:17:9b:e5", "network": {"id": "b178054f-dd8e-404f-af05-a4023fd81d93", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-305581073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60965b95c752466ab527ae17ce5eddca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a75ae91-43", "ovs_interfaceid": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:24:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-0fdac3ec-fd51-446d-becb-217c51ecd466" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:24:57 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:24:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:24:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:24:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:24:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:24:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:24:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:01 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:25:02 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:25:02 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:25:02 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:25:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:25:03 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:25:07 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:25:07 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:25:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:25:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:25:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:25:07 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:25:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:07 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:08 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:25:08 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:25:08 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=25.213607788085938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 0fdac3ec-fd51-446d-becb-217c51ecd466 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing inventories for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating ProviderTree inventory for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating inventory in ProviderTree for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing aggregate associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, aggregates: None {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing trait associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 10:25:08 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] There are 0 instances to clean {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 10:25:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:13 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:25:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:25:17 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:25:17 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74611) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 10:25:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:25:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:25:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:25:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:25:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:25:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-d0803619-7f57-4941-a333-54b75d9a2e27 req-ff51087a-725b-492c-ba7d-056aded29321 service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Received event network-changed-3a75ae91-43cb-4031-b840-8c4f04c9e6e6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:25:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-d0803619-7f57-4941-a333-54b75d9a2e27 req-ff51087a-725b-492c-ba7d-056aded29321 service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Refreshing instance network info cache due to event network-changed-3a75ae91-43cb-4031-b840-8c4f04c9e6e6. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:25:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d0803619-7f57-4941-a333-54b75d9a2e27 req-ff51087a-725b-492c-ba7d-056aded29321 service nova] Acquiring lock "refresh_cache-0fdac3ec-fd51-446d-becb-217c51ecd466" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:25:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d0803619-7f57-4941-a333-54b75d9a2e27 req-ff51087a-725b-492c-ba7d-056aded29321 service nova] Acquired lock "refresh_cache-0fdac3ec-fd51-446d-becb-217c51ecd466" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:25:20 user nova-compute[74611]: DEBUG nova.network.neutron [req-d0803619-7f57-4941-a333-54b75d9a2e27 req-ff51087a-725b-492c-ba7d-056aded29321 service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Refreshing network info cache for port 3a75ae91-43cb-4031-b840-8c4f04c9e6e6 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:25:21 user nova-compute[74611]: DEBUG nova.network.neutron [req-d0803619-7f57-4941-a333-54b75d9a2e27 req-ff51087a-725b-492c-ba7d-056aded29321 service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Updated VIF entry in instance network info cache for port 3a75ae91-43cb-4031-b840-8c4f04c9e6e6. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:25:21 user nova-compute[74611]: DEBUG nova.network.neutron [req-d0803619-7f57-4941-a333-54b75d9a2e27 req-ff51087a-725b-492c-ba7d-056aded29321 service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Updating instance_info_cache with network_info: [{"id": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "address": "fa:16:3e:17:9b:e5", "network": {"id": "b178054f-dd8e-404f-af05-a4023fd81d93", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-305581073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60965b95c752466ab527ae17ce5eddca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a75ae91-43", "ovs_interfaceid": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:25:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-d0803619-7f57-4941-a333-54b75d9a2e27 req-ff51087a-725b-492c-ba7d-056aded29321 service nova] Releasing lock "refresh_cache-0fdac3ec-fd51-446d-becb-217c51ecd466" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:25:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "0fdac3ec-fd51-446d-becb-217c51ecd466" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:25:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:25:22 user nova-compute[74611]: DEBUG nova.objects.instance [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lazy-loading 'flavor' on Instance uuid 0fdac3ec-fd51-446d-becb-217c51ecd466 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:25:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:25:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "0fdac3ec-fd51-446d-becb-217c51ecd466" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:25:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:25:22 user nova-compute[74611]: INFO nova.compute.manager [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Attaching volume 5bf34d16-057d-4173-af17-c122c4b8bf96 to /dev/vdb
Nov 13 10:25:23 user nova-compute[74611]: DEBUG os_brick.utils [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15d7b3f-a76d-473a-99bf-e5636f6a5aed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24520b3-a0c0-4079-a08c-6c31f198e332]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f918dc9a-7e24-4610-8ec8-7bed051cfb07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a780d5-62f2-455f-bde3-8b77247cb4e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:25:23 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:25:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d3373f-0ca0-42b5-ae48-805930ff70ac]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG os_brick.utils [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:25:23 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Updating existing volume attachment record: 71cc898f-a822-41ae-b800-d4653448c7ac {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:25:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:25 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObCSIUjs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:25:27 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:25:27 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:25:27 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f481dd23-f2d2-47de-9b86-cd15ed7a3d1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:25:27 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[496fb8dc-3105-4d65-9f04-445aaf85cd2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96] added
Nov 13 10:25:27 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49cf502-b27d-4724-8de5-440eeb154bbb]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10b2837-6ad2-448b-a871-7b561364128c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ObCSIUjs {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ObCSIUjs" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b585a0b0-0a25-4782-aab8-0dcb9b2367ad]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ObCSIUjs'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db09cc7-a1c6-47d1-836e-8ac7ba1cda4c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41b9428-f07d-4ca7-a74f-09d5645abba0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 10:25:27 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 10:25:27 user nova-compute[74611]:  {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:25:27 user nova-compute[74611]: WARNING os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 10:25:27 user nova-compute[74611]: 
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4ccfe0-70a8-46ca-adf6-278efcb10f3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96, portal: 172.16.0.220,3260]
Nov 13 10:25:27 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96, portal: 172.16.0.220,3260] successful.
Nov 13 10:25:27 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1334475-aade-402a-9f32-8c0fd1508f22]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[badd47a1-6e8f-4af2-b073-6866540f08b6]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)
Nov 13 10:25:27 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)
Nov 13 10:25:27 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7993b88e-22d4-4051-ad18-8dd766518d32]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:25:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObCSIUjs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:25:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:25:28 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23238653230333439', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:25:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238653230333439', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:25:28 user nova-compute[74611]: DEBUG nova.objects.instance [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lazy-loading 'flavor' on Instance uuid 0fdac3ec-fd51-446d-becb-217c51ecd466 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:25:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:25:28 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:25:28 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:25:28 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:25:28 user nova-compute[74611]:   <serial>5bf34d16-057d-4173-af17-c122c4b8bf96</serial>
Nov 13 10:25:28 user nova-compute[74611]: </disk>
Nov 13 10:25:28 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:25:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:25:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:25:28 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] No VIF found with MAC fa:16:3e:17:9b:e5, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:25:28 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-50e04dd7-b61d-4977-b82f-e8625abb14ab tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.961s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:25:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:30 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "0fdac3ec-fd51-446d-becb-217c51ecd466" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG nova.objects.instance [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lazy-loading 'flavor' on Instance uuid 0fdac3ec-fd51-446d-becb-217c51ecd466 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "0fdac3ec-fd51-446d-becb-217c51ecd466" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:25:32 user nova-compute[74611]: INFO nova.compute.manager [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Attaching volume 4944a96b-3b69-4942-a0c5-45dd34a9dcbf to /dev/vdc
Nov 13 10:25:32 user nova-compute[74611]: DEBUG os_brick.utils [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b70a18-f153-4367-a22e-da57f5b4c350]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6b2c40-6bee-456b-a32a-05a4192c0aef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b754082f-d817-453b-8db3-9527ec1886a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f746821-823a-4097-ad71-acae0c375e3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:25:32 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:25:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[978b970e-7013-4d91-bab0-6442333f9520]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG os_brick.utils [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:25:32 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Updating existing volume attachment record: 2231c5d2-4a78-40f7-b653-3a7ef1ec83b5 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:25:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTZBlwCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:25:36 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:25:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:25:36 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:25:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:25:36 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:25:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b5c010-5b6f-4c82-9134-2d69fcf657d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:25:36 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[226a6c15-0f68-4f5f-a2d0-b0ee84baace6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf] added
Nov 13 10:25:36 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4afed8a-1656-4be6-93a9-f6b881ef2ca9]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fcd0fd-dae8-455c-a75e-f25d7c1e521e]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pTZBlwCf {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pTZBlwCf" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffbbf2c-1ead-41a9-b965-a364c0ab2eda]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pTZBlwCf'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6be40a-3fe8-41d3-9f7d-4e94b0cff653]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dbde86-8547-4b9d-87aa-0a3cce33349a]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)
Nov 13 10:25:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)
Nov 13 10:25:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae1860b-e62c-4fc9-a904-76468abacaf3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf, portal: 172.16.0.220,3260]
Nov 13 10:25:37 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf, portal: 172.16.0.220,3260] successful.
Nov 13 10:25:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[151ca97e-b372-481e-b30a-b9e3b76c8370]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[84985bd8-a9ee-439f-b877-38a95c63f359]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)
Nov 13 10:25:37 user nova-compute[74611]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf (non-flash)
Nov 13 10:25:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)
Nov 13 10:25:37 user nova-compute[74611]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf (non-flash)
Nov 13 10:25:37 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0beb0fe9-f38a-428b-9e17-72a6a946baaf]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTZBlwCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:25:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:25:38 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23739363764306366', 'path': '/dev/sdc'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:25:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739363764306366', 'path': '/dev/sdc'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:25:38 user nova-compute[74611]: DEBUG nova.objects.instance [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lazy-loading 'flavor' on Instance uuid 0fdac3ec-fd51-446d-becb-217c51ecd466 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:25:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:25:38 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:25:38 user nova-compute[74611]:   <source dev="/dev/sdc"/>
Nov 13 10:25:38 user nova-compute[74611]:   <target dev="vdc" bus="virtio"/>
Nov 13 10:25:38 user nova-compute[74611]:   <serial>4944a96b-3b69-4942-a0c5-45dd34a9dcbf</serial>
Nov 13 10:25:38 user nova-compute[74611]: </disk>
Nov 13 10:25:38 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:25:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:25:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:25:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:25:38 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] No VIF found with MAC fa:16:3e:17:9b:e5, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:25:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-076e8677-4a93-4ada-8ba1-961b927fb91c tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.053s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:25:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "0fdac3ec-fd51-446d-becb-217c51ecd466" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:25:39 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:25:39 user nova-compute[74611]: INFO nova.compute.manager [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Detaching volume 4944a96b-3b69-4942-a0c5-45dd34a9dcbf
Nov 13 10:25:39 user nova-compute[74611]: INFO nova.virt.block_device [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Attempting to driver detach volume 4944a96b-3b69-4942-a0c5-45dd34a9dcbf from mountpoint /dev/vdc
Nov 13 10:25:39 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Attempting to detach device vdc from instance 0fdac3ec-fd51-446d-becb-217c51ecd466 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:25:39 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:25:39 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:25:39 user nova-compute[74611]:   <source dev="/dev/sdc"/>
Nov 13 10:25:39 user nova-compute[74611]:   <target dev="vdc" bus="virtio"/>
Nov 13 10:25:39 user nova-compute[74611]:   <serial>4944a96b-3b69-4942-a0c5-45dd34a9dcbf</serial>
Nov 13 10:25:39 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 10:25:39 user nova-compute[74611]: </disk>
Nov 13 10:25:39 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:25:39 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Successfully detached device vdc from instance 0fdac3ec-fd51-446d-becb-217c51ecd466 from the persistent domain config.
Nov 13 10:25:39 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0fdac3ec-fd51-446d-becb-217c51ecd466 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:25:39 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:25:39 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:25:39 user nova-compute[74611]:   <source dev="/dev/sdc"/>
Nov 13 10:25:39 user nova-compute[74611]:   <target dev="vdc" bus="virtio"/>
Nov 13 10:25:39 user nova-compute[74611]:   <serial>4944a96b-3b69-4942-a0c5-45dd34a9dcbf</serial>
Nov 13 10:25:39 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 10:25:39 user nova-compute[74611]: </disk>
Nov 13 10:25:39 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:25:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:40 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0fdac3ec-fd51-446d-becb-217c51ecd466 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:25:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:25:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:25:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:25:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:25:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:25:42 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:25:42 user nova-compute[74611]: INFO nova.compute.claims [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Claim successful on node user
Nov 13 10:25:42 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:25:42 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:25:42 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:25:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:25:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:25:42 user nova-compute[74611]: DEBUG nova.network.neutron [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:25:42 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:25:42 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG nova.policy [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ff786be735d47e88024a09965f13fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597eb3324adc4bc79ba58b311df1e7c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:25:43 user nova-compute[74611]: INFO nova.virt.block_device [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Booting with volume ac1a6fda-0266-45a9-962f-60dbd3942042 at /dev/vda
Nov 13 10:25:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG os_brick.utils [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbc507d-31f6-4549-86f5-ee4f08c79b76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a05c0b-2826-4430-8fc7-7d8ff1f34f3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b620bcd9-9933-44bc-81b8-ea5bb66bf1dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea0d07a-6e04-4189-ba18-8be70302ebc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:25:43 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:25:43 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ecf571-63ef-4cab-a292-54f96ac631a9]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG os_brick.utils [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updating existing volume attachment record: 1048807d-a55d-4752-9ab7-b7848b4e79a8 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:25:43 user nova-compute[74611]: DEBUG nova.network.neutron [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Successfully created port: 2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:25:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Successfully updated port: 2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:25:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:25:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquired lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:25:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:25:44 user nova-compute[74611]: DEBUG nova.compute.manager [req-26ef1f52-ffa6-4ae2-8874-7060691a637d req-ad62d652-503a-4ad7-8b46-dc97a6c2fbd1 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received event network-changed-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:25:44 user nova-compute[74611]: DEBUG nova.compute.manager [req-26ef1f52-ffa6-4ae2-8874-7060691a637d req-ad62d652-503a-4ad7-8b46-dc97a6c2fbd1 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Refreshing instance network info cache due to event network-changed-2b937006-d7f5-4fc2-9275-a9f7d8c189a1. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:25:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-26ef1f52-ffa6-4ae2-8874-7060691a637d req-ad62d652-503a-4ad7-8b46-dc97a6c2fbd1 service nova] Acquiring lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:25:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:25:44 user nova-compute[74611]: DEBUG nova.network.neutron [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updating instance_info_cache with network_info: [{"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:25:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Releasing lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:25:44 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Instance network_info: |[{"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:25:44 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-26ef1f52-ffa6-4ae2-8874-7060691a637d req-ad62d652-503a-4ad7-8b46-dc97a6c2fbd1 service nova] Acquired lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:25:44 user nova-compute[74611]: DEBUG nova.network.neutron [req-26ef1f52-ffa6-4ae2-8874-7060691a637d req-ad62d652-503a-4ad7-8b46-dc97a6c2fbd1 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Refreshing network info cache for port 2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:25:45 user nova-compute[74611]: DEBUG nova.network.neutron [req-26ef1f52-ffa6-4ae2-8874-7060691a637d req-ad62d652-503a-4ad7-8b46-dc97a6c2fbd1 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updated VIF entry in instance network info cache for port 2b937006-d7f5-4fc2-9275-a9f7d8c189a1. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:25:45 user nova-compute[74611]: DEBUG nova.network.neutron [req-26ef1f52-ffa6-4ae2-8874-7060691a637d req-ad62d652-503a-4ad7-8b46-dc97a6c2fbd1 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updating instance_info_cache with network_info: [{"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:25:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-26ef1f52-ffa6-4ae2-8874-7060691a637d req-ad62d652-503a-4ad7-8b46-dc97a6c2fbd1 service nova] Releasing lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:25:47 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Creating image(s)
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Ensure instance console log exists: /opt/stack/data/nova/instances/f68bf9fb-0b41-48fa-a9d4-a44131abd424/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Start _get_guest_xml network_info=[{"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '1048807d-a55d-4752-9ab7-b7848b4e79a8', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNOQYCvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f68bf9fb-0b41-48fa-a9d4-a44131abd424', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac1a6fda-0266-45a9-962f-60dbd3942042', 'serial': 'ac1a6fda-0266-45a9-962f-60dbd3942042'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:25:47 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:25:47 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNOQYCvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:25:47 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:25:47 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:25:47 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[30751997-44ca-4137-8f1d-3e5d49fe831d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:25:47 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd4d85b-c77e-4f01-b52a-110ce14b597b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042] added
Nov 13 10:25:47 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f5f4fd-1e55-4c86-bbbe-45d3fa260f2d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb29e00-85c3-4b94-b0fd-21b3300c7106]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uNOQYCvV {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uNOQYCvV" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fd96e4-2234-4e1e-af07-d398d6da4ee8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uNOQYCvV'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[764f8313-5aff-40f7-b48b-24ec6fecc009]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[db92496d-73d0-45c5-b46b-0b9ee4810b72]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)
Nov 13 10:25:47 user nova-compute[74611]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf (non-flash)
Nov 13 10:25:47 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)
Nov 13 10:25:47 user nova-compute[74611]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf (non-flash)
Nov 13 10:25:47 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[662dc371-2ea6-491e-8322-232575e53f85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042, portal: 172.16.0.220,3260]
Nov 13 10:25:47 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042, portal: 172.16.0.220,3260] successful.
Nov 13 10:25:47 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a129f49b-119e-48a7-8572-80ac59d00482]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54979ec-a3d4-442d-b5f4-5471ee4bfa99]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)
Nov 13 10:25:47 user nova-compute[74611]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf (non-flash)
Nov 13 10:25:47 user nova-compute[74611]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)
Nov 13 10:25:47 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)
Nov 13 10:25:47 user nova-compute[74611]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf (non-flash)
Nov 13 10:25:47 user nova-compute[74611]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)
Nov 13 10:25:47 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] HCTL ('35', '-', '-', 0) found on session 62 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc0812b-5928-4ecc-9f74-ba7903bbd491]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:25:47 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Searching for a device in session 62 and hctl ['35', '*', '*', 0] yield: None {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Searching for a device in session 62 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNOQYCvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26633303434666366', 'path': '/dev/sdd'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633303434666366', 'path': '/dev/sdd'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1164946694',display_name='tempest-TestShelveInstance-server-1164946694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1164946694',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/St9cs4AH7Rdd5dmRQDk3rEwjBcEeIkVBH+Gk2StDXgzpSQ1Pdkcwpsz2QED2CvNgdH38x1QYihieK5EgZ06RntdTBirJ5jdiwu2iUd+eWQnMTJqsYThl/xt0I6xG5aA==',key_name='tempest-TestShelveInstance-2134255681',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='597eb3324adc4bc79ba58b311df1e7c5',ramdisk_id='',reservation_id='r-6g9rixoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-194060203',owner_user_name='tempest-TestShelveInstance-194060203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:25:43Z,user_data=None,user_id='6ff786be735d47e88024a09965f13fc4',uuid=f68bf9fb-0b41-48fa-a9d4-a44131abd424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Converting VIF {"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d9:91,bridge_name='br-int',has_traffic_filtering=True,id=2b937006-d7f5-4fc2-9275-a9f7d8c189a1,network=Network(e5de37e5-5401-4471-a192-c6b7de88a651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b937006-d7') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG nova.objects.instance [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lazy-loading 'pci_devices' on Instance uuid f68bf9fb-0b41-48fa-a9d4-a44131abd424 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:25:48 user nova-compute[74611]:   <uuid>f68bf9fb-0b41-48fa-a9d4-a44131abd424</uuid>
Nov 13 10:25:48 user nova-compute[74611]:   <name>instance-00000034</name>
Nov 13 10:25:48 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:25:48 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:25:48 user nova-compute[74611]:   <metadata>
Nov 13 10:25:48 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:25:48 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:25:48 user nova-compute[74611]:       <nova:name>tempest-TestShelveInstance-server-1164946694</nova:name>
Nov 13 10:25:48 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:25:47</nova:creationTime>
Nov 13 10:25:48 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:25:48 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:25:48 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:25:48 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:25:48 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:25:48 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:25:48 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:25:48 user nova-compute[74611]:       <nova:owner>
Nov 13 10:25:48 user nova-compute[74611]:         <nova:user uuid="6ff786be735d47e88024a09965f13fc4">tempest-TestShelveInstance-194060203-project-member</nova:user>
Nov 13 10:25:48 user nova-compute[74611]:         <nova:project uuid="597eb3324adc4bc79ba58b311df1e7c5">tempest-TestShelveInstance-194060203</nova:project>
Nov 13 10:25:48 user nova-compute[74611]:       </nova:owner>
Nov 13 10:25:48 user nova-compute[74611]:       <nova:ports>
Nov 13 10:25:48 user nova-compute[74611]:         <nova:port uuid="2b937006-d7f5-4fc2-9275-a9f7d8c189a1">
Nov 13 10:25:48 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 10:25:48 user nova-compute[74611]:         </nova:port>
Nov 13 10:25:48 user nova-compute[74611]:       </nova:ports>
Nov 13 10:25:48 user nova-compute[74611]:     </nova:instance>
Nov 13 10:25:48 user nova-compute[74611]:   </metadata>
Nov 13 10:25:48 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:25:48 user nova-compute[74611]:     <system>
Nov 13 10:25:48 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:25:48 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:25:48 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:25:48 user nova-compute[74611]:       <entry name="serial">f68bf9fb-0b41-48fa-a9d4-a44131abd424</entry>
Nov 13 10:25:48 user nova-compute[74611]:       <entry name="uuid">f68bf9fb-0b41-48fa-a9d4-a44131abd424</entry>
Nov 13 10:25:48 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:25:48 user nova-compute[74611]:     </system>
Nov 13 10:25:48 user nova-compute[74611]:   </sysinfo>
Nov 13 10:25:48 user nova-compute[74611]:   <os>
Nov 13 10:25:48 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:25:48 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:25:48 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:25:48 user nova-compute[74611]:   </os>
Nov 13 10:25:48 user nova-compute[74611]:   <features>
Nov 13 10:25:48 user nova-compute[74611]:     <acpi/>
Nov 13 10:25:48 user nova-compute[74611]:     <apic/>
Nov 13 10:25:48 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:25:48 user nova-compute[74611]:   </features>
Nov 13 10:25:48 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:25:48 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:25:48 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:25:48 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:25:48 user nova-compute[74611]:   </clock>
Nov 13 10:25:48 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:25:48 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:25:48 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:25:48 user nova-compute[74611]:   </cpu>
Nov 13 10:25:48 user nova-compute[74611]:   <devices>
Nov 13 10:25:48 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:25:48 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:25:48 user nova-compute[74611]:       <source dev="/dev/sdd"/>
Nov 13 10:25:48 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:25:48 user nova-compute[74611]:       <serial>ac1a6fda-0266-45a9-962f-60dbd3942042</serial>
Nov 13 10:25:48 user nova-compute[74611]:     </disk>
Nov 13 10:25:48 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:25:48 user nova-compute[74611]:       <mac address="fa:16:3e:9d:d9:91"/>
Nov 13 10:25:48 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:25:48 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:25:48 user nova-compute[74611]:       <target dev="tap2b937006-d7"/>
Nov 13 10:25:48 user nova-compute[74611]:     </interface>
Nov 13 10:25:48 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:25:48 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/f68bf9fb-0b41-48fa-a9d4-a44131abd424/console.log" append="off"/>
Nov 13 10:25:48 user nova-compute[74611]:     </serial>
Nov 13 10:25:48 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:25:48 user nova-compute[74611]:     <video>
Nov 13 10:25:48 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:25:48 user nova-compute[74611]:     </video>
Nov 13 10:25:48 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:25:48 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:25:48 user nova-compute[74611]:     </rng>
Nov 13 10:25:48 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:25:48 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:25:48 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:25:48 user nova-compute[74611]:     </memballoon>
Nov 13 10:25:48 user nova-compute[74611]:   </devices>
Nov 13 10:25:48 user nova-compute[74611]: </domain>
Nov 13 10:25:48 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1164946694',display_name='tempest-TestShelveInstance-server-1164946694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1164946694',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/St9cs4AH7Rdd5dmRQDk3rEwjBcEeIkVBH+Gk2StDXgzpSQ1Pdkcwpsz2QED2CvNgdH38x1QYihieK5EgZ06RntdTBirJ5jdiwu2iUd+eWQnMTJqsYThl/xt0I6xG5aA==',key_name='tempest-TestShelveInstance-2134255681',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='597eb3324adc4bc79ba58b311df1e7c5',ramdisk_id='',reservation_id='r-6g9rixoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-194060203',owner_user_name='tempest-TestShelveInstance-194060203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:25:43Z,user_data=None,user_id='6ff786be735d47e88024a09965f13fc4',uuid=f68bf9fb-0b41-48fa-a9d4-a44131abd424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Converting VIF {"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d9:91,bridge_name='br-int',has_traffic_filtering=True,id=2b937006-d7f5-4fc2-9275-a9f7d8c189a1,network=Network(e5de37e5-5401-4471-a192-c6b7de88a651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b937006-d7') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG os_vif [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d9:91,bridge_name='br-int',has_traffic_filtering=True,id=2b937006-d7f5-4fc2-9275-a9f7d8c189a1,network=Network(e5de37e5-5401-4471-a192-c6b7de88a651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b937006-d7') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03303007-3da0-5aa2-872d-618ba8f516d7', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b937006-d7, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b937006-d7, col_values=(('qos', UUID('b671654f-4069-405e-8ca2-6dc1a3876f65')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b937006-d7, col_values=(('external_ids', {'iface-id': '2b937006-d7f5-4fc2-9275-a9f7d8c189a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:d9:91', 'vm-uuid': 'f68bf9fb-0b41-48fa-a9d4-a44131abd424'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:48 user nova-compute[74611]: INFO os_vif [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d9:91,bridge_name='br-int',has_traffic_filtering=True,id=2b937006-d7f5-4fc2-9275-a9f7d8c189a1,network=Network(e5de37e5-5401-4471-a192-c6b7de88a651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b937006-d7')
Nov 13 10:25:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:25:48 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] No VIF found with MAC fa:16:3e:9d:d9:91, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:25:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-6ccd8be8-1085-4f72-8a26-36b5399d0a27 req-58698852-506f-46ad-875a-5ef7b02c77b2 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received event network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:25:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6ccd8be8-1085-4f72-8a26-36b5399d0a27 req-58698852-506f-46ad-875a-5ef7b02c77b2 service nova] Acquiring lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:25:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6ccd8be8-1085-4f72-8a26-36b5399d0a27 req-58698852-506f-46ad-875a-5ef7b02c77b2 service nova] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:25:50 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6ccd8be8-1085-4f72-8a26-36b5399d0a27 req-58698852-506f-46ad-875a-5ef7b02c77b2 service nova] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:25:50 user nova-compute[74611]: DEBUG nova.compute.manager [req-6ccd8be8-1085-4f72-8a26-36b5399d0a27 req-58698852-506f-46ad-875a-5ef7b02c77b2 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] No waiting events found dispatching network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:25:50 user nova-compute[74611]: WARNING nova.compute.manager [req-6ccd8be8-1085-4f72-8a26-36b5399d0a27 req-58698852-506f-46ad-875a-5ef7b02c77b2 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received unexpected event network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 for instance with vm_state building and task_state spawning.
Nov 13 10:25:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:50 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:25:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:25:52 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Instance spawned successfully.
Nov 13 10:25:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:25:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:25:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:25:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:25:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:25:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:25:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:25:52 user nova-compute[74611]: INFO nova.compute.manager [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 13 10:25:52 user nova-compute[74611]: DEBUG nova.compute.manager [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:25:52 user nova-compute[74611]: INFO nova.compute.manager [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Took 9.74 seconds to build instance.
Nov 13 10:25:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-e3718ba6-3b2c-41ed-a365-d677bc09db99 req-936a809a-c124-4a99-ad3d-b9e099abfd5d service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received event network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:25:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e3718ba6-3b2c-41ed-a365-d677bc09db99 req-936a809a-c124-4a99-ad3d-b9e099abfd5d service nova] Acquiring lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:25:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e3718ba6-3b2c-41ed-a365-d677bc09db99 req-936a809a-c124-4a99-ad3d-b9e099abfd5d service nova] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:25:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-e3718ba6-3b2c-41ed-a365-d677bc09db99 req-936a809a-c124-4a99-ad3d-b9e099abfd5d service nova] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:25:52 user nova-compute[74611]: DEBUG nova.compute.manager [req-e3718ba6-3b2c-41ed-a365-d677bc09db99 req-936a809a-c124-4a99-ad3d-b9e099abfd5d service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] No waiting events found dispatching network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:25:52 user nova-compute[74611]: WARNING nova.compute.manager [req-e3718ba6-3b2c-41ed-a365-d677bc09db99 req-936a809a-c124-4a99-ad3d-b9e099abfd5d service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received unexpected event network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 for instance with vm_state active and task_state None.
Nov 13 10:25:52 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-ea8ac390-6f60-4dd1-b876-7e598f72acc5 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.838s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:25:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:25:59 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:25:59 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:25:59 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:25:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-0fdac3ec-fd51-446d-becb-217c51ecd466" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:25:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-0fdac3ec-fd51-446d-becb-217c51ecd466" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:25:59 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:25:59 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid 0fdac3ec-fd51-446d-becb-217c51ecd466 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:25:59 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Updating instance_info_cache with network_info: [{"id": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "address": "fa:16:3e:17:9b:e5", "network": {"id": "b178054f-dd8e-404f-af05-a4023fd81d93", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-305581073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60965b95c752466ab527ae17ce5eddca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a75ae91-43", "ovs_interfaceid": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:25:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-0fdac3ec-fd51-446d-becb-217c51ecd466" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:25:59 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:26:00 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0fdac3ec-fd51-446d-becb-217c51ecd466 is timed out.
Nov 13 10:26:00 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Successfully detached device vdc from instance 0fdac3ec-fd51-446d-becb-217c51ecd466 from the live domain config.
Nov 13 10:26:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTZBlwCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:26:00 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5499f43e-19e2-47c0-8ff1-cc1fa91c62db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:26:00 user nova-compute[74611]: No targets found.
Nov 13 10:26:00 user nova-compute[74611]: iSNS:
Nov 13 10:26:00 user nova-compute[74611]: No targets found.
Nov 13 10:26:00 user nova-compute[74611]: STATIC:
Nov 13 10:26:00 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf
Nov 13 10:26:00 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:26:00 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:26:00 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96
Nov 13 10:26:00 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:26:00 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:26:00 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042
Nov 13 10:26:00 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:26:00 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:26:00 user nova-compute[74611]: FIRMWARE:
Nov 13 10:26:00 user nova-compute[74611]: No targets found.
Nov 13 10:26:00 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:26:00 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:26:00 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[040ce5dc-9836-43c1-b7b4-ba030dd0c9d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f73217-b8e4-4ceb-91d2-7422576c0863]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)
Nov 13 10:26:00 user nova-compute[74611]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf (non-flash)
Nov 13 10:26:00 user nova-compute[74611]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)
Nov 13 10:26:00 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)
Nov 13 10:26:00 user nova-compute[74611]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf (non-flash)
Nov 13 10:26:00 user nova-compute[74611]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)
Nov 13 10:26:00 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64432050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf'): ({'sdc'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Removing single pathed devices sdc {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb87fd1-fa78-4476-a1d0-f82e42f391a9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc404c2-2859-4f7f-ab27-7dfdf9ae0ece]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Flushing IO for device /dev/sdc {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b47941-5768-4377-999a-a87c7b978572]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcbd85f-a0c2-40bb-a2f8-ea7123e36871]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] SCSI volumes sdc have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[918f06a7-5502-41be-b3cf-4ddd1f50ed67]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c560666-67a6-4a52-ae2d-2953de702162]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf, portal: 172.16.0.220,3260]
Nov 13 10:26:00 user nova-compute[74611]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf, portal: 172.16.0.220,3260] successful.
Nov 13 10:26:00 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4944a96b-3b69-4942-a0c5-45dd34a9dcbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[299c4c21-d437-48a6-8503-f319d36f857b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] <== disconnect_volume: return (280ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:26:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:26:01 user nova-compute[74611]: DEBUG nova.objects.instance [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lazy-loading 'flavor' on Instance uuid 0fdac3ec-fd51-446d-becb-217c51ecd466 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:26:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d7d62058-3462-4c06-9710-88574e82e888 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.574s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:26:01 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:26:03 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:26:03 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:26:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:26:04 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:26:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:26:05 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:26:05 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:26:08 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:26:08 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:26:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:26:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:26:08 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:26:08 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:26:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:26:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:08 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:08 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:26:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:26:09 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:26:09 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:26:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=25.201324462890625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:26:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:26:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:26:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 0fdac3ec-fd51-446d-becb-217c51ecd466 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:26:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f68bf9fb-0b41-48fa-a9d4-a44131abd424 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:26:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:26:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:26:09 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:26:09 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:26:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:26:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:26:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:26:13 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:26:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:26:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:26:15 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:26:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:26:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:26:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:26:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:26:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "0fdac3ec-fd51-446d-becb-217c51ecd466" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:26:30 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:26:30 user nova-compute[74611]: INFO nova.compute.manager [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Detaching volume 5bf34d16-057d-4173-af17-c122c4b8bf96
Nov 13 10:26:30 user nova-compute[74611]: INFO nova.virt.block_device [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Attempting to driver detach volume 5bf34d16-057d-4173-af17-c122c4b8bf96 from mountpoint /dev/vdb
Nov 13 10:26:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Attempting to detach device vdb from instance 0fdac3ec-fd51-446d-becb-217c51ecd466 from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:26:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:26:30 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:26:30 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:26:30 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:26:30 user nova-compute[74611]:   <serial>5bf34d16-057d-4173-af17-c122c4b8bf96</serial>
Nov 13 10:26:30 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:26:30 user nova-compute[74611]: </disk>
Nov 13 10:26:30 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:26:30 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Successfully detached device vdb from instance 0fdac3ec-fd51-446d-becb-217c51ecd466 from the persistent domain config.
Nov 13 10:26:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0fdac3ec-fd51-446d-becb-217c51ecd466 from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:26:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:26:30 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:26:30 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:26:30 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:26:30 user nova-compute[74611]:   <serial>5bf34d16-057d-4173-af17-c122c4b8bf96</serial>
Nov 13 10:26:30 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:26:30 user nova-compute[74611]: </disk>
Nov 13 10:26:30 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:26:30 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0fdac3ec-fd51-446d-becb-217c51ecd466 {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:26:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:26:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:26:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:26:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:26:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:26:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:26:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:26:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:26:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:26:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:26:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:26:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:26:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:26:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:26:50 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0fdac3ec-fd51-446d-becb-217c51ecd466 is timed out.
Nov 13 10:26:50 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Successfully detached device vdb from instance 0fdac3ec-fd51-446d-becb-217c51ecd466 from the live domain config.
Nov 13 10:26:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObCSIUjs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:26:50 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e5d957-a81c-46f8-8b7b-3790cc94fe00]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:26:50 user nova-compute[74611]: No targets found.
Nov 13 10:26:50 user nova-compute[74611]: iSNS:
Nov 13 10:26:50 user nova-compute[74611]: No targets found.
Nov 13 10:26:50 user nova-compute[74611]: STATIC:
Nov 13 10:26:50 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96
Nov 13 10:26:50 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:26:50 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:26:50 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042
Nov 13 10:26:50 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:26:50 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:26:50 user nova-compute[74611]: FIRMWARE:
Nov 13 10:26:50 user nova-compute[74611]: No targets found.
Nov 13 10:26:50 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:26:50 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:26:50 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c19879d-e2d5-4cd2-87ae-6ca72da2845b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[78385663-7b3a-42cd-9ac5-0c60662506dc]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)
Nov 13 10:26:50 user nova-compute[74611]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)
Nov 13 10:26:50 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 (non-flash)
Nov 13 10:26:50 user nova-compute[74611]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)
Nov 13 10:26:50 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb643651b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7310b1-e051-4cc7-88d5-8f07754cace4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[63956bcf-6999-416b-8bf3-b388513524c3]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b43a800-d238-4078-aaf3-1f734f0461b0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf88687-7076-4798-a74a-618a7cfd7136]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc811e2-58ea-4342-aa68-b3f9b413d466]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[854d07eb-fb74-4ad3-bfbf-33970a916f7b]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96, portal: 172.16.0.220,3260]
Nov 13 10:26:50 user nova-compute[74611]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96, portal: 172.16.0.220,3260] successful.
Nov 13 10:26:50 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf34d16-057d-4173-af17-c122c4b8bf96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[678230cc-63e3-4609-9c5f-2c12875067d1]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] <== disconnect_volume: return (329ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:26:50 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:26:51 user nova-compute[74611]: DEBUG nova.objects.instance [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lazy-loading 'flavor' on Instance uuid 0fdac3ec-fd51-446d-becb-217c51ecd466 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:26:51 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-3791d3bd-aaf4-4a6e-98bf-d1a29aa0bcd7 tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.650s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:26:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:26:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:26:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:26:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:26:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:26:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:26:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:26:59 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:26:59 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:26:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:26:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:26:59 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:26:59 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updating instance_info_cache with network_info: [{"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:26:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:26:59 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:27:02 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:27:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:27:04 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:27:04 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:27:06 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:27:07 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:27:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:27:10 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:27:10 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:27:10 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8847MB free_disk=25.200572967529297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:27:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:27:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:27:10 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 0fdac3ec-fd51-446d-becb-217c51ecd466 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:27:10 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f68bf9fb-0b41-48fa-a9d4-a44131abd424 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:27:10 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:27:10 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:27:10 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:27:10 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:27:10 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:27:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:27:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:27:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:27:15 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:27:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:27:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:27:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:27:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:27:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "0fdac3ec-fd51-446d-becb-217c51ecd466" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:27:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:27:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "0fdac3ec-fd51-446d-becb-217c51ecd466-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:27:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:27:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:27:20 user nova-compute[74611]: INFO nova.compute.manager [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Terminating instance
Nov 13 10:27:20 user nova-compute[74611]: DEBUG nova.compute.manager [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:27:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG nova.compute.manager [req-014e4c53-fae3-4ee5-9d93-cb36915d90df req-f342f85a-7685-481b-9282-b150f93420c3 service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Received event network-vif-unplugged-3a75ae91-43cb-4031-b840-8c4f04c9e6e6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-014e4c53-fae3-4ee5-9d93-cb36915d90df req-f342f85a-7685-481b-9282-b150f93420c3 service nova] Acquiring lock "0fdac3ec-fd51-446d-becb-217c51ecd466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-014e4c53-fae3-4ee5-9d93-cb36915d90df req-f342f85a-7685-481b-9282-b150f93420c3 service nova] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-014e4c53-fae3-4ee5-9d93-cb36915d90df req-f342f85a-7685-481b-9282-b150f93420c3 service nova] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG nova.compute.manager [req-014e4c53-fae3-4ee5-9d93-cb36915d90df req-f342f85a-7685-481b-9282-b150f93420c3 service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] No waiting events found dispatching network-vif-unplugged-3a75ae91-43cb-4031-b840-8c4f04c9e6e6 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG nova.compute.manager [req-014e4c53-fae3-4ee5-9d93-cb36915d90df req-f342f85a-7685-481b-9282-b150f93420c3 service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Received event network-vif-unplugged-3a75ae91-43cb-4031-b840-8c4f04c9e6e6 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:27:21 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Instance destroyed successfully.
Nov 13 10:27:21 user nova-compute[74611]: DEBUG nova.objects.instance [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lazy-loading 'resources' on Instance uuid 0fdac3ec-fd51-446d-becb-217c51ecd466 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:23:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-758567933',display_name='tempest-TestServerVolumeAttachmentScenario-server-758567933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-758567933',id=51,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAwJzy6Utqswrs7Z/FQFAgHliLp7CJf2B2Ha5gGTZJrtc8AyCEXy59cd5ws6sgCTx/1sc3tlC8igQRwkp/RRWc9IMtRKX/73Bflg3mI+FIRUSnYXjPtHbLniD/rmingeQ==',key_name='tempest-keypair-1063547603',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:23:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60965b95c752466ab527ae17ce5eddca',ramdisk_id='',reservation_id='r-wttc0yhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-709578559',owner_user_name='tempest-TestServerVolumeAttachmentScenario-709578559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab79aeb071d64eb7a02160d4a6200880',uuid=0fdac3ec-fd51-446d-becb-217c51ecd466,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "address": "fa:16:3e:17:9b:e5", "network": {"id": "b178054f-dd8e-404f-af05-a4023fd81d93", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-305581073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60965b95c752466ab527ae17ce5eddca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a75ae91-43", "ovs_interfaceid": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Converting VIF {"id": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "address": "fa:16:3e:17:9b:e5", "network": {"id": "b178054f-dd8e-404f-af05-a4023fd81d93", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-305581073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60965b95c752466ab527ae17ce5eddca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a75ae91-43", "ovs_interfaceid": "3a75ae91-43cb-4031-b840-8c4f04c9e6e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:9b:e5,bridge_name='br-int',has_traffic_filtering=True,id=3a75ae91-43cb-4031-b840-8c4f04c9e6e6,network=Network(b178054f-dd8e-404f-af05-a4023fd81d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a75ae91-43') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG os_vif [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:9b:e5,bridge_name='br-int',has_traffic_filtering=True,id=3a75ae91-43cb-4031-b840-8c4f04c9e6e6,network=Network(b178054f-dd8e-404f-af05-a4023fd81d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a75ae91-43') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a75ae91-43, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29bb4584-5e64-4def-9f47-c5a5ef3e547f) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:21 user nova-compute[74611]: INFO os_vif [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:9b:e5,bridge_name='br-int',has_traffic_filtering=True,id=3a75ae91-43cb-4031-b840-8c4f04c9e6e6,network=Network(b178054f-dd8e-404f-af05-a4023fd81d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a75ae91-43')
Nov 13 10:27:21 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Deleting instance files /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466_del
Nov 13 10:27:21 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Deletion of /opt/stack/data/nova/instances/0fdac3ec-fd51-446d-becb-217c51ecd466_del complete
Nov 13 10:27:21 user nova-compute[74611]: INFO nova.compute.manager [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 13 10:27:21 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:27:21 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:27:22 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:27:22 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Took 0.93 seconds to deallocate network for instance.
Nov 13 10:27:22 user nova-compute[74611]: DEBUG nova.compute.manager [req-4533064b-ccef-4298-9773-42e2886058a0 req-d6afec4d-0102-46b6-8db6-be2b450b8fdb service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Received event network-vif-deleted-3a75ae91-43cb-4031-b840-8c4f04c9e6e6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:27:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:27:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:27:22 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:27:22 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:27:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:27:22 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Deleted allocations for instance 0fdac3ec-fd51-446d-becb-217c51ecd466
Nov 13 10:27:22 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-85d6851a-944d-46c2-a168-c04605f8f8ee tempest-TestServerVolumeAttachmentScenario-709578559 tempest-TestServerVolumeAttachmentScenario-709578559-project-member] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.254s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:27:23 user nova-compute[74611]: DEBUG nova.compute.manager [req-08b7541f-b0bf-4dfa-b795-b9cae3a11dac req-7192e3ed-0912-4f35-a157-e1580dec4803 service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Received event network-vif-plugged-3a75ae91-43cb-4031-b840-8c4f04c9e6e6 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:27:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-08b7541f-b0bf-4dfa-b795-b9cae3a11dac req-7192e3ed-0912-4f35-a157-e1580dec4803 service nova] Acquiring lock "0fdac3ec-fd51-446d-becb-217c51ecd466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:27:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-08b7541f-b0bf-4dfa-b795-b9cae3a11dac req-7192e3ed-0912-4f35-a157-e1580dec4803 service nova] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:27:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-08b7541f-b0bf-4dfa-b795-b9cae3a11dac req-7192e3ed-0912-4f35-a157-e1580dec4803 service nova] Lock "0fdac3ec-fd51-446d-becb-217c51ecd466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:27:23 user nova-compute[74611]: DEBUG nova.compute.manager [req-08b7541f-b0bf-4dfa-b795-b9cae3a11dac req-7192e3ed-0912-4f35-a157-e1580dec4803 service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] No waiting events found dispatching network-vif-plugged-3a75ae91-43cb-4031-b840-8c4f04c9e6e6 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:27:23 user nova-compute[74611]: WARNING nova.compute.manager [req-08b7541f-b0bf-4dfa-b795-b9cae3a11dac req-7192e3ed-0912-4f35-a157-e1580dec4803 service nova] [instance: 0fdac3ec-fd51-446d-becb-217c51ecd466] Received unexpected event network-vif-plugged-3a75ae91-43cb-4031-b840-8c4f04c9e6e6 for instance with vm_state deleted and task_state None.
Nov 13 10:27:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:27:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:27:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:27:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:27:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-cbcbc762-3fd8-4c48-b982-394617e33aab req-a67f96cd-bb17-4677-a192-70093422130a service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received event network-changed-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:27:34 user nova-compute[74611]: DEBUG nova.compute.manager [req-cbcbc762-3fd8-4c48-b982-394617e33aab req-a67f96cd-bb17-4677-a192-70093422130a service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Refreshing instance network info cache due to event network-changed-2b937006-d7f5-4fc2-9275-a9f7d8c189a1. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:27:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cbcbc762-3fd8-4c48-b982-394617e33aab req-a67f96cd-bb17-4677-a192-70093422130a service nova] Acquiring lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:27:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cbcbc762-3fd8-4c48-b982-394617e33aab req-a67f96cd-bb17-4677-a192-70093422130a service nova] Acquired lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:27:34 user nova-compute[74611]: DEBUG nova.network.neutron [req-cbcbc762-3fd8-4c48-b982-394617e33aab req-a67f96cd-bb17-4677-a192-70093422130a service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Refreshing network info cache for port 2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:27:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:34 user nova-compute[74611]: DEBUG nova.network.neutron [req-cbcbc762-3fd8-4c48-b982-394617e33aab req-a67f96cd-bb17-4677-a192-70093422130a service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updated VIF entry in instance network info cache for port 2b937006-d7f5-4fc2-9275-a9f7d8c189a1. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:27:34 user nova-compute[74611]: DEBUG nova.network.neutron [req-cbcbc762-3fd8-4c48-b982-394617e33aab req-a67f96cd-bb17-4677-a192-70093422130a service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updating instance_info_cache with network_info: [{"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:27:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cbcbc762-3fd8-4c48-b982-394617e33aab req-a67f96cd-bb17-4677-a192-70093422130a service nova] Releasing lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:27:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:27:34 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:27:34 user nova-compute[74611]: INFO nova.compute.manager [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Shelve offloading
Nov 13 10:27:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-6fe40a73-3941-4715-8ba1-962e1d083067 req-786c1414-769e-420a-8704-3dc7597f0290 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received event network-vif-unplugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:27:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6fe40a73-3941-4715-8ba1-962e1d083067 req-786c1414-769e-420a-8704-3dc7597f0290 service nova] Acquiring lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:27:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6fe40a73-3941-4715-8ba1-962e1d083067 req-786c1414-769e-420a-8704-3dc7597f0290 service nova] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:27:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-6fe40a73-3941-4715-8ba1-962e1d083067 req-786c1414-769e-420a-8704-3dc7597f0290 service nova] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:27:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-6fe40a73-3941-4715-8ba1-962e1d083067 req-786c1414-769e-420a-8704-3dc7597f0290 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] No waiting events found dispatching network-vif-unplugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:27:35 user nova-compute[74611]: WARNING nova.compute.manager [req-6fe40a73-3941-4715-8ba1-962e1d083067 req-786c1414-769e-420a-8704-3dc7597f0290 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received unexpected event network-vif-unplugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 for instance with vm_state active and task_state shelving.
Nov 13 10:27:35 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Instance destroyed successfully.
Nov 13 10:27:35 user nova-compute[74611]: DEBUG nova.compute.manager [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:27:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:27:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquired lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:27:35 user nova-compute[74611]: DEBUG nova.network.neutron [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG nova.network.neutron [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updating instance_info_cache with network_info: [{"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Releasing lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:36 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Instance destroyed successfully.
Nov 13 10:27:36 user nova-compute[74611]: DEBUG nova.objects.instance [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lazy-loading 'resources' on Instance uuid f68bf9fb-0b41-48fa-a9d4-a44131abd424 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1164946694',display_name='tempest-TestShelveInstance-server-1164946694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1164946694',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/St9cs4AH7Rdd5dmRQDk3rEwjBcEeIkVBH+Gk2StDXgzpSQ1Pdkcwpsz2QED2CvNgdH38x1QYihieK5EgZ06RntdTBirJ5jdiwu2iUd+eWQnMTJqsYThl/xt0I6xG5aA==',key_name='tempest-TestShelveInstance-2134255681',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:25:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='597eb3324adc4bc79ba58b311df1e7c5',ramdisk_id='',reservation_id='r-6g9rixoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-194060203',owner_user_name='tempest-TestShelveInstance-194060203-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:25:52Z,user_data=None,user_id='6ff786be735d47e88024a09965f13fc4',uuid=f68bf9fb-0b41-48fa-a9d4-a44131abd424,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Converting VIF {"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d9:91,bridge_name='br-int',has_traffic_filtering=True,id=2b937006-d7f5-4fc2-9275-a9f7d8c189a1,network=Network(e5de37e5-5401-4471-a192-c6b7de88a651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b937006-d7') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_vif [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d9:91,bridge_name='br-int',has_traffic_filtering=True,id=2b937006-d7f5-4fc2-9275-a9f7d8c189a1,network=Network(e5de37e5-5401-4471-a192-c6b7de88a651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b937006-d7') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b937006-d7, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-91db65f5-51c4-412f-9a0d-83ab5fbc9ea1 req-f265c1d4-4440-4032-8b07-d14e47766f8f service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received event network-changed-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG nova.compute.manager [req-91db65f5-51c4-412f-9a0d-83ab5fbc9ea1 req-f265c1d4-4440-4032-8b07-d14e47766f8f service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Refreshing instance network info cache due to event network-changed-2b937006-d7f5-4fc2-9275-a9f7d8c189a1. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-91db65f5-51c4-412f-9a0d-83ab5fbc9ea1 req-f265c1d4-4440-4032-8b07-d14e47766f8f service nova] Acquiring lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-91db65f5-51c4-412f-9a0d-83ab5fbc9ea1 req-f265c1d4-4440-4032-8b07-d14e47766f8f service nova] Acquired lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG nova.network.neutron [req-91db65f5-51c4-412f-9a0d-83ab5fbc9ea1 req-f265c1d4-4440-4032-8b07-d14e47766f8f service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Refreshing network info cache for port 2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b671654f-4069-405e-8ca2-6dc1a3876f65) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:27:36 user nova-compute[74611]: INFO os_vif [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d9:91,bridge_name='br-int',has_traffic_filtering=True,id=2b937006-d7f5-4fc2-9275-a9f7d8c189a1,network=Network(e5de37e5-5401-4471-a192-c6b7de88a651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b937006-d7')
Nov 13 10:27:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNOQYCvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:27:36 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ee2963-0907-43d2-bc6b-a00ee47d9019]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:27:36 user nova-compute[74611]: No targets found.
Nov 13 10:27:36 user nova-compute[74611]: iSNS:
Nov 13 10:27:36 user nova-compute[74611]: No targets found.
Nov 13 10:27:36 user nova-compute[74611]: STATIC:
Nov 13 10:27:36 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042
Nov 13 10:27:36 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:27:36 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:27:36 user nova-compute[74611]: FIRMWARE:
Nov 13 10:27:36 user nova-compute[74611]: No targets found.
Nov 13 10:27:36 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:27:36 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:27:36 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[648de977-2e22-46cb-a140-ced47b2e477d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[18050169-373b-4183-a3ad-552f65275aaf]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)
Nov 13 10:27:36 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)
Nov 13 10:27:36 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7c14d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042'): ({'sdd'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Removing single pathed devices sdd {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[677a47b4-228c-45be-8601-5a1cb93306b4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9832155a-7cab-46c7-bd7f-98f3be54f778]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Flushing IO for device /dev/sdd {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f55ead7-9b7d-44a5-a999-62adca3bfe53]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6111640a-944f-4b41-8c5c-5ead724a60fe]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] SCSI volumes sdd have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[abce8a8a-481c-4e98-9d83-3f94802115fd]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7113d381-7a3c-4ea9-a70c-0dde8bdc22fd]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042, portal: 172.16.0.220,3260]
Nov 13 10:27:36 user nova-compute[74611]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042, portal: 172.16.0.220,3260] successful.
Nov 13 10:27:36 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4609c9-6128-4fdb-b546-415e95e2883c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] <== disconnect_volume: return (267ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:27:36 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:27:36 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Deleting instance files /opt/stack/data/nova/instances/f68bf9fb-0b41-48fa-a9d4-a44131abd424_del
Nov 13 10:27:36 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Deletion of /opt/stack/data/nova/instances/f68bf9fb-0b41-48fa-a9d4-a44131abd424_del complete
Nov 13 10:27:37 user nova-compute[74611]: DEBUG nova.network.neutron [req-91db65f5-51c4-412f-9a0d-83ab5fbc9ea1 req-f265c1d4-4440-4032-8b07-d14e47766f8f service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updated VIF entry in instance network info cache for port 2b937006-d7f5-4fc2-9275-a9f7d8c189a1. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:27:37 user nova-compute[74611]: DEBUG nova.network.neutron [req-91db65f5-51c4-412f-9a0d-83ab5fbc9ea1 req-f265c1d4-4440-4032-8b07-d14e47766f8f service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updating instance_info_cache with network_info: [{"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": null, "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2b937006-d7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:27:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-91db65f5-51c4-412f-9a0d-83ab5fbc9ea1 req-f265c1d4-4440-4032-8b07-d14e47766f8f service nova] Releasing lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:27:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-70d3eec9-628f-41a4-875d-f15c44fcff96 req-58f444be-67a2-45d7-8d00-21a37f53d9b7 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received event network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:27:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-70d3eec9-628f-41a4-875d-f15c44fcff96 req-58f444be-67a2-45d7-8d00-21a37f53d9b7 service nova] Acquiring lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:27:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-70d3eec9-628f-41a4-875d-f15c44fcff96 req-58f444be-67a2-45d7-8d00-21a37f53d9b7 service nova] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:27:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-70d3eec9-628f-41a4-875d-f15c44fcff96 req-58f444be-67a2-45d7-8d00-21a37f53d9b7 service nova] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:27:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-70d3eec9-628f-41a4-875d-f15c44fcff96 req-58f444be-67a2-45d7-8d00-21a37f53d9b7 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] No waiting events found dispatching network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:27:37 user nova-compute[74611]: WARNING nova.compute.manager [req-70d3eec9-628f-41a4-875d-f15c44fcff96 req-58f444be-67a2-45d7-8d00-21a37f53d9b7 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received unexpected event network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 for instance with vm_state active and task_state shelving.
Nov 13 10:27:37 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Deleted allocations for instance f68bf9fb-0b41-48fa-a9d4-a44131abd424
Nov 13 10:27:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:27:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:27:37 user nova-compute[74611]: DEBUG nova.objects.instance [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lazy-loading 'numa_topology' on Instance uuid f68bf9fb-0b41-48fa-a9d4-a44131abd424 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:27:37 user nova-compute[74611]: DEBUG nova.objects.base [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Object Instance<f68bf9fb-0b41-48fa-a9d4-a44131abd424> lazy-loaded attributes: resources,numa_topology {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:27:37 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:27:37 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:27:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:27:38 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-55556d2c-7a7f-43c0-8c50-849514782225 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.192s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:27:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:27:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:27:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:27:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:27:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:27:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:27:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:00 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:28:00 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:28:00 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:28:00 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Didn't find any instances for network info cache update. {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 10:28:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:28:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:28:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:28:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:28:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:03 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:28:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:05 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:28:05 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:28:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:07 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:28:08 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:28:08 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:28:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:28:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:28:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:28:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:28:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:28:09 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:28:09 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:28:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=9069MB free_disk=25.22753143310547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:28:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:28:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:28:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:28:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:28:09 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:28:09 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:28:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:28:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:28:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:28:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:28:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:28:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:28:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:11 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:28:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:28:15 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:16 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:28:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:28:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:28:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:28:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:28:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:28:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:28:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:28:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:28:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:28:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:28:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:41 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:28:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:28:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:28:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:28:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:28:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:28:46 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:28:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:28:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:28:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:28:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:28:51 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:28:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:28:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:28:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:28:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:28:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:00 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:29:00 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:29:00 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:29:00 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Didn't find any instances for network info cache update. {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 10:29:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:29:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:29:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:29:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:29:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:29:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:05 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:29:06 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:29:06 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:29:06 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:29:08 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:29:08 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:29:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:29:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:29:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:29:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:29:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:29:09 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:29:09 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:29:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=9151MB free_disk=25.22635269165039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:29:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:29:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:29:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:29:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:29:09 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:29:09 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:29:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:29:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.104s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:29:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:29:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:29:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:29:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:29:11 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:12 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:29:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:29:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:29:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:29:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:29:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:29:16 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:18 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:29:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:29:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:29:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:29:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:29:21 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:29:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:29:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:29:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:29:26 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:29:26 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:29:26 user nova-compute[74611]: INFO nova.compute.manager [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Unshelving
Nov 13 10:29:26 user nova-compute[74611]: INFO nova.virt.block_device [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Booting with volume ac1a6fda-0266-45a9-962f-60dbd3942042 at /dev/vda
Nov 13 10:29:27 user nova-compute[74611]: DEBUG os_brick.utils [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[970f4e30-37bf-4c3b-bb2c-5cccc545eb65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa3326a-aa89-488f-a933-38c5dbef69a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4172ac9e-1f3e-4251-b6b5-bb769aa7f01d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5042ec-5e83-4e63-b671-e0c6105c39a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:29:27 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:29:27 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb4f43c-a1b5-4b3b-9934-dc69af5d478b]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG os_brick.utils [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:29:27 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updating existing volume attachment record: ef72c76e-38ae-4881-91bb-d3c7166e2fc6 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:29:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:29:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:29:31 user nova-compute[74611]: DEBUG nova.objects.instance [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lazy-loading 'pci_requests' on Instance uuid f68bf9fb-0b41-48fa-a9d4-a44131abd424 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:29:31 user nova-compute[74611]: DEBUG nova.objects.instance [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lazy-loading 'numa_topology' on Instance uuid f68bf9fb-0b41-48fa-a9d4-a44131abd424 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:29:31 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:29:31 user nova-compute[74611]: INFO nova.compute.claims [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Claim successful on node user
Nov 13 10:29:31 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:29:31 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:29:31 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:29:31 user nova-compute[74611]: INFO nova.network.neutron [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updating port 2b937006-d7f5-4fc2-9275-a9f7d8c189a1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 13 10:29:31 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Verify base images {{(pid=74611) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74611) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 13 10:29:32 user nova-compute[74611]: WARNING nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4c1aa6280fe61b48abd448d077f18851b81c355d
Nov 13 10:29:32 user nova-compute[74611]: WARNING nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915
Nov 13 10:29:32 user nova-compute[74611]: WARNING nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d
Nov 13 10:29:32 user nova-compute[74611]: WARNING nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Unknown base file: /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57
Nov 13 10:29:32 user nova-compute[74611]: WARNING nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Unknown base file: /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715
Nov 13 10:29:32 user nova-compute[74611]: WARNING nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b33a9cc7de8ff36b44342335baccbab6791f21bd
Nov 13 10:29:32 user nova-compute[74611]: WARNING nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7
Nov 13 10:29:32 user nova-compute[74611]: WARNING nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2c8615f7764bcabff4370b636e29b1103134a23a
Nov 13 10:29:32 user nova-compute[74611]: WARNING nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd
Nov 13 10:29:32 user nova-compute[74611]: WARNING nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4
Nov 13 10:29:32 user nova-compute[74611]: INFO nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Removable base files: /opt/stack/data/nova/instances/_base/4c1aa6280fe61b48abd448d077f18851b81c355d /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57 /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715 /opt/stack/data/nova/instances/_base/b33a9cc7de8ff36b44342335baccbab6791f21bd /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7 /opt/stack/data/nova/instances/_base/2c8615f7764bcabff4370b636e29b1103134a23a /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4
Nov 13 10:29:32 user nova-compute[74611]: INFO nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4c1aa6280fe61b48abd448d077f18851b81c355d
Nov 13 10:29:32 user nova-compute[74611]: INFO nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915
Nov 13 10:29:32 user nova-compute[74611]: INFO nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ccfefe55fae6d87cd8496c0bf8d766bbde6ef09d
Nov 13 10:29:32 user nova-compute[74611]: INFO nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/385d1671726baa076097a97422a6c21c45484b57
Nov 13 10:29:32 user nova-compute[74611]: INFO nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/965225700c29c9f7174a11f26beb75c950695715
Nov 13 10:29:32 user nova-compute[74611]: INFO nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b33a9cc7de8ff36b44342335baccbab6791f21bd
Nov 13 10:29:32 user nova-compute[74611]: INFO nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2caa0348060be914dfdb4919bc14bc1e9d5954f7
Nov 13 10:29:32 user nova-compute[74611]: INFO nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2c8615f7764bcabff4370b636e29b1103134a23a
Nov 13 10:29:32 user nova-compute[74611]: INFO nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b3077f86d24b8b00183b107703a73b688a91fbfd
Nov 13 10:29:32 user nova-compute[74611]: INFO nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7d46eeeb2175a8865dd9c8bd9424e94d123922e4
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Verification complete {{(pid=74611) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Verify swap images {{(pid=74611) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.imagecache [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Verify ephemeral images {{(pid=74611) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquired lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.network.neutron [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-98454cc3-412c-412b-ad26-8f077938cf93 req-e77fb04f-aa23-4e88-825a-0ea48e1da14c service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received event network-changed-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.compute.manager [req-98454cc3-412c-412b-ad26-8f077938cf93 req-e77fb04f-aa23-4e88-825a-0ea48e1da14c service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Refreshing instance network info cache due to event network-changed-2b937006-d7f5-4fc2-9275-a9f7d8c189a1. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-98454cc3-412c-412b-ad26-8f077938cf93 req-e77fb04f-aa23-4e88-825a-0ea48e1da14c service nova] Acquiring lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.network.neutron [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updating instance_info_cache with network_info: [{"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Releasing lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:29:32 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Creating image(s)
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Did not create local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Ensure instance console log exists: /opt/stack/data/nova/instances/f68bf9fb-0b41-48fa-a9d4-a44131abd424/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Start _get_guest_xml network_info=[{"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'ef72c76e-38ae-4881-91bb-d3c7166e2fc6', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNOQYCvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f68bf9fb-0b41-48fa-a9d4-a44131abd424', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac1a6fda-0266-45a9-962f-60dbd3942042', 'serial': 'ac1a6fda-0266-45a9-962f-60dbd3942042'}, 'volume_type': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-98454cc3-412c-412b-ad26-8f077938cf93 req-e77fb04f-aa23-4e88-825a-0ea48e1da14c service nova] Acquired lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.network.neutron [req-98454cc3-412c-412b-ad26-8f077938cf93 req-e77fb04f-aa23-4e88-825a-0ea48e1da14c service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Refreshing network info cache for port 2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:29:32 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:29:32 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.objects.instance [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lazy-loading 'vcpu_model' on Instance uuid f68bf9fb-0b41-48fa-a9d4-a44131abd424 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.objects.base [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Object Instance<f68bf9fb-0b41-48fa-a9d4-a44131abd424> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNOQYCvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:29:32 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:29:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:29:32 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:29:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:29:32 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23e8900-c1ef-4eed-a38a-77ddfe86bd64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:29:32 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[177f487f-f1ff-4b46-8096-2c44e86d6eaf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042] added
Nov 13 10:29:32 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[18021342-cf46-49d7-968c-9e63ffadc22a]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7758e0d1-2b65-40c0-a37a-08b38fcd62a0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uNOQYCvV {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uNOQYCvV" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4cbcc2-b81c-4753-bfbc-4bae97cca4e9]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uNOQYCvV'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f0e9cf-7056-43ed-8e63-230a21209db3]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[545082f3-4377-4540-80c3-32ab2815df1f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 10:29:32 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:29:32 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 10:29:32 user nova-compute[74611]:  {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:29:32 user nova-compute[74611]: WARNING os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 10:29:32 user nova-compute[74611]: 
Nov 13 10:29:32 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0289f2-8b13-4529-9e74-f05dec0f3e89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042, portal: 172.16.0.220,3260]
Nov 13 10:29:33 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042, portal: 172.16.0.220,3260] successful.
Nov 13 10:29:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1e36ef-539e-4fb3-8d37-1618be55c90b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[117e5046-aeb6-4c2d-a835-a0d2c7042c57]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)
Nov 13 10:29:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)
Nov 13 10:29:33 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[77adff46-4ad7-455e-b1e2-5f84c7c4da04]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNOQYCvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG nova.network.neutron [req-98454cc3-412c-412b-ad26-8f077938cf93 req-e77fb04f-aa23-4e88-825a-0ea48e1da14c service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updated VIF entry in instance network info cache for port 2b937006-d7f5-4fc2-9275-a9f7d8c189a1. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG nova.network.neutron [req-98454cc3-412c-412b-ad26-8f077938cf93 req-e77fb04f-aa23-4e88-825a-0ea48e1da14c service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updating instance_info_cache with network_info: [{"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:29:33 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-98454cc3-412c-412b-ad26-8f077938cf93 req-e77fb04f-aa23-4e88-825a-0ea48e1da14c service nova] Releasing lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26633303434666366', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633303434666366', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T10:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1164946694',display_name='tempest-TestShelveInstance-server-1164946694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1164946694',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2134255681',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:25:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='597eb3324adc4bc79ba58b311df1e7c5',ramdisk_id='',reservation_id='r-6g9rixoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-194060203',owner_user_name='tempest-TestShelveInstance-194060203-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:29:27Z,user_data=None,user_id='6ff786be735d47e88024a09965f13fc4',uuid=f68bf9fb-0b41-48fa-a9d4-a44131abd424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Converting VIF {"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d9:91,bridge_name='br-int',has_traffic_filtering=True,id=2b937006-d7f5-4fc2-9275-a9f7d8c189a1,network=Network(e5de37e5-5401-4471-a192-c6b7de88a651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b937006-d7') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG nova.objects.instance [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lazy-loading 'pci_devices' on Instance uuid f68bf9fb-0b41-48fa-a9d4-a44131abd424 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG nova.objects.base [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Object Instance<f68bf9fb-0b41-48fa-a9d4-a44131abd424> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74611) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:29:34 user nova-compute[74611]:   <uuid>f68bf9fb-0b41-48fa-a9d4-a44131abd424</uuid>
Nov 13 10:29:34 user nova-compute[74611]:   <name>instance-00000034</name>
Nov 13 10:29:34 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:29:34 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:29:34 user nova-compute[74611]:   <metadata>
Nov 13 10:29:34 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:29:34 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:29:34 user nova-compute[74611]:       <nova:name>tempest-TestShelveInstance-server-1164946694</nova:name>
Nov 13 10:29:34 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:29:32</nova:creationTime>
Nov 13 10:29:34 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:29:34 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:29:34 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:29:34 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:29:34 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:29:34 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:29:34 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:29:34 user nova-compute[74611]:       <nova:owner>
Nov 13 10:29:34 user nova-compute[74611]:         <nova:user uuid="6ff786be735d47e88024a09965f13fc4">tempest-TestShelveInstance-194060203-project-member</nova:user>
Nov 13 10:29:34 user nova-compute[74611]:         <nova:project uuid="597eb3324adc4bc79ba58b311df1e7c5">tempest-TestShelveInstance-194060203</nova:project>
Nov 13 10:29:34 user nova-compute[74611]:       </nova:owner>
Nov 13 10:29:34 user nova-compute[74611]:       <nova:ports>
Nov 13 10:29:34 user nova-compute[74611]:         <nova:port uuid="2b937006-d7f5-4fc2-9275-a9f7d8c189a1">
Nov 13 10:29:34 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 10:29:34 user nova-compute[74611]:         </nova:port>
Nov 13 10:29:34 user nova-compute[74611]:       </nova:ports>
Nov 13 10:29:34 user nova-compute[74611]:     </nova:instance>
Nov 13 10:29:34 user nova-compute[74611]:   </metadata>
Nov 13 10:29:34 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:29:34 user nova-compute[74611]:     <system>
Nov 13 10:29:34 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:29:34 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:29:34 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:29:34 user nova-compute[74611]:       <entry name="serial">f68bf9fb-0b41-48fa-a9d4-a44131abd424</entry>
Nov 13 10:29:34 user nova-compute[74611]:       <entry name="uuid">f68bf9fb-0b41-48fa-a9d4-a44131abd424</entry>
Nov 13 10:29:34 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:29:34 user nova-compute[74611]:     </system>
Nov 13 10:29:34 user nova-compute[74611]:   </sysinfo>
Nov 13 10:29:34 user nova-compute[74611]:   <os>
Nov 13 10:29:34 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:29:34 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:29:34 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:29:34 user nova-compute[74611]:   </os>
Nov 13 10:29:34 user nova-compute[74611]:   <features>
Nov 13 10:29:34 user nova-compute[74611]:     <acpi/>
Nov 13 10:29:34 user nova-compute[74611]:     <apic/>
Nov 13 10:29:34 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:29:34 user nova-compute[74611]:   </features>
Nov 13 10:29:34 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:29:34 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:29:34 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:29:34 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:29:34 user nova-compute[74611]:   </clock>
Nov 13 10:29:34 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:29:34 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:29:34 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:29:34 user nova-compute[74611]:   </cpu>
Nov 13 10:29:34 user nova-compute[74611]:   <devices>
Nov 13 10:29:34 user nova-compute[74611]:     <disk type="block" device="disk">
Nov 13 10:29:34 user nova-compute[74611]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:29:34 user nova-compute[74611]:       <source dev="/dev/sdb"/>
Nov 13 10:29:34 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:29:34 user nova-compute[74611]:       <serial>ac1a6fda-0266-45a9-962f-60dbd3942042</serial>
Nov 13 10:29:34 user nova-compute[74611]:     </disk>
Nov 13 10:29:34 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:29:34 user nova-compute[74611]:       <mac address="fa:16:3e:9d:d9:91"/>
Nov 13 10:29:34 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:29:34 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:29:34 user nova-compute[74611]:       <target dev="tap2b937006-d7"/>
Nov 13 10:29:34 user nova-compute[74611]:     </interface>
Nov 13 10:29:34 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:29:34 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/f68bf9fb-0b41-48fa-a9d4-a44131abd424/console.log" append="off"/>
Nov 13 10:29:34 user nova-compute[74611]:     </serial>
Nov 13 10:29:34 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:29:34 user nova-compute[74611]:     <video>
Nov 13 10:29:34 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:29:34 user nova-compute[74611]:     </video>
Nov 13 10:29:34 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:29:34 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:29:34 user nova-compute[74611]:     </rng>
Nov 13 10:29:34 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:29:34 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:29:34 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:29:34 user nova-compute[74611]:     </memballoon>
Nov 13 10:29:34 user nova-compute[74611]:   </devices>
Nov 13 10:29:34 user nova-compute[74611]: </domain>
Nov 13 10:29:34 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T10:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1164946694',display_name='tempest-TestShelveInstance-server-1164946694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1164946694',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2134255681',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:25:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='597eb3324adc4bc79ba58b311df1e7c5',ramdisk_id='',reservation_id='r-6g9rixoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-194060203',owner_user_name='tempest-TestShelveInstance-194060203-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:29:27Z,user_data=None,user_id='6ff786be735d47e88024a09965f13fc4',uuid=f68bf9fb-0b41-48fa-a9d4-a44131abd424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Converting VIF {"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d9:91,bridge_name='br-int',has_traffic_filtering=True,id=2b937006-d7f5-4fc2-9275-a9f7d8c189a1,network=Network(e5de37e5-5401-4471-a192-c6b7de88a651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b937006-d7') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG os_vif [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d9:91,bridge_name='br-int',has_traffic_filtering=True,id=2b937006-d7f5-4fc2-9275-a9f7d8c189a1,network=Network(e5de37e5-5401-4471-a192-c6b7de88a651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b937006-d7') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03303007-3da0-5aa2-872d-618ba8f516d7', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b937006-d7, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b937006-d7, col_values=(('qos', UUID('e6e62118-dcb9-4847-a9bc-5d70c79ca6c9')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b937006-d7, col_values=(('external_ids', {'iface-id': '2b937006-d7f5-4fc2-9275-a9f7d8c189a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:d9:91', 'vm-uuid': 'f68bf9fb-0b41-48fa-a9d4-a44131abd424'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:34 user nova-compute[74611]: INFO os_vif [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d9:91,bridge_name='br-int',has_traffic_filtering=True,id=2b937006-d7f5-4fc2-9275-a9f7d8c189a1,network=Network(e5de37e5-5401-4471-a192-c6b7de88a651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b937006-d7')
Nov 13 10:29:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:29:34 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] No VIF found with MAC fa:16:3e:9d:d9:91, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:29:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:35 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-5cf8e078-bbe1-4326-94d0-664458a3adde req-c6db42d2-c861-46d4-94b5-3d4dae86d633 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received event network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:29:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5cf8e078-bbe1-4326-94d0-664458a3adde req-c6db42d2-c861-46d4-94b5-3d4dae86d633 service nova] Acquiring lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:29:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5cf8e078-bbe1-4326-94d0-664458a3adde req-c6db42d2-c861-46d4-94b5-3d4dae86d633 service nova] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:29:35 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5cf8e078-bbe1-4326-94d0-664458a3adde req-c6db42d2-c861-46d4-94b5-3d4dae86d633 service nova] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:29:35 user nova-compute[74611]: DEBUG nova.compute.manager [req-5cf8e078-bbe1-4326-94d0-664458a3adde req-c6db42d2-c861-46d4-94b5-3d4dae86d633 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] No waiting events found dispatching network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:29:35 user nova-compute[74611]: WARNING nova.compute.manager [req-5cf8e078-bbe1-4326-94d0-664458a3adde req-c6db42d2-c861-46d4-94b5-3d4dae86d633 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received unexpected event network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 10:29:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:36 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:37 user nova-compute[74611]: DEBUG nova.compute.manager [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:29:37 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:29:37 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Instance spawned successfully.
Nov 13 10:29:37 user nova-compute[74611]: DEBUG nova.compute.manager [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:29:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-441464c6-d469-464b-afdb-418681e43530 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.754s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:29:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-2803f6a0-ab51-4023-9265-2f64fad942da req-0e1cb5f9-1afb-4ac9-a8d3-442f922754a7 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received event network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:29:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2803f6a0-ab51-4023-9265-2f64fad942da req-0e1cb5f9-1afb-4ac9-a8d3-442f922754a7 service nova] Acquiring lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:29:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2803f6a0-ab51-4023-9265-2f64fad942da req-0e1cb5f9-1afb-4ac9-a8d3-442f922754a7 service nova] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:29:37 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2803f6a0-ab51-4023-9265-2f64fad942da req-0e1cb5f9-1afb-4ac9-a8d3-442f922754a7 service nova] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:29:37 user nova-compute[74611]: DEBUG nova.compute.manager [req-2803f6a0-ab51-4023-9265-2f64fad942da req-0e1cb5f9-1afb-4ac9-a8d3-442f922754a7 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] No waiting events found dispatching network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:29:37 user nova-compute[74611]: WARNING nova.compute.manager [req-2803f6a0-ab51-4023-9265-2f64fad942da req-0e1cb5f9-1afb-4ac9-a8d3-442f922754a7 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received unexpected event network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 for instance with vm_state active and task_state None.
Nov 13 10:29:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:29:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:29:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:29:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:29:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:29:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:29:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:29:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:29:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:29:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:29:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:30:02 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:30:02 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:30:02 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:30:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:30:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:30:02 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:30:02 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid f68bf9fb-0b41-48fa-a9d4-a44131abd424 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:30:02 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updating instance_info_cache with network_info: [{"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:30:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:30:02 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:30:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:30:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:30:06 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:30:07 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:30:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:30:08 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:30:09 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:30:09 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:30:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.224777221679688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f68bf9fb-0b41-48fa-a9d4-a44131abd424 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing inventories for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating ProviderTree inventory for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating inventory in ProviderTree for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing aggregate associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, aggregates: None {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing trait associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 10:30:09 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:30:10 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:30:10 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:30:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:30:11 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:30:11 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 10:30:11 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] There are 0 instances to clean {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 10:30:12 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:30:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:30:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:30:19 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:30:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:30:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:30:29 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:30:29 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74611) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 10:30:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:30:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:30:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:30:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:30:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:30:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:30:29 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:30:34 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:30:39 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:30:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:30:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:30:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:30:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:30:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:30:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:30:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:30:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:30:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:03 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:31:03 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:31:03 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:31:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:31:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:31:03 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:31:03 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid f68bf9fb-0b41-48fa-a9d4-a44131abd424 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:31:03 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updating instance_info_cache with network_info: [{"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:31:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:31:03 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:31:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:31:08 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:31:08 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74611) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 10:31:09 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:31:09 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:31:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=9005MB free_disk=25.216411590576172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance f68bf9fb-0b41-48fa-a9d4-a44131abd424 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:31:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:31:11 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:31:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:31:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:31:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:31:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:31:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:31:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:16 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:31:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:17 user nova-compute[74611]: DEBUG nova.compute.manager [req-cdada8df-4588-4505-ad19-2362b5ccbf67 req-8cea2878-db63-4311-8743-499cda171f15 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received event network-changed-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:31:17 user nova-compute[74611]: DEBUG nova.compute.manager [req-cdada8df-4588-4505-ad19-2362b5ccbf67 req-8cea2878-db63-4311-8743-499cda171f15 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Refreshing instance network info cache due to event network-changed-2b937006-d7f5-4fc2-9275-a9f7d8c189a1. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:31:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cdada8df-4588-4505-ad19-2362b5ccbf67 req-8cea2878-db63-4311-8743-499cda171f15 service nova] Acquiring lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:31:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cdada8df-4588-4505-ad19-2362b5ccbf67 req-8cea2878-db63-4311-8743-499cda171f15 service nova] Acquired lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:31:17 user nova-compute[74611]: DEBUG nova.network.neutron [req-cdada8df-4588-4505-ad19-2362b5ccbf67 req-8cea2878-db63-4311-8743-499cda171f15 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Refreshing network info cache for port 2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:31:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:31:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:31:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:31:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:31:17 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:31:17 user nova-compute[74611]: INFO nova.compute.manager [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Terminating instance
Nov 13 10:31:17 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:31:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG nova.network.neutron [req-cdada8df-4588-4505-ad19-2362b5ccbf67 req-8cea2878-db63-4311-8743-499cda171f15 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updated VIF entry in instance network info cache for port 2b937006-d7f5-4fc2-9275-a9f7d8c189a1. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG nova.network.neutron [req-cdada8df-4588-4505-ad19-2362b5ccbf67 req-8cea2878-db63-4311-8743-499cda171f15 service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updating instance_info_cache with network_info: [{"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-cdada8df-4588-4505-ad19-2362b5ccbf67 req-8cea2878-db63-4311-8743-499cda171f15 service nova] Releasing lock "refresh_cache-f68bf9fb-0b41-48fa-a9d4-a44131abd424" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:18 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Instance destroyed successfully.
Nov 13 10:31:18 user nova-compute[74611]: DEBUG nova.objects.instance [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lazy-loading 'resources' on Instance uuid f68bf9fb-0b41-48fa-a9d4-a44131abd424 {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T10:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1164946694',display_name='tempest-TestShelveInstance-server-1164946694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1164946694',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/St9cs4AH7Rdd5dmRQDk3rEwjBcEeIkVBH+Gk2StDXgzpSQ1Pdkcwpsz2QED2CvNgdH38x1QYihieK5EgZ06RntdTBirJ5jdiwu2iUd+eWQnMTJqsYThl/xt0I6xG5aA==',key_name='tempest-TestShelveInstance-2134255681',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:29:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='597eb3324adc4bc79ba58b311df1e7c5',ramdisk_id='',reservation_id='r-6g9rixoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-194060203',owner_user_name='tempest-TestShelveInstance-194060203-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:29:38Z,user_data=None,user_id='6ff786be735d47e88024a09965f13fc4',uuid=f68bf9fb-0b41-48fa-a9d4-a44131abd424,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Converting VIF {"id": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "address": "fa:16:3e:9d:d9:91", "network": {"id": "e5de37e5-5401-4471-a192-c6b7de88a651", "bridge": "br-int", "label": "tempest-TestShelveInstance-1113720180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597eb3324adc4bc79ba58b311df1e7c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b937006-d7", "ovs_interfaceid": "2b937006-d7f5-4fc2-9275-a9f7d8c189a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:d9:91,bridge_name='br-int',has_traffic_filtering=True,id=2b937006-d7f5-4fc2-9275-a9f7d8c189a1,network=Network(e5de37e5-5401-4471-a192-c6b7de88a651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b937006-d7') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_vif [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:d9:91,bridge_name='br-int',has_traffic_filtering=True,id=2b937006-d7f5-4fc2-9275-a9f7d8c189a1,network=Network(e5de37e5-5401-4471-a192-c6b7de88a651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b937006-d7') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b937006-d7, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6e62118-dcb9-4847-a9bc-5d70c79ca6c9) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:31:18 user nova-compute[74611]: INFO os_vif [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:d9:91,bridge_name='br-int',has_traffic_filtering=True,id=2b937006-d7f5-4fc2-9275-a9f7d8c189a1,network=Network(e5de37e5-5401-4471-a192-c6b7de88a651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b937006-d7')
Nov 13 10:31:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNOQYCvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:31:18 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1374083-d7a8-4d57-bebc-5a0e5c1b6323]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:31:18 user nova-compute[74611]: No targets found.
Nov 13 10:31:18 user nova-compute[74611]: iSNS:
Nov 13 10:31:18 user nova-compute[74611]: No targets found.
Nov 13 10:31:18 user nova-compute[74611]: STATIC:
Nov 13 10:31:18 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042
Nov 13 10:31:18 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:31:18 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:31:18 user nova-compute[74611]: FIRMWARE:
Nov 13 10:31:18 user nova-compute[74611]: No targets found.
Nov 13 10:31:18 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:31:18 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:31:18 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6102755e-e36a-42a7-ae56-c5d5f16edb45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6b9de7-9526-4ec1-8c7d-3683f0d3cf6c]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)
Nov 13 10:31:18 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 (non-flash)
Nov 13 10:31:18 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb642ae8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3382283-0aa9-472a-bc76-318aa4657007]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c355e54-fc68-4496-ae2f-8527ce8ba930]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d8e303-09b7-42c1-b2d1-5b4d851ed864]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d74054a-cebc-4279-82ca-9e847c8b4a80]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOa5139378-f3044fcfe000bded', '/dev/disk/by-id/scsi-26633303434666366', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a5139378') {{(pid=85776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 10:31:18 user nova-compute[74611]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOa5139378-f3044fcfe000bded
Nov 13 10:31:18 user nova-compute[74611]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26633303434666366
Nov 13 10:31:18 user nova-compute[74611]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_a5139378
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f84d0b-7930-40aa-a47e-64cd57b93abc]: (4, None) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc3bdba-8338-444f-abf3-638fc1213240]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a606233-e015-4b99-a3e3-64496d08c370]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042, portal: 172.16.0.220,3260]
Nov 13 10:31:18 user nova-compute[74611]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042, portal: 172.16.0.220,3260] successful.
Nov 13 10:31:18 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac1a6fda-0266-45a9-962f-60dbd3942042 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c02917f-cac7-48b8-abdc-a08f07bef2c4]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] <== disconnect_volume: return (362ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:31:18 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:31:18 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Deleting instance files /opt/stack/data/nova/instances/f68bf9fb-0b41-48fa-a9d4-a44131abd424_del
Nov 13 10:31:18 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Deletion of /opt/stack/data/nova/instances/f68bf9fb-0b41-48fa-a9d4-a44131abd424_del complete
Nov 13 10:31:19 user nova-compute[74611]: INFO nova.compute.manager [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 13 10:31:19 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:31:19 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:31:19 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:31:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:19 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:31:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:19 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:31:19 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Took 0.54 seconds to deallocate network for instance.
Nov 13 10:31:20 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-5ce4e27c-1cd9-4870-bcec-5b61a426498d req-f27a1978-f892-49bf-9cd1-e1c5b5cea69e service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received event network-vif-unplugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:31:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5ce4e27c-1cd9-4870-bcec-5b61a426498d req-f27a1978-f892-49bf-9cd1-e1c5b5cea69e service nova] Acquiring lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:31:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5ce4e27c-1cd9-4870-bcec-5b61a426498d req-f27a1978-f892-49bf-9cd1-e1c5b5cea69e service nova] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:31:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5ce4e27c-1cd9-4870-bcec-5b61a426498d req-f27a1978-f892-49bf-9cd1-e1c5b5cea69e service nova] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:31:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-5ce4e27c-1cd9-4870-bcec-5b61a426498d req-f27a1978-f892-49bf-9cd1-e1c5b5cea69e service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] No waiting events found dispatching network-vif-unplugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:31:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-5ce4e27c-1cd9-4870-bcec-5b61a426498d req-f27a1978-f892-49bf-9cd1-e1c5b5cea69e service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received event network-vif-unplugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:31:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-5ce4e27c-1cd9-4870-bcec-5b61a426498d req-f27a1978-f892-49bf-9cd1-e1c5b5cea69e service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received event network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:31:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5ce4e27c-1cd9-4870-bcec-5b61a426498d req-f27a1978-f892-49bf-9cd1-e1c5b5cea69e service nova] Acquiring lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:31:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5ce4e27c-1cd9-4870-bcec-5b61a426498d req-f27a1978-f892-49bf-9cd1-e1c5b5cea69e service nova] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:31:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-5ce4e27c-1cd9-4870-bcec-5b61a426498d req-f27a1978-f892-49bf-9cd1-e1c5b5cea69e service nova] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:31:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-5ce4e27c-1cd9-4870-bcec-5b61a426498d req-f27a1978-f892-49bf-9cd1-e1c5b5cea69e service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] No waiting events found dispatching network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:31:20 user nova-compute[74611]: WARNING nova.compute.manager [req-5ce4e27c-1cd9-4870-bcec-5b61a426498d req-f27a1978-f892-49bf-9cd1-e1c5b5cea69e service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received unexpected event network-vif-plugged-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 for instance with vm_state active and task_state deleting.
Nov 13 10:31:20 user nova-compute[74611]: DEBUG nova.compute.manager [req-9cb0874e-21df-447e-8584-b734786b8791 req-809c7c4b-86ca-45fd-a361-298fafa1576a service nova] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Received event network-vif-deleted-2b937006-d7f5-4fc2-9275-a9f7d8c189a1 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:31:20 user nova-compute[74611]: INFO nova.compute.manager [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Took 0.78 seconds to detach 1 volumes for instance.
Nov 13 10:31:20 user nova-compute[74611]: DEBUG nova.compute.manager [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] [instance: f68bf9fb-0b41-48fa-a9d4-a44131abd424] Deleting volume: ac1a6fda-0266-45a9-962f-60dbd3942042 {{(pid=74611) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 10:31:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:31:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:31:20 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:31:20 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:31:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:31:20 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Deleted allocations for instance f68bf9fb-0b41-48fa-a9d4-a44131abd424
Nov 13 10:31:20 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-b1728a7d-ccdf-4845-9b72-726ffca06de0 tempest-TestShelveInstance-194060203 tempest-TestShelveInstance-194060203-project-member] Lock "f68bf9fb-0b41-48fa-a9d4-a44131abd424" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.023s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:31:21 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:31:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:31:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:31:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:31:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:31:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:31:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:31:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:31:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:31:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:31:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:31:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:31:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:31:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:31:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:31:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:31:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:31:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:31:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:31:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:31:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:03 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:32:05 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:32:05 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:32:05 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:32:05 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Didn't find any instances for network info cache update. {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 10:32:08 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:32:08 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:32:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:08 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:32:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:32:09 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:32:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:32:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:32:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:32:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:32:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:32:09 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:32:09 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:32:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=9122MB free_disk=25.215450286865234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:32:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:32:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:32:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:32:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:32:09 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:32:09 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:32:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:32:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:32:10 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:12 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:32:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:13 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:16 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:32:17 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:32:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:32:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:32:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:32:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:32:18 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:19 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:32:23 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:32:28 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:32:33 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:38 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:32:40 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:43 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:44 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:48 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:53 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Starting instance... {{(pid=74611) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74611) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 10:32:54 user nova-compute[74611]: INFO nova.compute.claims [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Claim successful on node user
Nov 13 10:32:54 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.190s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Start building networks asynchronously for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Allocating IP information in the background. {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] allocate_for_instance() {{(pid=74611) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 10:32:54 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 10:32:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Start building block device mappings for instance. {{(pid=74611) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG nova.policy [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31056262291043c7a51d08c3d1e4dd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df34cbc03bc4b7ea591477b8f61346c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74611) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Start spawning the instance on the hypervisor. {{(pid=74611) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Creating instance directory {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 10:32:54 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Creating image(s)
Nov 13 10:32:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "/opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "/opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "/opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:32:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.191s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.228s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk 1073741824 {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915,backing_fmt=raw /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk 1073741824" returned: 0 in 0.077s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "f66cf751f71bf6b4c341123e725ea35f01eaf915" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f66cf751f71bf6b4c341123e725ea35f01eaf915 --force-share --output=json" returned: 0 in 0.211s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Checking if we can resize image /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk. size=1073741824 {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Successfully created port: bf5ae128-f52f-4baf-9578-19fc3fccbde9 {{(pid=74611) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG nova.virt.disk.api [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Cannot resize image /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk to a smaller size. {{(pid=74611) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Created local disks {{(pid=74611) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Ensure instance console log exists: /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/console.log {{(pid=74611) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:32:55 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:32:56 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Successfully updated port: bf5ae128-f52f-4baf-9578-19fc3fccbde9 {{(pid=74611) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 10:32:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:32:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquired lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:32:56 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Building network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 10:32:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-2aeae7a4-8c82-4c9a-9340-c4ec706e27f9 req-4578320d-ed67-49bb-8a10-f9fec706af14 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Received event network-changed-bf5ae128-f52f-4baf-9578-19fc3fccbde9 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:32:56 user nova-compute[74611]: DEBUG nova.compute.manager [req-2aeae7a4-8c82-4c9a-9340-c4ec706e27f9 req-4578320d-ed67-49bb-8a10-f9fec706af14 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Refreshing instance network info cache due to event network-changed-bf5ae128-f52f-4baf-9578-19fc3fccbde9. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:32:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2aeae7a4-8c82-4c9a-9340-c4ec706e27f9 req-4578320d-ed67-49bb-8a10-f9fec706af14 service nova] Acquiring lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:32:56 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Instance cache missing network info. {{(pid=74611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 10:32:56 user nova-compute[74611]: DEBUG nova.network.neutron [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updating instance_info_cache with network_info: [{"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:32:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Releasing lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:32:56 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Instance network_info: |[{"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74611) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 10:32:56 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2aeae7a4-8c82-4c9a-9340-c4ec706e27f9 req-4578320d-ed67-49bb-8a10-f9fec706af14 service nova] Acquired lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:32:56 user nova-compute[74611]: DEBUG nova.network.neutron [req-2aeae7a4-8c82-4c9a-9340-c4ec706e27f9 req-4578320d-ed67-49bb-8a10-f9fec706af14 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Refreshing network info cache for port bf5ae128-f52f-4baf-9578-19fc3fccbde9 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:32:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Start _get_guest_xml network_info=[{"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b51f50a6-3c60-4450-bd2c-4073087acec9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 10:32:56 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:32:56 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:32:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 10:32:56 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] CPU controller missing on host. {{(pid=74611) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.host [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] CPU controller found on host. {{(pid=74611) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74611) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T09:49:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T09:50:00Z,direct_url=<?>,disk_format='qcow2',id=b51f50a6-3c60-4450-bd2c-4073087acec9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d2600c1c1bc43ca9eb9a25c96f462ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T09:50:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Flavor limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Image limits 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Flavor pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Image pref 0:0:0 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Got 1 possible topologies {{(pid=74611) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.hardware [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74611) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1263756364',display_name='tempest-SnapshotDataIntegrityTests-server-1263756364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1263756364',id=53,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeUGa7CxV5YMVS/PTt0+bHFWpY6aDezgAFtwHkEdXWO2f6rJQL2NEVpyRw7OlCHZsgIrxwm+2XPBD2HzQTVycjZPRR0e/6/TCNcC+lKsBVCBft4nO61pwm/WhXAXdxUFQ==',key_name='tempest-keypair-1476586738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9df34cbc03bc4b7ea591477b8f61346c',ramdisk_id='',reservation_id='r-1ku1hvop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-412992398',owner_user_name='tempest-SnapshotDataIntegrityTests-412992398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31056262291043c7a51d08c3d1e4dd9c',uuid=260deeda-5160-4951-8777-1eebb211987c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74611) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Converting VIF {"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:26:d9,bridge_name='br-int',has_traffic_filtering=True,id=bf5ae128-f52f-4baf-9578-19fc3fccbde9,network=Network(faa3ee57-2e91-4e8b-a5f8-4faebb889931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5ae128-f5') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.objects.instance [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lazy-loading 'pci_devices' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] End _get_guest_xml xml=<domain type="kvm">
Nov 13 10:32:57 user nova-compute[74611]:   <uuid>260deeda-5160-4951-8777-1eebb211987c</uuid>
Nov 13 10:32:57 user nova-compute[74611]:   <name>instance-00000035</name>
Nov 13 10:32:57 user nova-compute[74611]:   <memory>524288</memory>
Nov 13 10:32:57 user nova-compute[74611]:   <vcpu>1</vcpu>
Nov 13 10:32:57 user nova-compute[74611]:   <metadata>
Nov 13 10:32:57 user nova-compute[74611]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 10:32:57 user nova-compute[74611]:       <nova:package version="0.0.0"/>
Nov 13 10:32:57 user nova-compute[74611]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1263756364</nova:name>
Nov 13 10:32:57 user nova-compute[74611]:       <nova:creationTime>2023-11-13 10:32:56</nova:creationTime>
Nov 13 10:32:57 user nova-compute[74611]:       <nova:flavor name="m1.tiny">
Nov 13 10:32:57 user nova-compute[74611]:         <nova:memory>512</nova:memory>
Nov 13 10:32:57 user nova-compute[74611]:         <nova:disk>1</nova:disk>
Nov 13 10:32:57 user nova-compute[74611]:         <nova:swap>0</nova:swap>
Nov 13 10:32:57 user nova-compute[74611]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 10:32:57 user nova-compute[74611]:         <nova:vcpus>1</nova:vcpus>
Nov 13 10:32:57 user nova-compute[74611]:       </nova:flavor>
Nov 13 10:32:57 user nova-compute[74611]:       <nova:owner>
Nov 13 10:32:57 user nova-compute[74611]:         <nova:user uuid="31056262291043c7a51d08c3d1e4dd9c">tempest-SnapshotDataIntegrityTests-412992398-project-member</nova:user>
Nov 13 10:32:57 user nova-compute[74611]:         <nova:project uuid="9df34cbc03bc4b7ea591477b8f61346c">tempest-SnapshotDataIntegrityTests-412992398</nova:project>
Nov 13 10:32:57 user nova-compute[74611]:       </nova:owner>
Nov 13 10:32:57 user nova-compute[74611]:       <nova:root type="image" uuid="b51f50a6-3c60-4450-bd2c-4073087acec9"/>
Nov 13 10:32:57 user nova-compute[74611]:       <nova:ports>
Nov 13 10:32:57 user nova-compute[74611]:         <nova:port uuid="bf5ae128-f52f-4baf-9578-19fc3fccbde9">
Nov 13 10:32:57 user nova-compute[74611]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 10:32:57 user nova-compute[74611]:         </nova:port>
Nov 13 10:32:57 user nova-compute[74611]:       </nova:ports>
Nov 13 10:32:57 user nova-compute[74611]:     </nova:instance>
Nov 13 10:32:57 user nova-compute[74611]:   </metadata>
Nov 13 10:32:57 user nova-compute[74611]:   <sysinfo type="smbios">
Nov 13 10:32:57 user nova-compute[74611]:     <system>
Nov 13 10:32:57 user nova-compute[74611]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 10:32:57 user nova-compute[74611]:       <entry name="product">OpenStack Nova</entry>
Nov 13 10:32:57 user nova-compute[74611]:       <entry name="version">0.0.0</entry>
Nov 13 10:32:57 user nova-compute[74611]:       <entry name="serial">260deeda-5160-4951-8777-1eebb211987c</entry>
Nov 13 10:32:57 user nova-compute[74611]:       <entry name="uuid">260deeda-5160-4951-8777-1eebb211987c</entry>
Nov 13 10:32:57 user nova-compute[74611]:       <entry name="family">Virtual Machine</entry>
Nov 13 10:32:57 user nova-compute[74611]:     </system>
Nov 13 10:32:57 user nova-compute[74611]:   </sysinfo>
Nov 13 10:32:57 user nova-compute[74611]:   <os>
Nov 13 10:32:57 user nova-compute[74611]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 10:32:57 user nova-compute[74611]:     <boot dev="hd"/>
Nov 13 10:32:57 user nova-compute[74611]:     <smbios mode="sysinfo"/>
Nov 13 10:32:57 user nova-compute[74611]:   </os>
Nov 13 10:32:57 user nova-compute[74611]:   <features>
Nov 13 10:32:57 user nova-compute[74611]:     <acpi/>
Nov 13 10:32:57 user nova-compute[74611]:     <apic/>
Nov 13 10:32:57 user nova-compute[74611]:     <vmcoreinfo/>
Nov 13 10:32:57 user nova-compute[74611]:   </features>
Nov 13 10:32:57 user nova-compute[74611]:   <clock offset="utc">
Nov 13 10:32:57 user nova-compute[74611]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 10:32:57 user nova-compute[74611]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 10:32:57 user nova-compute[74611]:     <timer name="hpet" present="no"/>
Nov 13 10:32:57 user nova-compute[74611]:   </clock>
Nov 13 10:32:57 user nova-compute[74611]:   <cpu mode="custom" match="exact">
Nov 13 10:32:57 user nova-compute[74611]:     <model>Nehalem</model>
Nov 13 10:32:57 user nova-compute[74611]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 10:32:57 user nova-compute[74611]:   </cpu>
Nov 13 10:32:57 user nova-compute[74611]:   <devices>
Nov 13 10:32:57 user nova-compute[74611]:     <disk type="file" device="disk">
Nov 13 10:32:57 user nova-compute[74611]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 10:32:57 user nova-compute[74611]:       <source file="/opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk"/>
Nov 13 10:32:57 user nova-compute[74611]:       <target dev="vda" bus="virtio"/>
Nov 13 10:32:57 user nova-compute[74611]:     </disk>
Nov 13 10:32:57 user nova-compute[74611]:     <interface type="ethernet">
Nov 13 10:32:57 user nova-compute[74611]:       <mac address="fa:16:3e:20:26:d9"/>
Nov 13 10:32:57 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:32:57 user nova-compute[74611]:       <mtu size="1442"/>
Nov 13 10:32:57 user nova-compute[74611]:       <target dev="tapbf5ae128-f5"/>
Nov 13 10:32:57 user nova-compute[74611]:     </interface>
Nov 13 10:32:57 user nova-compute[74611]:     <serial type="pty">
Nov 13 10:32:57 user nova-compute[74611]:       <log file="/opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/console.log" append="off"/>
Nov 13 10:32:57 user nova-compute[74611]:     </serial>
Nov 13 10:32:57 user nova-compute[74611]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 10:32:57 user nova-compute[74611]:     <video>
Nov 13 10:32:57 user nova-compute[74611]:       <model type="virtio"/>
Nov 13 10:32:57 user nova-compute[74611]:     </video>
Nov 13 10:32:57 user nova-compute[74611]:     <rng model="virtio">
Nov 13 10:32:57 user nova-compute[74611]:       <backend model="random">/dev/urandom</backend>
Nov 13 10:32:57 user nova-compute[74611]:     </rng>
Nov 13 10:32:57 user nova-compute[74611]:     <controller type="usb" index="0" model="none"/>
Nov 13 10:32:57 user nova-compute[74611]:     <memballoon model="virtio">
Nov 13 10:32:57 user nova-compute[74611]:       <stats period="10"/>
Nov 13 10:32:57 user nova-compute[74611]:     </memballoon>
Nov 13 10:32:57 user nova-compute[74611]:   </devices>
Nov 13 10:32:57 user nova-compute[74611]: </domain>
Nov 13 10:32:57 user nova-compute[74611]:  {{(pid=74611) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1263756364',display_name='tempest-SnapshotDataIntegrityTests-server-1263756364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1263756364',id=53,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeUGa7CxV5YMVS/PTt0+bHFWpY6aDezgAFtwHkEdXWO2f6rJQL2NEVpyRw7OlCHZsgIrxwm+2XPBD2HzQTVycjZPRR0e/6/TCNcC+lKsBVCBft4nO61pwm/WhXAXdxUFQ==',key_name='tempest-keypair-1476586738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9df34cbc03bc4b7ea591477b8f61346c',ramdisk_id='',reservation_id='r-1ku1hvop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-412992398',owner_user_name='tempest-SnapshotDataIntegrityTests-412992398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T10:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31056262291043c7a51d08c3d1e4dd9c',uuid=260deeda-5160-4951-8777-1eebb211987c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Converting VIF {"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:26:d9,bridge_name='br-int',has_traffic_filtering=True,id=bf5ae128-f52f-4baf-9578-19fc3fccbde9,network=Network(faa3ee57-2e91-4e8b-a5f8-4faebb889931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5ae128-f5') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG os_vif [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:26:d9,bridge_name='br-int',has_traffic_filtering=True,id=bf5ae128-f52f-4baf-9578-19fc3fccbde9,network=Network(faa3ee57-2e91-4e8b-a5f8-4faebb889931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5ae128-f5') {{(pid=74611) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de873c99-ede7-5c8e-ab6c-a8dcefd5d5e5', '_type': 'linux-noop'}}, row=False) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf5ae128-f5, may_exist=True, interface_attrs={}) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf5ae128-f5, col_values=(('qos', UUID('f27244b3-c203-4a6e-aae3-b66199c5a8a1')),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf5ae128-f5, col_values=(('external_ids', {'iface-id': 'bf5ae128-f52f-4baf-9578-19fc3fccbde9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:26:d9', 'vm-uuid': '260deeda-5160-4951-8777-1eebb211987c'}),), if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:57 user nova-compute[74611]: INFO os_vif [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:26:d9,bridge_name='br-int',has_traffic_filtering=True,id=bf5ae128-f52f-4baf-9578-19fc3fccbde9,network=Network(faa3ee57-2e91-4e8b-a5f8-4faebb889931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5ae128-f5')
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] No VIF found with MAC fa:16:3e:20:26:d9, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.network.neutron [req-2aeae7a4-8c82-4c9a-9340-c4ec706e27f9 req-4578320d-ed67-49bb-8a10-f9fec706af14 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updated VIF entry in instance network info cache for port bf5ae128-f52f-4baf-9578-19fc3fccbde9. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG nova.network.neutron [req-2aeae7a4-8c82-4c9a-9340-c4ec706e27f9 req-4578320d-ed67-49bb-8a10-f9fec706af14 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updating instance_info_cache with network_info: [{"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:32:57 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-2aeae7a4-8c82-4c9a-9340-c4ec706e27f9 req-4578320d-ed67-49bb-8a10-f9fec706af14 service nova] Releasing lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:32:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:58 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-394cc3f8-1066-4865-91ed-6a4a21cc09d6 req-40eb170e-0e0f-4bfa-aa27-0aa336c8cf5c service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Received event network-vif-plugged-bf5ae128-f52f-4baf-9578-19fc3fccbde9 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:32:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-394cc3f8-1066-4865-91ed-6a4a21cc09d6 req-40eb170e-0e0f-4bfa-aa27-0aa336c8cf5c service nova] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:32:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-394cc3f8-1066-4865-91ed-6a4a21cc09d6 req-40eb170e-0e0f-4bfa-aa27-0aa336c8cf5c service nova] Lock "260deeda-5160-4951-8777-1eebb211987c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:32:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-394cc3f8-1066-4865-91ed-6a4a21cc09d6 req-40eb170e-0e0f-4bfa-aa27-0aa336c8cf5c service nova] Lock "260deeda-5160-4951-8777-1eebb211987c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:32:59 user nova-compute[74611]: DEBUG nova.compute.manager [req-394cc3f8-1066-4865-91ed-6a4a21cc09d6 req-40eb170e-0e0f-4bfa-aa27-0aa336c8cf5c service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] No waiting events found dispatching network-vif-plugged-bf5ae128-f52f-4baf-9578-19fc3fccbde9 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:32:59 user nova-compute[74611]: WARNING nova.compute.manager [req-394cc3f8-1066-4865-91ed-6a4a21cc09d6 req-40eb170e-0e0f-4bfa-aa27-0aa336c8cf5c service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Received unexpected event network-vif-plugged-bf5ae128-f52f-4baf-9578-19fc3fccbde9 for instance with vm_state building and task_state spawning.
Nov 13 10:32:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:32:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:00 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Instance event wait completed in 0 seconds for  {{(pid=74611) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 10:33:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Guest created on hypervisor {{(pid=74611) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 10:33:00 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 260deeda-5160-4951-8777-1eebb211987c] Instance spawned successfully.
Nov 13 10:33:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 10:33:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Found default for hw_cdrom_bus of ide {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:33:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Found default for hw_disk_bus of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:33:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Found default for hw_input_bus of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:33:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Found default for hw_pointer_model of None {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:33:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Found default for hw_video_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:33:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Found default for hw_vif_model of virtio {{(pid=74611) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 10:33:00 user nova-compute[74611]: INFO nova.compute.manager [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 13 10:33:00 user nova-compute[74611]: DEBUG nova.compute.manager [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Checking state {{(pid=74611) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 10:33:01 user nova-compute[74611]: INFO nova.compute.manager [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Took 6.60 seconds to build instance.
Nov 13 10:33:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-e5de5da9-0388-41e2-85ba-e7c6ea5670f4 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.700s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:33:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-78a26e83-41d9-4b0e-84d4-fbb62e6cbf9c req-a9d45c33-3730-4006-b0fa-9fa291d32f49 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Received event network-vif-plugged-bf5ae128-f52f-4baf-9578-19fc3fccbde9 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:33:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-78a26e83-41d9-4b0e-84d4-fbb62e6cbf9c req-a9d45c33-3730-4006-b0fa-9fa291d32f49 service nova] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:33:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-78a26e83-41d9-4b0e-84d4-fbb62e6cbf9c req-a9d45c33-3730-4006-b0fa-9fa291d32f49 service nova] Lock "260deeda-5160-4951-8777-1eebb211987c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:33:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-78a26e83-41d9-4b0e-84d4-fbb62e6cbf9c req-a9d45c33-3730-4006-b0fa-9fa291d32f49 service nova] Lock "260deeda-5160-4951-8777-1eebb211987c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:33:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-78a26e83-41d9-4b0e-84d4-fbb62e6cbf9c req-a9d45c33-3730-4006-b0fa-9fa291d32f49 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] No waiting events found dispatching network-vif-plugged-bf5ae128-f52f-4baf-9578-19fc3fccbde9 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:33:01 user nova-compute[74611]: WARNING nova.compute.manager [req-78a26e83-41d9-4b0e-84d4-fbb62e6cbf9c req-a9d45c33-3730-4006-b0fa-9fa291d32f49 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Received unexpected event network-vif-plugged-bf5ae128-f52f-4baf-9578-19fc3fccbde9 for instance with vm_state active and task_state None.
Nov 13 10:33:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:06 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:33:06 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:33:06 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:33:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:33:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:33:06 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:33:06 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:33:06 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updating instance_info_cache with network_info: [{"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:33:06 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:33:06 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:33:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:08 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:33:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:33:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:33:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:33:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:33:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:33:09 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:33:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:33:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:33:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:33:09 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:33:10 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:33:10 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:33:10 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8913MB free_disk=25.199237823486328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:33:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:33:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:33:10 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 260deeda-5160-4951-8777-1eebb211987c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:33:10 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:33:10 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:33:10 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:33:10 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:33:10 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:33:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:33:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:33:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:33:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:33:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:33:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:33:12 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:33:12 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:33:12 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:33:14 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:16 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:33:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:17 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:33:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:20 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:33:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:24 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:29 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:33:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:33:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:33:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:33:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:33:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:33:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:33:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:33:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:33:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:33:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:33:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:33:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:33:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:33:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:33:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:33:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:33:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:33:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:33:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:33:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:33:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:33:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:33:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:34:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:34:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:34:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:34:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:34:07 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:34:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:34:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:34:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:34:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:34:07 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:34:07 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:34:07 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updating instance_info_cache with network_info: [{"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:34:07 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:34:07 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:34:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:34:10 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:34:11 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:34:11 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:34:11 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:34:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:34:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:34:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:34:11 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:34:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:34:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:34:12 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:34:12 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:34:12 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8969MB free_disk=25.170486450195312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:34:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:34:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:34:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:34:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:34:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:34:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:34:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:12 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 260deeda-5160-4951-8777-1eebb211987c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:34:12 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:34:12 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:34:12 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:34:12 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:34:12 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:34:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:34:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:34:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:34:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:18 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:34:19 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:34:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:34:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:34:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:34:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:34:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:22 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:34:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:34:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:34:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:34:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:34:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:34:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:34:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:34:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:34:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:34:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:34:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-33bd1571-03e4-4014-8b6a-090b5f654bdc req-3db86c4e-c275-41a8-b87e-931bb51437a4 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Received event network-changed-bf5ae128-f52f-4baf-9578-19fc3fccbde9 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:34:45 user nova-compute[74611]: DEBUG nova.compute.manager [req-33bd1571-03e4-4014-8b6a-090b5f654bdc req-3db86c4e-c275-41a8-b87e-931bb51437a4 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Refreshing instance network info cache due to event network-changed-bf5ae128-f52f-4baf-9578-19fc3fccbde9. {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 10:34:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-33bd1571-03e4-4014-8b6a-090b5f654bdc req-3db86c4e-c275-41a8-b87e-931bb51437a4 service nova] Acquiring lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:34:45 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-33bd1571-03e4-4014-8b6a-090b5f654bdc req-3db86c4e-c275-41a8-b87e-931bb51437a4 service nova] Acquired lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:34:45 user nova-compute[74611]: DEBUG nova.network.neutron [req-33bd1571-03e4-4014-8b6a-090b5f654bdc req-3db86c4e-c275-41a8-b87e-931bb51437a4 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Refreshing network info cache for port bf5ae128-f52f-4baf-9578-19fc3fccbde9 {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 10:34:46 user nova-compute[74611]: DEBUG nova.network.neutron [req-33bd1571-03e4-4014-8b6a-090b5f654bdc req-3db86c4e-c275-41a8-b87e-931bb51437a4 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updated VIF entry in instance network info cache for port bf5ae128-f52f-4baf-9578-19fc3fccbde9. {{(pid=74611) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 10:34:46 user nova-compute[74611]: DEBUG nova.network.neutron [req-33bd1571-03e4-4014-8b6a-090b5f654bdc req-3db86c4e-c275-41a8-b87e-931bb51437a4 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updating instance_info_cache with network_info: [{"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:34:46 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-33bd1571-03e4-4014-8b6a-090b5f654bdc req-3db86c4e-c275-41a8-b87e-931bb51437a4 service nova] Releasing lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:34:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:34:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:34:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:34:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:34:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG nova.objects.instance [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lazy-loading 'flavor' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:34:48 user nova-compute[74611]: INFO nova.compute.manager [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Attaching volume 75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 to /dev/vdb
Nov 13 10:34:48 user nova-compute[74611]: DEBUG os_brick.utils [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dfa436-0edd-4000-a42f-d217f66b213d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[17da7ede-28ca-4067-b228-6a04fe7c3e0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd46803-37fe-4443-b113-06d5f1519a57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce209b27-b171-4712-a81a-b5314c30cb3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:34:48 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:34:48 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8125b4e-fde2-4322-ac43-7fb030a7b184]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG os_brick.utils [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:34:48 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updating existing volume attachment record: 931cfe55-09db-409c-9dc1-a9b63599c2cd {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:34:49 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWLXdoFI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:34:52 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:34:52 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:34:52 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0301ce6b-42a9-4dcf-905b-66d373089bdb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:34:52 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[36faa880-bcee-4078-9ca4-6422888d7e6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826] added
Nov 13 10:34:52 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7bb6eb-2c4f-4765-89d1-897eab66bfc4]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1857ebf2-f39e-44fb-932e-268be6c30d7c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DWLXdoFI {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DWLXdoFI" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2093e4d-1661-433b-aca3-3de427e2e0f8]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DWLXdoFI'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[672b8464-c747-4cc2-a05b-ede301d6b890]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35d511d-306f-411d-acd9-449f30e75b3a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 10:34:52 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 10:34:52 user nova-compute[74611]:  {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:34:52 user nova-compute[74611]: WARNING os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 10:34:52 user nova-compute[74611]: 
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0287b0d1-1ffd-402e-9ed4-9fd2d07e57a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826, portal: 172.16.0.220,3260]
Nov 13 10:34:52 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826, portal: 172.16.0.220,3260] successful.
Nov 13 10:34:52 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de2bc14-9093-46f5-8980-ca1106c0b737]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a22ecc-5e6e-461a-bc85-b48210afb3d8]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 (non-flash)
Nov 13 10:34:52 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 (non-flash)
Nov 13 10:34:52 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:34:52 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:34:53 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:34:53 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db2ddfd-765f-42db-91ec-fa18b9e9f81d]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:34:53 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:34:53 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWLXdoFI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:34:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:34:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26139366665643534', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:34:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139366665643534', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:34:54 user nova-compute[74611]: DEBUG nova.objects.instance [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lazy-loading 'flavor' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:34:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:34:54 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:34:54 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:34:54 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:34:54 user nova-compute[74611]:   <serial>75573f1f-2cff-48fc-a1cc-1eb6b2d0a826</serial>
Nov 13 10:34:54 user nova-compute[74611]: </disk>
Nov 13 10:34:54 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:34:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:34:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:34:54 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] No VIF found with MAC fa:16:3e:20:26:d9, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:34:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1638e076-cc2a-4a37-abb0-791a13537b36 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:34:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:34:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:35:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:35:02 user nova-compute[74611]: INFO nova.compute.manager [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Detaching volume 75573f1f-2cff-48fc-a1cc-1eb6b2d0a826
Nov 13 10:35:02 user nova-compute[74611]: INFO nova.virt.block_device [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Attempting to driver detach volume 75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 from mountpoint /dev/vdb
Nov 13 10:35:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Attempting to detach device vdb from instance 260deeda-5160-4951-8777-1eebb211987c from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:35:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:35:02 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:35:02 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:35:02 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:35:02 user nova-compute[74611]:   <serial>75573f1f-2cff-48fc-a1cc-1eb6b2d0a826</serial>
Nov 13 10:35:02 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:35:02 user nova-compute[74611]: </disk>
Nov 13 10:35:02 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:35:02 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Successfully detached device vdb from instance 260deeda-5160-4951-8777-1eebb211987c from the persistent domain config.
Nov 13 10:35:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 260deeda-5160-4951-8777-1eebb211987c from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:35:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:35:02 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:35:02 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:35:02 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:35:02 user nova-compute[74611]:   <serial>75573f1f-2cff-48fc-a1cc-1eb6b2d0a826</serial>
Nov 13 10:35:02 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:35:02 user nova-compute[74611]: </disk>
Nov 13 10:35:02 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:35:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:35:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:35:09 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:35:09 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:35:09 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:35:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:35:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:35:09 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:35:09 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:35:09 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updating instance_info_cache with network_info: [{"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:35:09 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:35:09 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:35:10 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:35:11 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:35:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:35:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:35:11 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:35:11 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:35:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:11 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:12 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:35:12 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:35:12 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8984MB free_disk=25.169235229492188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:35:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:35:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:35:12 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 260deeda-5160-4951-8777-1eebb211987c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:35:12 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:35:12 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:35:12 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing inventories for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 10:35:12 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating ProviderTree inventory for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 10:35:12 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating inventory in ProviderTree for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 10:35:12 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing aggregate associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, aggregates: None {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 10:35:12 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing trait associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 10:35:12 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:35:12 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:35:12 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:35:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:35:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:35:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:35:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:35:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 10:35:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] There are 0 instances to clean {{(pid=74611) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 10:35:15 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:35:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:35:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:35:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:35:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:35:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:19 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:20 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:35:21 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:22 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 260deeda-5160-4951-8777-1eebb211987c is timed out.
Nov 13 10:35:22 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Successfully detached device vdb from instance 260deeda-5160-4951-8777-1eebb211987c from the live domain config.
Nov 13 10:35:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWLXdoFI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:35:22 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ef85ac-ec3a-4785-9021-b77dab07f4a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:35:22 user nova-compute[74611]: No targets found.
Nov 13 10:35:22 user nova-compute[74611]: iSNS:
Nov 13 10:35:22 user nova-compute[74611]: No targets found.
Nov 13 10:35:22 user nova-compute[74611]: STATIC:
Nov 13 10:35:22 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826
Nov 13 10:35:22 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:35:22 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:35:22 user nova-compute[74611]: FIRMWARE:
Nov 13 10:35:22 user nova-compute[74611]: No targets found.
Nov 13 10:35:22 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:35:22 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:35:22 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[50373769-6d1b-40e1-a026-9d3e419a8cb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc60bc7-e652-494f-8c96-87cdeab31b29]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 (non-flash)
Nov 13 10:35:22 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 (non-flash)
Nov 13 10:35:22 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64682cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[445a0ca7-2fc0-4f72-ae01-57f1275c24df]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d33af7a-fe63-4e8a-bfa8-99155545ed3b]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1499943-54e1-4d9d-ac87-1c0526830b5d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c68659-e241-4641-8f7b-7bb8a00eecdb]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19ba515-32e8-41bc-a891-30c21992861d]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[098824cc-87ea-4b43-892d-286846eefed7]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826, portal: 172.16.0.220,3260]
Nov 13 10:35:22 user nova-compute[74611]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826, portal: 172.16.0.220,3260] successful.
Nov 13 10:35:22 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75573f1f-2cff-48fc-a1cc-1eb6b2d0a826 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c9fcbc-996c-4663-8b35-244959f3d395]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] <== disconnect_volume: return (297ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:35:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:35:23 user nova-compute[74611]: DEBUG nova.objects.instance [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lazy-loading 'flavor' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:35:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-d0de0418-c884-4878-a4ec-481d93ec7f51 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.611s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:35:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:35:31 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:35:31 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74611) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 10:35:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:35:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:35:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:35:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:35:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:35:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:35:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:35:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:35:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:35:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:35:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:35:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:35:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:35:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:43 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:35:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:35:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:35:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:35:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:35:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:35:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:35:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:35:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:35:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:35:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:35:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:35:53 user nova-compute[74611]: DEBUG nova.objects.instance [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lazy-loading 'flavor' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:35:53 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:35:54 user nova-compute[74611]: INFO nova.compute.manager [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Attaching volume 62baac0b-77de-497d-87b4-ecd92b9ec6a5 to /dev/vdb
Nov 13 10:35:54 user nova-compute[74611]: DEBUG os_brick.utils [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb9e719-d5a1-449a-9c82-a040d54ac752]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d710c71-94bc-453f-879c-62d996639f6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f778277-3b87-4e36-843e-e37c20e9b107]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[55860e85-bfea-4ae6-bf01-873a62b4f312]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:35:54 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:35:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b42f0c-2895-4f0e-b5bb-d2181d033d5f]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG os_brick.utils [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updating existing volume attachment record: a7e98ee7-1002-4d8a-8b78-16541b1e5532 {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:35:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTOrgdpt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:35:58 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:35:58 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:35:58 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c066a5-351b-4edd-9a3a-efdacddfaa8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:35:58 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa7187f-785c-46a2-a752-350426f35fee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5] added
Nov 13 10:35:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2365845c-8368-46c6-895a-876bc749fe2c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9aaea9f-eddd-4c63-a941-ec24f6748929]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HTOrgdpt {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HTOrgdpt" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[269ebe9c-a349-482c-a8dc-463843600b4b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HTOrgdpt'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3124b06b-1171-4399-86fc-87bf18577181]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b5ba0c-f7f4-434f-bc75-ed90361c42aa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 10:35:58 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 10:35:58 user nova-compute[74611]:  {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:35:58 user nova-compute[74611]: WARNING os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 10:35:58 user nova-compute[74611]: 
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d867685-9655-476c-ae14-19313d22374c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5, portal: 172.16.0.220,3260]
Nov 13 10:35:58 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5, portal: 172.16.0.220,3260] successful.
Nov 13 10:35:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e565731d-deea-490e-b47d-a2f20f338f0b]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed069807-6b1e-462f-8429-2bfd45afd1a4]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 (non-flash)
Nov 13 10:35:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 (non-flash)
Nov 13 10:35:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bc0d10-ced5-4c52-9a1a-212c01d41d35]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:35:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTOrgdpt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:35:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:35:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23939656438303161', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:35:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939656438303161', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:35:59 user nova-compute[74611]: DEBUG nova.objects.instance [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lazy-loading 'flavor' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:35:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:35:59 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:35:59 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:35:59 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:35:59 user nova-compute[74611]:   <serial>62baac0b-77de-497d-87b4-ecd92b9ec6a5</serial>
Nov 13 10:35:59 user nova-compute[74611]: </disk>
Nov 13 10:35:59 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:35:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:35:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:35:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] No VIF found with MAC fa:16:3e:20:26:d9, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:35:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-7444cd54-f9a3-4f10-a607-236c3f1329f9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.862s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:36:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:36:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:36:02 user nova-compute[74611]: INFO nova.compute.manager [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Detaching volume 62baac0b-77de-497d-87b4-ecd92b9ec6a5
Nov 13 10:36:02 user nova-compute[74611]: INFO nova.virt.block_device [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Attempting to driver detach volume 62baac0b-77de-497d-87b4-ecd92b9ec6a5 from mountpoint /dev/vdb
Nov 13 10:36:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Attempting to detach device vdb from instance 260deeda-5160-4951-8777-1eebb211987c from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:36:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:36:02 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:36:02 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:36:02 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:36:02 user nova-compute[74611]:   <serial>62baac0b-77de-497d-87b4-ecd92b9ec6a5</serial>
Nov 13 10:36:02 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:36:02 user nova-compute[74611]: </disk>
Nov 13 10:36:02 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:36:02 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Successfully detached device vdb from instance 260deeda-5160-4951-8777-1eebb211987c from the persistent domain config.
Nov 13 10:36:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 260deeda-5160-4951-8777-1eebb211987c from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:36:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:36:02 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:36:02 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:36:02 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:36:02 user nova-compute[74611]:   <serial>62baac0b-77de-497d-87b4-ecd92b9ec6a5</serial>
Nov 13 10:36:02 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:36:02 user nova-compute[74611]: </disk>
Nov 13 10:36:02 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:36:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:36:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:36:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:36:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:36:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:36:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:36:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:36:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:36:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:36:10 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:36:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:36:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:36:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:36:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:36:10 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:36:10 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:36:10 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updating instance_info_cache with network_info: [{"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:36:10 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:36:10 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:36:11 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:36:12 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:36:12 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:36:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:36:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:36:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:36:12 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:36:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:36:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:13 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:36:13 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:36:13 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8959MB free_disk=25.168277740478516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:36:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:36:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:36:13 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 260deeda-5160-4951-8777-1eebb211987c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:36:13 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:36:13 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:36:13 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:36:13 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:36:13 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:36:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:36:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:36:15 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:36:15 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:36:17 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:36:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:36:21 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:36:21 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:36:22 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 260deeda-5160-4951-8777-1eebb211987c is timed out.
Nov 13 10:36:22 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Successfully detached device vdb from instance 260deeda-5160-4951-8777-1eebb211987c from the live domain config.
Nov 13 10:36:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTOrgdpt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:36:22 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[67caf735-51a7-4d99-aa48-39782bb98209]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:36:22 user nova-compute[74611]: No targets found.
Nov 13 10:36:22 user nova-compute[74611]: iSNS:
Nov 13 10:36:22 user nova-compute[74611]: No targets found.
Nov 13 10:36:22 user nova-compute[74611]: STATIC:
Nov 13 10:36:22 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5
Nov 13 10:36:22 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:36:22 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:36:22 user nova-compute[74611]: FIRMWARE:
Nov 13 10:36:22 user nova-compute[74611]: No targets found.
Nov 13 10:36:22 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:36:22 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:36:22 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14dda2a-f003-41e0-95e3-7b2aa998424a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef929dd1-581a-4a49-a628-27212442c035]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 (non-flash)
Nov 13 10:36:22 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 (non-flash)
Nov 13 10:36:22 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8424fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f4d111-d907-4702-a9cc-1fc061966497]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[965195f4-53c0-426f-8b86-3c7ecc4e60b3]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb77f3c-247b-4eb9-a770-2e611c18e8c7]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43d6def-b202-41ae-ba80-2f7d719ec375]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[614c9fc7-4ba9-43ef-a840-66bef4b5d442]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[456285c1-b9b4-4193-9e38-ce287313d6d6]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5, portal: 172.16.0.220,3260]
Nov 13 10:36:22 user nova-compute[74611]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5, portal: 172.16.0.220,3260] successful.
Nov 13 10:36:22 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62baac0b-77de-497d-87b4-ecd92b9ec6a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c99b31-d0bb-4af8-8344-daf0212bdfc5]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] <== disconnect_volume: return (298ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:36:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:36:23 user nova-compute[74611]: DEBUG nova.objects.instance [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lazy-loading 'flavor' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:36:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-44a0c11d-ff75-4c6a-882a-a28ef7c5cd32 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.604s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:36:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:36:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:36:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:36:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:36:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:36:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:36:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:36:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:36:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:36:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:36:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG nova.objects.instance [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lazy-loading 'flavor' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:36:54 user nova-compute[74611]: INFO nova.compute.manager [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Attaching volume 28d3f800-9571-4b42-875d-ac40da7a6e6a to /dev/vdb
Nov 13 10:36:54 user nova-compute[74611]: DEBUG os_brick.utils [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7de3f77-8b80-4da4-ba05-abfe5338cbe9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d763984-1133-4c96-b539-95a5680b01c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40eff8b-6f95-49a9-a882-f9f3f2db3b37]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bec391-3590-42e4-ac66-76e3d6f3b588]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:36:54 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:36:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3c9f45-6700-4de4-8d81-5f05aeefaf2a]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG os_brick.utils [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updating existing volume attachment record: e7b13920-ddd5-462f-af30-0bb90347009d {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:36:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:36:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhVSMnkG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:36:58 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:36:58 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:36:58 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f9cb17-5574-48b8-8932-2c4b20fb3ada]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:36:58 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ccff8d-256e-43bd-bc0e-2bcc5b24010b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a] added
Nov 13 10:36:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[664b0f57-a6c0-4196-b83c-14b76995ad8a]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f429ae7-36e7-4063-b18a-83abdf52825f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vhVSMnkG {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vhVSMnkG" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa710d01-e4a9-4493-addc-4fd42745bb5c]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vhVSMnkG'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adc5be1-b7c2-4681-b6de-1f49fbfc37a7]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaa1f4d-6f14-4c00-b30b-2840274d4836]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 10:36:58 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 10:36:58 user nova-compute[74611]:  {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:36:58 user nova-compute[74611]: WARNING os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 10:36:58 user nova-compute[74611]: 
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b7527f-9069-4fa3-a70b-e8729d424420]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a, portal: 172.16.0.220,3260]
Nov 13 10:36:58 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a, portal: 172.16.0.220,3260] successful.
Nov 13 10:36:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e310887-31be-4340-a736-1fd1274f88ac]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[520afa22-cb83-409d-af06-eb9310d8870f]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a (non-flash)
Nov 13 10:36:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a (non-flash)
Nov 13 10:36:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.229s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[236cf8c2-eb77-4739-80db-87963ed9f762]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:36:58 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:36:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:36:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhVSMnkG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:36:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.256s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:36:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] <== connect_volume: return (1258ms) {'type': 'block', 'scsi_wwn': '23062326662666662', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:36:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062326662666662', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:36:59 user nova-compute[74611]: DEBUG nova.objects.instance [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lazy-loading 'flavor' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:36:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:36:59 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:36:59 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:36:59 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:36:59 user nova-compute[74611]:   <serial>28d3f800-9571-4b42-875d-ac40da7a6e6a</serial>
Nov 13 10:36:59 user nova-compute[74611]: </disk>
Nov 13 10:36:59 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:36:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:36:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:36:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] No VIF found with MAC fa:16:3e:20:26:d9, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:36:59 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-1d553385-96a6-4461-b8a3-c613954533b9 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.780s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:37:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:37:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:37:02 user nova-compute[74611]: INFO nova.compute.manager [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Detaching volume 28d3f800-9571-4b42-875d-ac40da7a6e6a
Nov 13 10:37:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:37:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:37:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:37:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:37:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:37:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:37:02 user nova-compute[74611]: INFO nova.virt.block_device [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Attempting to driver detach volume 28d3f800-9571-4b42-875d-ac40da7a6e6a from mountpoint /dev/vdb
Nov 13 10:37:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Attempting to detach device vdb from instance 260deeda-5160-4951-8777-1eebb211987c from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:37:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:37:02 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:37:02 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:37:02 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:37:02 user nova-compute[74611]:   <serial>28d3f800-9571-4b42-875d-ac40da7a6e6a</serial>
Nov 13 10:37:02 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:37:02 user nova-compute[74611]: </disk>
Nov 13 10:37:02 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:37:02 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Successfully detached device vdb from instance 260deeda-5160-4951-8777-1eebb211987c from the persistent domain config.
Nov 13 10:37:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 260deeda-5160-4951-8777-1eebb211987c from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:37:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:37:02 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:37:02 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:37:02 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:37:02 user nova-compute[74611]:   <serial>28d3f800-9571-4b42-875d-ac40da7a6e6a</serial>
Nov 13 10:37:02 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:37:02 user nova-compute[74611]: </disk>
Nov 13 10:37:02 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:37:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:37:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:37:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updating instance_info_cache with network_info: [{"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:37:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:13 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:13 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:37:13 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:37:13 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=25.16729736328125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:37:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:37:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:37:13 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 260deeda-5160-4951-8777-1eebb211987c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:37:13 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:37:13 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:37:13 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:37:13 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:37:13 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:37:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:37:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:37:16 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:37:16 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:37:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:37:18 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:37:21 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:37:22 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 260deeda-5160-4951-8777-1eebb211987c is timed out.
Nov 13 10:37:22 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Successfully detached device vdb from instance 260deeda-5160-4951-8777-1eebb211987c from the live domain config.
Nov 13 10:37:22 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhVSMnkG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:37:22 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:37:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5b4141-c698-41fd-828c-3d0d4af360ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:37:22 user nova-compute[74611]: No targets found.
Nov 13 10:37:22 user nova-compute[74611]: iSNS:
Nov 13 10:37:22 user nova-compute[74611]: No targets found.
Nov 13 10:37:22 user nova-compute[74611]: STATIC:
Nov 13 10:37:22 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a
Nov 13 10:37:22 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:37:22 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:37:22 user nova-compute[74611]: FIRMWARE:
Nov 13 10:37:22 user nova-compute[74611]: No targets found.
Nov 13 10:37:22 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:37:22 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:37:22 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb94c97-74ee-477f-b360-be8fe15f3d5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb08e98a-0d4f-4620-ab00-ee00fd4dad85]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a (non-flash)
Nov 13 10:37:22 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a (non-flash)
Nov 13 10:37:22 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb64523d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:37:22 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[050402a9-8820-4626-814e-30610ccdcba6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcaabbf-f30c-4866-a319-4eebd342375b]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d383c26-0810-47f0-954c-c5dc12a843dc]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a50300-924b-4db4-b4be-05adb7a39444]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52667a4-6faa-4efa-a7fb-a451dc424ac2]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f2d86d-7419-43b5-8b99-2aa975efeee9]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a, portal: 172.16.0.220,3260]
Nov 13 10:37:23 user nova-compute[74611]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a, portal: 172.16.0.220,3260] successful.
Nov 13 10:37:23 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d3f800-9571-4b42-875d-ac40da7a6e6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3279be-7ae8-4604-ba6e-d2fc546f0868]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] <== disconnect_volume: return (299ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG nova.objects.instance [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lazy-loading 'flavor' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:37:23 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-660a01ad-b5f0-430a-ad15-e0cd70c5c0a1 tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.648s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:37:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:37:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:37:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:37:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:37:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:37:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:37:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:37:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:37:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:37:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:37:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:37:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:37:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:37:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:37:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:37:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:37:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:37:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:37:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:37:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:37:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG nova.objects.instance [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lazy-loading 'flavor' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:37:54 user nova-compute[74611]: INFO nova.compute.manager [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Attaching volume 086432d8-f4c2-47e6-8778-0264a5996123 to /dev/vdb
Nov 13 10:37:54 user nova-compute[74611]: DEBUG os_brick.utils [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaed0378-3ab0-416e-9c3c-b2db504a337b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29adca924774\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68c9395-a197-42dd-a990-967d9ceb87d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[0138f763-38ba-43a9-adef-84fcfdd54d1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b56a108-5bcd-4101-8a70-f514b1840afe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Running cmd (subprocess): nvme version {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] 'nvme version' failed. Not Retrying. {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] nvme not present on system {{(pid=74611) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 10:37:54 user nova-compute[74611]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 10:37:54 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9de64b-0243-4acb-8921-c7044246754b]: (4, '') {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74611) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.lightos [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] LIGHTOS: no hostnqn found. {{(pid=74611) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG os_brick.utils [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29adca924774', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG nova.virt.block_device [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updating existing volume attachment record: d4d64665-b654-45cd-9a5f-af5d539ba5aa {{(pid=74611) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 10:37:54 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:37:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Calling os-brick to attach iSCSI Volume {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IRZzWewT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:37:58 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:37:58 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:37:58 user nova-compute[74611]: INFO os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b8feb6-1002-4b85-9826-47cc87328d30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 10:37:58 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --interface default --op new {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef9cc22-26e0-4fce-a479-0d11e4112cd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123] added\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123] added
Nov 13 10:37:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2069870-24a9-4802-8f57-7055358f0051]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9370c60-b8ca-4c48-b219-5dfbdf73d34f]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IRZzWewT {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IRZzWewT" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24143e7-5f3a-459b-bafb-da47f4796da0]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IRZzWewT'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fd9d5f-bd2b-48e2-80ab-96dcf78c96a9]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[efab1013-78cd-4d94-87da-887f7ee02b04]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 10:37:58 user nova-compute[74611]:  {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 10:37:58 user nova-compute[74611]:  {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:37:58 user nova-compute[74611]: WARNING os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 10:37:58 user nova-compute[74611]: 
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --login {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f44a63e-622d-4b85-83b8-59ed56d1d186]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123, portal: 172.16.0.220,3260]
Nov 13 10:37:58 user nova-compute[74611]: Login to [iface: default, target: iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123, portal: 172.16.0.220,3260] successful.
Nov 13 10:37:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf94fb9-2ddb-4a57-9627-972df2d5dfdc]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14874b4-149b-40b0-a4cc-c31e43c9f90b]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 (non-flash)
Nov 13 10:37:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 (non-flash)
Nov 13 10:37:58 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Connected to 172.16.0.220:3260 {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74611) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74611) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f98645a-3b40-4961-ad89-3115d65fa8ef]: (4, ('- - 0', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:37:58 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:37:59 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74611) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 10:37:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IRZzWewT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74611) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 10:37:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:37:59 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23034343430623332', 'path': '/dev/sdb'} {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:37:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034343430623332', 'path': '/dev/sdb'} {{(pid=74611) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 10:37:59 user nova-compute[74611]: DEBUG nova.objects.instance [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lazy-loading 'flavor' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:37:59 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 10:37:59 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:37:59 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:37:59 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:37:59 user nova-compute[74611]:   <serial>086432d8-f4c2-47e6-8778-0264a5996123</serial>
Nov 13 10:37:59 user nova-compute[74611]: </disk>
Nov 13 10:37:59 user nova-compute[74611]:  {{(pid=74611) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 10:38:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] No BDM found with device name vda, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:38:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74611) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 10:38:00 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] No VIF found with MAC fa:16:3e:20:26:d9, not building metadata {{(pid=74611) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 10:38:00 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-cd906110-4bbe-4745-955f-49e5e4f9592d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.835s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:38:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:38:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:38:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:38:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:38:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:38:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:38:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:38:02 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:38:02 user nova-compute[74611]: INFO nova.compute.manager [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Detaching volume 086432d8-f4c2-47e6-8778-0264a5996123
Nov 13 10:38:02 user nova-compute[74611]: INFO nova.virt.block_device [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Attempting to driver detach volume 086432d8-f4c2-47e6-8778-0264a5996123 from mountpoint /dev/vdb
Nov 13 10:38:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Attempting to detach device vdb from instance 260deeda-5160-4951-8777-1eebb211987c from the persistent domain config. {{(pid=74611) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 10:38:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:38:02 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:38:02 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:38:02 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:38:02 user nova-compute[74611]:   <serial>086432d8-f4c2-47e6-8778-0264a5996123</serial>
Nov 13 10:38:02 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:38:02 user nova-compute[74611]: </disk>
Nov 13 10:38:02 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:38:02 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Successfully detached device vdb from instance 260deeda-5160-4951-8777-1eebb211987c from the persistent domain config.
Nov 13 10:38:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 260deeda-5160-4951-8777-1eebb211987c from the live domain config. {{(pid=74611) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 10:38:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.guest [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 10:38:02 user nova-compute[74611]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 10:38:02 user nova-compute[74611]:   <source dev="/dev/sdb"/>
Nov 13 10:38:02 user nova-compute[74611]:   <target dev="vdb" bus="virtio"/>
Nov 13 10:38:02 user nova-compute[74611]:   <serial>086432d8-f4c2-47e6-8778-0264a5996123</serial>
Nov 13 10:38:02 user nova-compute[74611]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 10:38:02 user nova-compute[74611]: </disk>
Nov 13 10:38:02 user nova-compute[74611]:  {{(pid=74611) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 10:38:03 user nova-compute[74611]: DEBUG nova.virt.libvirt.driver [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 10:38:04 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:38:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:38:12 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:38:12 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:38:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:38:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:38:12 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:38:12 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:38:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:38:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:38:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:38:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:38:12 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:38:13 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:38:13 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:38:13 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=25.166385650634766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:38:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:38:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:38:13 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Instance 260deeda-5160-4951-8777-1eebb211987c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74611) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 10:38:13 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:38:13 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:38:13 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:38:13 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:38:13 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:38:13 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:38:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:38:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:38:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:38:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:38:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:38:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 10:38:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquired lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 10:38:14 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Forcefully refreshing network info cache for instance {{(pid=74611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 10:38:14 user nova-compute[74611]: DEBUG nova.objects.instance [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lazy-loading 'info_cache' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:38:14 user nova-compute[74611]: DEBUG nova.network.neutron [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updating instance_info_cache with network_info: [{"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:38:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Releasing lock "refresh_cache-260deeda-5160-4951-8777-1eebb211987c" {{(pid=74611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 10:38:14 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updated the network info_cache for instance {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 10:38:17 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:38:17 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:38:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:38:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:38:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:38:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:38:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:38:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:38:20 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:38:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:38:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:38:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:38:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:38:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:38:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:38:23 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 260deeda-5160-4951-8777-1eebb211987c is timed out.
Nov 13 10:38:23 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Successfully detached device vdb from instance 260deeda-5160-4951-8777-1eebb211987c from the live domain config.
Nov 13 10:38:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] calling os-brick to detach iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7c2b88b0>, {'target_iqn': 'iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IRZzWewT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 10:38:23 user nova-compute[74611]: WARNING os_brick.initiator.connectors.base [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[272280f8-04ef-4f93-8a55-df69d5fbc16d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 10:38:23 user nova-compute[74611]: No targets found.
Nov 13 10:38:23 user nova-compute[74611]: iSNS:
Nov 13 10:38:23 user nova-compute[74611]: No targets found.
Nov 13 10:38:23 user nova-compute[74611]: STATIC:
Nov 13 10:38:23 user nova-compute[74611]: Target: iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123
Nov 13 10:38:23 user nova-compute[74611]:         Portal: 172.16.0.220:3260,-1
Nov 13 10:38:23 user nova-compute[74611]:                 Iface Name: default
Nov 13 10:38:23 user nova-compute[74611]: FIRMWARE:
Nov 13 10:38:23 user nova-compute[74611]: No targets found.
Nov 13 10:38:23 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 10:38:23 user nova-compute[74611]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 10:38:23 user nova-compute[74611]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74611) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123', 0)] {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0402c0-eb5c-48f4-8a21-953ed2e820cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[353ea480-04be-4348-bd42-41b19f9d800d]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 (non-flash)\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 (non-flash)
Nov 13 10:38:23 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 (non-flash)
Nov 13 10:38:23 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb642ac8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123'): ({'sdb'}, set())}) {{(pid=74611) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Removing single pathed devices sdb {{(pid=74611) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a367b1e-c08c-41a5-86f7-2877750d7d0a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bed95bb-aa02-4002-9987-a9bdeb95789b]: (4, ('ok\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Flushing IO for device /dev/sdb {{(pid=74611) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b831f8-d1e2-4b6b-b4ac-78be5ccffcee]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74611) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8af29a8-7d59-4686-bc5a-1647aafbf48e]: (4, ('1', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.linuxscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] SCSI volumes sdb have been removed. {{(pid=74611) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123')] {{(pid=74611) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2bb976-8c1c-4fb2-bc36-ff1980515086]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --logout {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[e039ba25-0096-454a-b85b-a7c512068364]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123, portal: 172.16.0.220,3260]
Nov 13 10:38:23 user nova-compute[74611]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123, portal: 172.16.0.220,3260] successful.
Nov 13 10:38:23 user nova-compute[74611]:  stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --op delete {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:086432d8-f4c2-47e6-8778-0264a5996123 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0e3fcc-8931-46ac-8f2d-6d136c897533]: (4, ('', '')) {{(pid=85776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74611) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.base [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG os_brick.initiator.connectors.iscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] <== disconnect_volume: return (257ms) None {{(pid=74611) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 10:38:23 user nova-compute[74611]: DEBUG nova.virt.libvirt.volume.iscsi [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Disconnected iSCSI Volume {{(pid=74611) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 10:38:24 user nova-compute[74611]: DEBUG nova.objects.instance [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lazy-loading 'flavor' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:38:24 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-469d49ad-ea46-4cc1-bb62-68be9a6c73dd tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.564s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:38:25 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:38:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:38:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:38:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:38:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:38:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:38:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:38:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:38:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:38:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:38:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:38:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:38:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:38:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:38:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:38:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:38:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:38:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:38:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:38:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:38:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:38:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:38:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:38:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:38:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:38:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:38:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:38:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:39:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:39:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:39:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:39:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:39:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:39:01 user nova-compute[74611]: INFO nova.compute.manager [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Terminating instance
Nov 13 10:39:01 user nova-compute[74611]: DEBUG nova.compute.manager [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Start destroying the instance on the hypervisor. {{(pid=74611) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 10:39:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:39:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:39:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:39:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:39:01 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:39:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-8a680061-0570-4848-b7b3-92abf38455a8 req-9da44a65-4003-4fff-9c71-cc879dc68676 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Received event network-vif-unplugged-bf5ae128-f52f-4baf-9578-19fc3fccbde9 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:39:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8a680061-0570-4848-b7b3-92abf38455a8 req-9da44a65-4003-4fff-9c71-cc879dc68676 service nova] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:39:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8a680061-0570-4848-b7b3-92abf38455a8 req-9da44a65-4003-4fff-9c71-cc879dc68676 service nova] Lock "260deeda-5160-4951-8777-1eebb211987c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:39:01 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-8a680061-0570-4848-b7b3-92abf38455a8 req-9da44a65-4003-4fff-9c71-cc879dc68676 service nova] Lock "260deeda-5160-4951-8777-1eebb211987c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:39:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-8a680061-0570-4848-b7b3-92abf38455a8 req-9da44a65-4003-4fff-9c71-cc879dc68676 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] No waiting events found dispatching network-vif-unplugged-bf5ae128-f52f-4baf-9578-19fc3fccbde9 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:39:01 user nova-compute[74611]: DEBUG nova.compute.manager [req-8a680061-0570-4848-b7b3-92abf38455a8 req-9da44a65-4003-4fff-9c71-cc879dc68676 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Received event network-vif-unplugged-bf5ae128-f52f-4baf-9578-19fc3fccbde9 for instance with task_state deleting. {{(pid=74611) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 10:39:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:39:02 user nova-compute[74611]: INFO nova.virt.libvirt.driver [-] [instance: 260deeda-5160-4951-8777-1eebb211987c] Instance destroyed successfully.
Nov 13 10:39:02 user nova-compute[74611]: DEBUG nova.objects.instance [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lazy-loading 'resources' on Instance uuid 260deeda-5160-4951-8777-1eebb211987c {{(pid=74611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 10:39:02 user nova-compute[74611]: DEBUG nova.virt.libvirt.vif [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T10:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1263756364',display_name='tempest-SnapshotDataIntegrityTests-server-1263756364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1263756364',id=53,image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeUGa7CxV5YMVS/PTt0+bHFWpY6aDezgAFtwHkEdXWO2f6rJQL2NEVpyRw7OlCHZsgIrxwm+2XPBD2HzQTVycjZPRR0e/6/TCNcC+lKsBVCBft4nO61pwm/WhXAXdxUFQ==',key_name='tempest-keypair-1476586738',keypairs=<?>,launch_index=0,launched_at=2023-11-13T10:33:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9df34cbc03bc4b7ea591477b8f61346c',ramdisk_id='',reservation_id='r-1ku1hvop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b51f50a6-3c60-4450-bd2c-4073087acec9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-412992398',owner_user_name='tempest-SnapshotDataIntegrityTests-412992398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T10:33:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31056262291043c7a51d08c3d1e4dd9c',uuid=260deeda-5160-4951-8777-1eebb211987c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 10:39:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Converting VIF {"id": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "address": "fa:16:3e:20:26:d9", "network": {"id": "faa3ee57-2e91-4e8b-a5f8-4faebb889931", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1850662329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df34cbc03bc4b7ea591477b8f61346c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5ae128-f5", "ovs_interfaceid": "bf5ae128-f52f-4baf-9578-19fc3fccbde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 10:39:02 user nova-compute[74611]: DEBUG nova.network.os_vif_util [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:26:d9,bridge_name='br-int',has_traffic_filtering=True,id=bf5ae128-f52f-4baf-9578-19fc3fccbde9,network=Network(faa3ee57-2e91-4e8b-a5f8-4faebb889931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5ae128-f5') {{(pid=74611) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 10:39:02 user nova-compute[74611]: DEBUG os_vif [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:26:d9,bridge_name='br-int',has_traffic_filtering=True,id=bf5ae128-f52f-4baf-9578-19fc3fccbde9,network=Network(faa3ee57-2e91-4e8b-a5f8-4faebb889931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5ae128-f5') {{(pid=74611) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 10:39:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:39:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf5ae128-f5, bridge=br-int, if_exists=True) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:39:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:39:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:39:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:39:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f27244b3-c203-4a6e-aae3-b66199c5a8a1) {{(pid=74611) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 10:39:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:39:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:39:02 user nova-compute[74611]: INFO os_vif [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:26:d9,bridge_name='br-int',has_traffic_filtering=True,id=bf5ae128-f52f-4baf-9578-19fc3fccbde9,network=Network(faa3ee57-2e91-4e8b-a5f8-4faebb889931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5ae128-f5')
Nov 13 10:39:02 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Deleting instance files /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c_del
Nov 13 10:39:02 user nova-compute[74611]: INFO nova.virt.libvirt.driver [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Deletion of /opt/stack/data/nova/instances/260deeda-5160-4951-8777-1eebb211987c_del complete
Nov 13 10:39:02 user nova-compute[74611]: INFO nova.compute.manager [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] [instance: 260deeda-5160-4951-8777-1eebb211987c] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 10:39:02 user nova-compute[74611]: DEBUG oslo.service.loopingcall [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74611) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 10:39:02 user nova-compute[74611]: DEBUG nova.compute.manager [-] [instance: 260deeda-5160-4951-8777-1eebb211987c] Deallocating network for instance {{(pid=74611) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 10:39:02 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 260deeda-5160-4951-8777-1eebb211987c] deallocate_for_instance() {{(pid=74611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 10:39:03 user nova-compute[74611]: DEBUG nova.network.neutron [-] [instance: 260deeda-5160-4951-8777-1eebb211987c] Updating instance_info_cache with network_info: [] {{(pid=74611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 10:39:03 user nova-compute[74611]: INFO nova.compute.manager [-] [instance: 260deeda-5160-4951-8777-1eebb211987c] Took 0.77 seconds to deallocate network for instance.
Nov 13 10:39:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:39:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:39:03 user nova-compute[74611]: DEBUG nova.compute.manager [req-856942d4-62f0-426b-afca-bb14dcf6120f req-53337a91-87c5-4393-ae41-6fb8766e2c47 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Received event network-vif-deleted-bf5ae128-f52f-4baf-9578-19fc3fccbde9 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:39:03 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:39:03 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:39:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:39:03 user nova-compute[74611]: INFO nova.scheduler.client.report [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Deleted allocations for instance 260deeda-5160-4951-8777-1eebb211987c
Nov 13 10:39:03 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-8728b17a-901d-4fa0-9c35-38e91a9e3d2d tempest-SnapshotDataIntegrityTests-412992398 tempest-SnapshotDataIntegrityTests-412992398-project-member] Lock "260deeda-5160-4951-8777-1eebb211987c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.923s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:39:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-105cf960-cb81-4d2f-961c-73b128bc3a46 req-c4596859-f43e-4b54-8f0a-b2e204aca871 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Received event network-vif-plugged-bf5ae128-f52f-4baf-9578-19fc3fccbde9 {{(pid=74611) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 10:39:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-105cf960-cb81-4d2f-961c-73b128bc3a46 req-c4596859-f43e-4b54-8f0a-b2e204aca871 service nova] Acquiring lock "260deeda-5160-4951-8777-1eebb211987c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:39:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-105cf960-cb81-4d2f-961c-73b128bc3a46 req-c4596859-f43e-4b54-8f0a-b2e204aca871 service nova] Lock "260deeda-5160-4951-8777-1eebb211987c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:39:04 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [req-105cf960-cb81-4d2f-961c-73b128bc3a46 req-c4596859-f43e-4b54-8f0a-b2e204aca871 service nova] Lock "260deeda-5160-4951-8777-1eebb211987c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:39:04 user nova-compute[74611]: DEBUG nova.compute.manager [req-105cf960-cb81-4d2f-961c-73b128bc3a46 req-c4596859-f43e-4b54-8f0a-b2e204aca871 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] No waiting events found dispatching network-vif-plugged-bf5ae128-f52f-4baf-9578-19fc3fccbde9 {{(pid=74611) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 10:39:04 user nova-compute[74611]: WARNING nova.compute.manager [req-105cf960-cb81-4d2f-961c-73b128bc3a46 req-c4596859-f43e-4b54-8f0a-b2e204aca871 service nova] [instance: 260deeda-5160-4951-8777-1eebb211987c] Received unexpected event network-vif-plugged-bf5ae128-f52f-4baf-9578-19fc3fccbde9 for instance with vm_state deleted and task_state None.
Nov 13 10:39:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:39:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:39:13 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:39:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:39:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:39:13 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Didn't find any instances for network info cache update. {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 10:39:13 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:39:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:39:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:39:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:39:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:39:14 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:39:14 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:39:14 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:39:14 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=9114MB free_disk=25.193470001220703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:39:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:39:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:39:14 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:39:14 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:39:14 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:39:14 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:39:14 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:39:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:39:16 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:39:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:39:19 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:39:19 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 10:39:22 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:39:22 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:39:24 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:39:25 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:39:27 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:39:27 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:39:32 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:39:37 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:39:42 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:39:47 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:39:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:39:52 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:39:56 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:39:57 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:39:59 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:40:02 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:40:07 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:40:12 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:40:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:40:14 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:40:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:40:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:40:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:40:14 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Auditing locally available compute resources for user (node: user) {{(pid=74611) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 10:40:14 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:40:14 user nova-compute[74611]: WARNING nova.virt.libvirt.driver [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 10:40:14 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Hypervisor/Node resource view: name=user free_ram=9237MB free_disk=25.192230224609375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74611) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 10:40:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 10:40:14 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 10:40:14 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 10:40:14 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74611) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 10:40:14 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing inventories for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 10:40:14 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating ProviderTree inventory for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 10:40:14 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Updating inventory in ProviderTree for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 10:40:14 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing aggregate associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, aggregates: None {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 10:40:14 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Refreshing trait associations for resource provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74611) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 10:40:15 user nova-compute[74611]: DEBUG nova.compute.provider_tree [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed in ProviderTree for provider: f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a {{(pid=74611) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 10:40:15 user nova-compute[74611]: DEBUG nova.scheduler.client.report [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Inventory has not changed for provider f6de3dc0-0bbc-4a8f-92fa-f83c90b9b11a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74611) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 10:40:15 user nova-compute[74611]: DEBUG nova.compute.resource_tracker [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Compute_service record updated for user:user {{(pid=74611) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 10:40:15 user nova-compute[74611]: DEBUG oslo_concurrency.lockutils [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=74611) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 10:40:16 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:40:16 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Starting heal instance info cache {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 10:40:16 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Rebuilding the list of instances to heal {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 10:40:16 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Didn't find any instances for network info cache update. {{(pid=74611) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 10:40:16 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:40:17 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:40:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 10:40:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:40:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74611) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 10:40:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:40:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74611) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 10:40:17 user nova-compute[74611]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74611) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 10:40:21 user nova-compute[74611]: DEBUG oslo_service.periodic_task [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74611) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 10:40:21 user nova-compute[74611]: DEBUG nova.compute.manager [None req-2487078b-29b8-42d1-bf8e-afda74f1a188 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74611) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}